No commit activity in last 3 years
No release in over 3 years
Command line tool which helps remove old ES indices and types
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Runtime

~> 0.14
 Project Readme

Elasticsearch data cleaner

It is simple command line tool for cleaning old data inside Elasticsearch database

Features

General feature is removing types inside indices. Yes it is rarely case but it can help for removing old data by types

Configuration

For example you need to leave data for the last month, but you have some data which has big size and it doesn't necessary to store it for the whole month. We can remove it by type. Sure you can said that we can store this data in separated indices, but if we need to search information over all our data in Kibana we can't use separated indices.

here is example for this case

---
events-%Y.%m.%d:     # index pattern compatible ruby date format directives
  number: 7          # how many indices script have to keep by pattern above (an index per day)
  future: true       # leave indices with future timestamp. true by default
logstash-%Y.%m.%d:
  number: 31
  future: false
  types:             # types description
    elb:             # type name. there is no patterns
      number: 14
      optimize: true # run _optimize for index after removing this type.
                     # false by default

Installing

from rubygems.org

gem install elasticsearch-data-cleaner

or

gem build elasticsearch-data-cleaner.gemspec
gem install elasticsearch-data-cleaner-<version>.gem