No commit activity in last 3 years
No release in over 3 years
Fluentd plugin to move files to swift container
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Runtime

~> 0.12.0
~> 1.15.0
 Project Readme

fluent-plugin-swift-sweep

Fluentd plugin to read data from files and move it Swift object storage as is.

Installation

Add this line to your application's Gemfile:

gem 'fluent-plugin-swift-sweep'

Or install it yourself as:

$ gem install fluent-plugin-swift-sweep

Basic Behavior

Assume your files are inside /tmp/test directory as

tmp/test
├── core.files1.log
├── core.files2.log
└── core.files2.log

This plugin watches the directory (file_path_with_glob tmp/test/*.log). And reads the file and sends it to swift object storage. Finally removes the file, after sending it to swift.

The files after getting moved to swift container:

├── tmp/test/core.files1.log
├── tmp/test/core.files2.log
├── tmp/test/core.files3.log

Configuration

<source>
  type swift_swwep

  # Required. process files that match this pattern using glob.
  file_path_with_glob /tmp/imp/*.log

  # Required. Authentication URL 
  auth_url <Authentication url>

  # Required. Authenticated User Name
  auth_user <User name>

  # Required. Password
  auth_api_key <Password>

  # Required. The name of the openstack tenant
  auth_tenant <Openstack Tenant>

  # Required. The name of the swift container
  swift_container <Container Name>

  ssl_verify false
</source>

ChangeLog

CHANGELOG.md

Warning

  • This plugin supports fluentd from v0.12.33

Contributing

  1. Fork it ( https://github.com/deepakarumugham/fluent-plugin-swift-sweep/fork )
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create a new Pull Request