Project

fluent-plugin-rds-log

0.01
No commit activity in last 3 years
No release in over 3 years
fluent-plugin-rds-logshinsaka/fluent-plugin-rds-logHomepageDocumentationSource CodeWiki
Amazon RDS slow_log and general_log input plugin for Fluent event collector
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
37,000
Stars
10
Forks
7
Watchers
3
 Releases
Current version
0.3.2
Total releases
14
First release
2013-10-10
Latest release
2018-10-03
 Pull Requests
Open Pull Requests
1
Closed Pull Requests
2
Merged Pull Requests
11
Pull Request Acceptance Rate
78%
 Development
Primary Language
Ruby
Licenses
MIT
Average date of last 50 commits
2016-04-05
Reverse Dependencies
0

 Dependencies

Development

rake
>= 10.0.4, ~> 10.0
simplecov
~> 0
test-unit
~> 3.2
webmock
~> 3

Runtime

fluentd
< 2, >= 0.14.0
mysql2
~> 0.4.1
 Project Readme

Amazon RDS (for MySQL) input plugin for Fluentd

Gem Version

Overview

  • Amazon Web Services RDS(MySQL) general_log and slow_log input plugin.

Installation

$ fluent-gem install fluent-plugin-rds-log

Maybe, you also need the following packages

  • MySQL-shared
  • MySQL-shared-compat
  • MySQL-devel

RDS Setting

Working with MySQL Database Log Files / aws documentation

  • Set the log_output parameter to TABLE to write the logs to a database table.
  • Set the slow_query_log parameter to 1
  • Set the general_log parameter to 1
  • setting min_examined_row_limit
  • setting long_query_time

Configuration

<source>
  type rds_log
  log_type <slow_log | general_log>
  host <RDS Hostname1>,<RDS Hostname2>,<RDS Hostname3>.. # multiple database servers(comma separated)
  username <RDS Username>
  password <RDS Password>
  refresh_interval <number>
  auto_reconnect <true|false>
  tag <tag-name>
  add_host false # add database hostname in record
  where <condition> #option
</source>

Example GET RDS general_log

<source>
  type rds_log
  log_type general_log
  host endpoint.abcdefghijkl.ap-northeast-1.rds.amazonaws.com
  username rds_user
  password rds_password
  refresh_interval 30
  auto_reconnect true
  tag rds-general-log
  add_host false # add database hostname in record
  where argument LIKE '%sample_table%'
</source>

<match rds-general-log>
  type file
  path /var/log/rds-general-log
</match>

Changes

0.3.0

  • require fluentd version 0.14.0