Project

fluent-plugin-rds-slowlog

0.02
No commit activity in last 3 years
No release in over 3 years
fluent-plugin-rds-slowlogkenjiskywalker/fluent-plugin-rds-slowlogHomepageDocumentationSource CodeBug TrackerWiki
Amazon RDS slow_log input plugin for Fluent event collector
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
25,195
Stars
23
Forks
10
Watchers
4
 Releases
Current version
0.0.8
Total releases
8
First release
2013-03-09
Latest release
2017-02-23
 Issues
Open Issues
1
Closed Issues
1
Total Issues
2
Issue Closure Rate
50%
 Pull Requests
Open Pull Requests
0
Closed Pull Requests
3
Merged Pull Requests
13
Pull Request Acceptance Rate
81%
 Development
Primary Language
Ruby
Average date of last 50 commits
2016-06-10
Reverse Dependencies
0

 Dependencies

Development

rake
>= 10.0.4
test-unit
~> 3.1.3
timecop
>= 0

Runtime

fluentd
>= 0
mysql2
~> 0.3.11
 Project Readme

fluent-plugin-rds-slowlog Build Status

RDS Setting

Working with MySQL Database Log Files / aws documentation

  • Set the slow_query_log parameter to 1
  • setting min_examined_row_limit
  • setting long_query_time

Overview

AWS RDS slow_log input plugin.

  1. "CALL mysql.rds_rotate_slow_log"
  2. "SELECT * FROM slow_log_backup"
  3. "INSERT INTO yourdb.slow_log_custom_backup SELECT * FROM slow_log_backup" (if you want to take a backup)

every 10 seconds from AWS RDS.

Configuration

<source>
  type rds_slowlog
  tag rds-slowlog
  host [RDS Hostname]
  username [RDS Username]
  password [RDS Password]
  backup_table [Your Backup Tablename]
</source>

Example: GET RDS slow_log

<source>
  type rds_slowlog
  tag rds-slowlog
  host [RDS Hostname]
  username [RDS Username]
  password [RDS Password]
  interval 10
  backup_table [Your Backup Tablename]
</source>

<match rds-slowlog>
  type copy
 <store>
  type file
  path /var/log/slow_log
 </store>
</match>

output data format

2013-03-08T16:04:43+09:00       rds-slowlog     {"start_time":"2013-03-08 07:04:38","user_host":"rds_db[rds_db] @  [192.0.2.10]","query_time":"00:00:00","lock_time":"00:00:00","rows_sent":"3000","rows_examined":"3000","db":"rds_db","last_insert_id":"0","insert_id":"0","server_id":"100000000","sql_text":"select foo from bar"}
2013-03-08T16:04:43+09:00       rds-slowlog     {"start_time":"2013-03-08 07:04:38","user_host":"rds_db[rds_db] @  [192.0.2.10]","query_time":"00:00:00","lock_time":"00:00:00","rows_sent":"3000","rows_examined":"3000","db":"rds_db","last_insert_id":"0","insert_id":"0","server_id":"100000000","sql_text":"Quit"}

if not connect

  • td-agent.log
2013-06-29 00:32:55 +0900 [error]: fluent-plugin-rds-slowlog: cannot connect RDS

Example: Encode output string

Specify the encoding of output string. The default is ASCII-8BIT.

<source>
  ...
  encoding UTF-8
</source>

<source>
  ...
  encoding CP932
  from_encoding UTF-8
</source>
  • If specify encoding and from_encoding, the plugin tries to encode string from from_encoding to encoding. This uses ruby's String#encode

You can get supported encoding list by typing following command:

$ ruby -e 'p Encoding.name_list.sort'