0.0
No commit activity in last 3 years
No release in over 3 years
Send consul watch events to an amqp.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Development

~> 2.0
~> 10.0

Runtime

~> 1.7.0
~> 2.2.4
= 0.3.9
~> 4.6
 Project Readme

NOTICE

This gem is a work in progress. 0.0.x versions are considered to be in ALPHA state where functionality will vary greatly between versions. 0.1.0 will be the first BETA relese and will come with better backwards compatibility guarentees. Please see the TODO documentation

First 0.0.1 release. Partial functionality

Note on naming

This project name is a little confusing in that it called consul_watcher. It is wrapping the consul watch command line tool from Hashicorp. To avoid confusion, this project in the context of both the docker image and ruby gem will be referred to as consul_watcher. Any time that consul watch is used, that is a reference to the actualy Hashicorp command.

Basic functionality

This git project produces a docker image. The basic premise of this docker image is to

  • parse the json output of the consul watch command
  • compare the output to the previous consul watch output
  • send the diff to a destination

The primary destination at this time is an AMQP topic exchange. The underlying logic in the docker image is a ruby gem. To make the gem modular and extensible, the functionality has been broken up into 3 sections; storage, watch_type, and destination.

If we want to do a diff of consul watches, we need to store the previous consul watch json. This is because consul watches kick off new executions on every change, so we can't store the previous run in memory. Storage is accomplished with storage classes. The purpose of the storage class is to just store and retrieve previous consul watch json. At this time, backend storage is planned for both local filesystem, and consul kv storage.

The next type of class, is the watch_type class. This maps to the actual consul watch command --type flag. There are two unfortunate things about the way consul watch commands work. The first is that there is not one consul watch command that can watch for all changes. Each different type of watch requires its own definition. It would be nice to specify one watch that can monitor for changes in all consul areas. This is not the case however. The lack of a single definition bleeds into the next issue which is, each watch type has a very distinct json output format. For the watch json output, instead of having meta data that describes what type of watch the output represents, it is expected that you already know the format because you have to pass the type to the watch command. The entire purpose of the watch_type class is to handle the unique json output for each consul watch type. For every option to the consul watch --type flag, there is a watch_type class. The one exception to this is that key and keyprefix types share the same output. There is just one key watch_type class to represent both.

After the watch_type class handles the data, it will create a json diff between the previous run and the current. This json diff is the message that is sent to the destinations classes. The initial implementation will support two destination classes; AMQP topic exchanges, and stdout through jq.

Quick start guide

The quickest and easiest way to get started is to follow the docker quickstart.

If you are planning to write your own extension for storage/watch_type/destination, then you can check out the ruby quickstart.

Development

Please read the general design documentation. More detailed architectual documenation will be created in the future. All development build and test commands are defined as rake tasks.

Contributing

Bug reports and pull requests are welcome on GitHub at https://github.com/fortman/consul_watcher.

PS. I swear I'm done changing the project name :)