Container Broker

• Run any Docker based task
• A Node only needs Docker HTTP API
• Separate Tasks by execution type
• Easily get Task logs
• Automatically retry jobs
• Enqueue tasks if no slots available
• Distribute load between Nodes
• If a node dies, tasks are automatically moved to another healthy Node (Failover)
• Support external volume mounts

Add this line to your application's Gemfile:

gem 'container-broker'

And then execute:

$ bundle install

Or install it yourself as:

$ gem install container-broker

• GET /nodes

• POST /nodes
• Parameters: { "hostname": "", "slots_execution_types": {"cpu": 2, "network": 10} }

• PATCH /nodes/:uuid
• Parameters: { "slots_execution_types": {"cpu": 2, "network": 10} }

• DELETE /nodes/:uuid
• Parameters: { "slots_execution_types": {"cpu": 2, "network": 10} }

• POST /tasks
• Parameters: { "name": "", "image": "", "cmd": "", "storage_mounts": "{}", "tags": {"type": "video"} }
• Response:

{
  "status": "ok|error",
  "uuid": "2d272b5c-953c-44e9-ad15-6c31187903c9"
}

• Show information about some job
• Parameters (query string): id
• Response:

{
  "uuid": "2d272b5c-953c-44e9-ad15-6c31187903c9",
  "status": "waiting|running|completed|error"
}

• Show pool informations
• Response:

{
  "nodes": [
    {
      "hostname": "",
      "cores": 10,
      "memory": 4096,
      "jobs": [
        {
          "uuid": "2d272b5c-953c-44e9-ad15-6c31187903c9",
          "status": "waiting|running|completed|error"
        }
      ]
    }
  ]
}

After checking out the repo, run bin/setup to install dependencies. Then, run rake spec to run the tests. You can also run bin/console for an interactive prompt that will allow you to experiment.

To install this gem onto your local machine, run bundle exec rake install. To release a new version, update the version number in version.rb, and then run bundle exec rake release, which will create a git tag for the version, push git commits and tags, and push the .gem file to rubygems.org.

socat TCP-LISTEN:2376,reuseaddr,fork UNIX-CONNECT:/var/run/docker.sock

Bug reports and pull requests are welcome on GitHub at https://github.com/globocom/container-broker.