Gush is a parallel workflow runner using Redis as storage and ActiveJob for executing jobs.

activejob-locking lets you control how ActiveJobs are enqueued and performed: Allow only one job to be enqueued at a time (based on a lock_id) Allow only one job to be performed at a time (also based on a lock_id)

where the wild things are. err, when resque gets stuck

A Resque plugin which allows you to create dedicated queues for jobs that use rate limited apis. These queues will pause when one of the jobs hits a rate limit, and unpause after a suitable time period. The rate_limited_queue can be used directly, and just requires catching the rate limit exception and pausing the queue. There are also additional queues provided that already include the pause/rety logic for twitter, angelist and evernote; these allow you to support rate limited apis with minimal changes.

Workflow

Runs Rails migrations in a Redis-backed mutex.

A Resque plugin which allows you to create dedicated queues for jobs that use rate-limited APIs. These queues will pause when one of the jobs hits a rate limit, and unpause after a suitable time period. The rate-limited queue can be used directly, and just requires catching the rate limit exception and pausing the queue. There are also additional queues provided that already include the pause/retry logic for Twitter, AngelList and Evernote; these allow you to support rate-limited APIs with minimal changes.

Robin hood leverages celluloid actors and redis-mutex to distribute long-lived, single-instance processes across multiple servers.