s3ckup

Note: I've rebuild this tool using GO, which I think makes more sense for this job. If you are interested, the GO version is at https://github.com/tscolari/s3kup. It has a few extra features, like listing and downloading.

Ruby gem/command line tool for Incremental backuping to AWS S3.

My motivation for this was to be used in a backup container for docker. But it's a command line that can be used in any platform.

It will store a manifest.yml file in the root of the bucket, containing all file names and digests. On backup this file will be matched with a on time generated one, only updated/new files will be pushed to the bucket, and files that no longer exists will be deleted.

There's no versioning, but you could use s3 built in versioning.

  gem install s3ckup

Usage: s3ckup OPTIONS --folders folder1,folder2,...
    -k, --aws-key-id KEY_ID          AWS key id
    -a, --aws-access-key ACCESS_KEY  AWS access key
    -b, --s3-bucket BUCKET_NAME      S3 bucket name
    -r, --recursive                  Recursive mode
    -v, --verbose                    Verbose
    -f FOLDER1,FOLDER2,FOLDER3...,   Folder list, separated by ','
        --folders

Example:

s3ckup -k $AWS_KEY -a $AWS_SECRET -b my_backup_bucket -r -f /myapp/uploads,/mydb/data