0.0
No commit activity in last 3 years
No release in over 3 years
Quickly grab many files from a remote location.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Development

~> 1.10
~> 10.0

Runtime

~> 1.6
~> 0.19
~> 1.1
 Project Readme

FileGrabber

Quickly access an index of pages and download a file from each page.

Create an empty specification file with grab init.

Then edit it and run with grab go (it runs the grabber 'default' if you provide no argument).

Try some basic changes like filtering:

# vim: ft=ruby
grabber 'default' do
  set_http_basic_username 'mcantor'
  set_http_basic_password ENV['HTTP_BASIC_PASSWORD']
  index 'https://whatever.example.com/files', '.panel-body ul div.row li a'
  # only download log files
  @docpages.select! { |page| page.filename.end_with? '.log' }
  download 'body > div.container > section.document-downloads > a:nth-child(1)'
end