Collamine

This is a ruby gem for CollaMine client, which communicates with CollaMine servers to download content from their SmartCache if it exists. It also lets you crawl a web site using SpiderCrawl and share the results with the community via CollaMine servers.

Add this line to your application's Gemfile:

gem 'collamine'

And then execute:

$ bundle

Or install it yourself as:

$ gem install collamine

To get started,

require 'collamine'
Collamine.start('http://forums.hardwarezone.com.sg/hwm-magazine-publication-38/', 
                :pattern => Regexp.new('^http:\/\/forums\.hardwarezone\.com\.sg\/hwm-magazine-publication-38\/?(.*\.html)?$'))

To do something before and after each fetch, you have to place the following before you call Collamine.start

Collamine.before_fetch do |url|
    puts "Do what you want to the url: #{url}"
end

Collamine.after_fetch do |page, from_collamine|
    # Do what you want to the page and the pages fetched from collamine
end

1. Fork it ( https://github.com/belsonheng/collamine/fork )
2. Create your feature branch (git checkout -b my-new-feature)
3. Commit your changes (git commit -am 'Add some feature')
4. Push to the branch (git push origin my-new-feature)
5. Create a new Pull Request