Horsefield
It's for scraping.
Installation
Add this line to your application's Gemfile:
gem 'horsefield'And then execute:
$ bundle
Or install it yourself as:
$ gem install horsefield
Usage
Define a scraper:
class RedditScraper
include Horsefield::Scraper
many :posts, '#siteTable .thing' do
one :title, 'a.title'
many :links, './/a[contains(@href, "reddit.com")]/@href'
end
many :trending, '.trending-subreddits-content > ul > li a'
endand use it with a URL or an HTML string:
RedditScraper.new('http://www.reddit.com').scrapeEnjoy:
{:posts=>
[{:title=>"Chris Pratt, homeless, living in this van, holding the script to his first acting job",
:links=>["http://www.reddit.com/user/Ripsaw99", "http://www.reddit.com/r/pics/", "http://www.reddit.com/r/pics/comments/2v16z9/chris_pratt_homeless_living_in_this_van_holding/"]},
{:title=>"Cannot believe I got him to sit and stay for this.",
:links=>["http://www.reddit.com/user/Hurevolution4lx", "http://www.reddit.com/r/aww/", "http://www.reddit.com/r/aww/comments/2v0tuh/cannot_believe_i_got_him_to_sit_and_stay_for_this/"]}
...Contributing
- Fork it ( https://github.com/[my-github-username]/horsefield/fork )
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Push to the branch (
git push origin my-new-feature) - Create a new Pull Request