CraigslistScraper
A gem to scrape craiglist data , use at own risk.
####Warning
This gem does not work if hosted on heroku or ec2 , it appears craiglist blocks requests coming from them.
Installation
Add this line to your application's Gemfile:
gem 'craigslist_scraper'
And then execute:
$ bundle
Or install it yourself as:
$ gem install craigslist_scraper
Usage
search example
craigslist = CraigsList.new
craigslist.search_boulder_for "vegan flip flops"
defaults to searching the entire post you can also search in just the titles
craigslist.search_titles_in_denver_for "vegan flip flops"
returns
[{
data_id: "314159265359",
decsription: "vegan flip flops made out of tofu",
url: "http://denver.craigslist.org/42.html,
price: 5
}]
Data calculations
average price
craigslist = CraigsList.new
craigslist.search_miami_for "white aligator shoes".average_price #=> 200
median price
craigslist = CraigsList.new
craigslist.search_losangeles_for "pretentious handbag".median_price #=> 700
You can search most valid craigslist cities
example
craigslist.search_dallas_for "a NoBama bumper sticker"
craigslist.search_lasvegas_for "gold chains and workout jumpsuit"
Contributing
- Fork it
- Create your feature branch (
git checkout -b my-new-feature) - Commit your changes (
git commit -am 'Add some feature') - Make sure all tests pass
- Push to the branch (
git push origin my-new-feature) - Create new Pull Request