HttpCrawler

Welcome to your new gem! In this directory, you'll find the files you need to be able to package up your Ruby library into a gem. Put your Ruby code in the file lib/http_crawler. To experiment with that code, run bin/console for an interactive prompt.

TODO: Delete this and the text above, and describe your gem

Add this line to your application's Gemfile:

gem 'http_crawler'

And then execute:

$ bundle

Or install it yourself as:

$ gem install http_crawler

client = HttpCrawler::Client::Baidu::Client.new
client.index  # 抓取首页

client = HttpCrawler::Client.for("baidu") # 
client.index   # 抓取首页

client = HttpCrawler::Proxy::TestProxyApi::Client.new

client = HttpCrawler::Proxy.for("test_proxy_api") #