Project

xp

0.0
No commit activity in last 3 years
No release in over 3 years
xpjikkujose/xpHomepageDocumentationSource CodeBug TrackerWiki
Ruby gem that adds some methods to String class for intuitive HTML/XML scraping
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
14,997
Stars
1
Forks
0
Watchers
2
 Releases
Current version
2.0.2
Total releases
6
First release
2014-09-06
Latest release
2014-12-18
 Development
Primary Language
Ruby
Licenses
MIT
Average date of last 50 commits
2014-11-10
Reverse Dependencies
0

 Dependencies

Runtime

nokogiri
~> 1.6
 Project Readme

xp

Ruby gem that adds some methods to String class for intuitive HTML/XML scraping.

Installation

$ gem install xp

Usage

In command line usage, xp filters HTML/XML documents provided via STDIN:

$ curl -s 'https://news.ycombinator.com' | xp --text '//td[class="title"]/a'

OR

$ curl -s 'https://news.ycombinator.com' | xp --text 'td.title > a'

Require (require 'xp') the gem to use in Ruby scripts. Following one liner can download all Dribbble shots in its home page:

'https://dribbble.com/'.css('.dribbble-link img').xpath('//img/@src').map(&:text).map(&:download)

API

xp adds the following methods to the String class:

Method Return type Remarks
to_nokogiri Nokogiri::XML::Document Converts a url or a page source to Nokogiri object
css(selector) String Filters a url or html string based on the selector
xpath(selector) Strng Filters a url or html string based on the selector
download(location: 'downloads', name: nil) String Downloads the url in the string (can be customized via the optional parameters)
page_source(user_agent_alias: :mac_firefox, user_agent: nil) String Gets the page source of a url (can be customized via optional parameters)
url? Boolean Checks whether current string is a url