html builder used in we-bridge

Simple DSL Webpage Scraper using Nibbler + Nokogiri + Faraday (35 or less LOC)

Web Scraper is a library to build APIs by scraping static sites and use data as models.

It's an utility to scrape web pages

webscraper_framework is a DRY framework for creating scrapers

This gem is web scraping from assignment 2 in Soft spec design lab.This gem is created by 6210546013 Vichisorn Wejsupakul

Get a free stock quote for a company symbol using webservicex.net

Get a free stock quote for a company symbol using webservicex.net

Web scraper that shakes a link to extract info out of it using AI.

Webshell API of APIs

This library allows you to create webshots using webkit on MacOSX. A webshot is a screenshot taken inside the browser. The advantage of this library is that it is headless and gives you the real view not a parsed view

Website Cloner is a Ruby gem that allows you to create local copies of websites, including all assets and linked pages. It's designed to be easy to use while providing powerful features for customization.

scrape website information that title, meta, page capture, description, ogp and so on.

auto tag social people

Fetch the web pages and stat.

Extract images, favicons, and meta info from websites

The Webtractor library can extract main content from websites like news, blogs, etc without unwanted boilerplate (menus, footer, comments)

This library # This class contains all the necessary methods to do the following: -Crawl most websites and return an array of their URLS. -Convert all HTML and most web linked PDF documents to one large string given an array of urls. -Parse out all non words and non human sensible markup. -Stooge Sort an array of words via Iteration, NOT recursion. NOTE: Current verison IS using recursive stooge sort! -Write array of words to a new file.

A simple content extractor

Weby has been designed to easily write web interfaces. It can be used to generate HTML code in a template based fashion or you're free to create HTML in a programmatic way, or even a mix of them.