0.01
Repository is archived
No release in over 3 years
An implementation of StringScanner that doesn't split multibyte characters.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Development

 Project Readme

Unicode String Scanner

A Unicode-aware implementation of Ruby's StringScanner.

Author Tim Morgan
Version 1.0 (Jul 11, 2012)
License Released under the MIT license.

About

Did you know that StringScanner splits codepoints? Neither did I. This one doesn't.

When would I want to use this? When you want to use StringScanner on a Unicode (UTF-n) string.

When would I not want to use this? If you're interested in speed. This is slower than StringScanner because a) it's not written in native C, and b) it's slower to traverse Unicode strings anyway because characters can have varying byte sizes.

Installation

Simply add this gem to your project's Gemfile:

gem 'unicode_scanner'

Usage

The UnicodeScanner object responds to exactly the same API as StringScanner, with the exception of the following methods:

  • getbyte
  • any obsolete methods

For more information, see the {UnicodeScanner} class documentation.