Compare projects
Project comparisons allow you to view any selection of projects side by side just like they're shown on regular categories or in search results. You can try out an example or start yourself by adding a library to the comparison via the input below. You can also easily share your current comparison with others by sending the URL of the current page.
0.0
An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It
can be used to count the number of tokens in text before sending it to OpenAI APIs. This
is a fork of tiktoken_ruby by IAPark, which has been cross-compiled for multiple platforms.
This way compilation with Rust extensions doesn't need to happen wherever you are deploying it.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
Activity