Chromate is a custom driver for Chrome using the Chrome DevTools Protocol (CDP) to create undetectable bots with human-like behavior. The ultimate goal is to enable the creation of AI agents capable of navigating and performing actions on the web on behalf of the user. This gem is the first step towards achieving that goal.

Add gem to your application's Gemfile:

# Github pkgs
bundle add chromate --source https://rubygems.pkg.github.com/eth3rnit3

# Or add manualy within a block
# source "https://rubygems.pkg.github.com/eth3rnit3" do
#   gem "chromate"
# end

# or

# Rubygems
bundle add chromate-rb

Or install it yourself as:

# Github pkgs
gem install chromate --source https://rubygems.pkg.github.com/eth3rnit3

# or

gem install chromate-rb

require 'chromate'

browser = Chromate::Browser.new # default headless: true
browser.start

url = 'http://example.com'
browser.navigate_to(url)
browser.find_element('#some-element').click
browser.screenshot('screenshot.png')

browser.stop

You can configure Chromate using a block:

Chromate.configure do |config|
  config.user_data_dir = '/path/to/user/data'
  config.headless = true
  config.native_control = true
  config.proxy = { host: 'proxy.example.com', port: 8080 }
end

Chromate leverages the Chrome DevTools Protocol (CDP) to interact with the browser. It provides a custom driver that mimics human-like behavior to avoid detection by anti-bot systems. The gem includes native mouse controllers for macOS and Linux, which do not trigger JavaScript events, making interactions more human-like.

• Headless Mode: Run Chrome without a graphical user interface.
• Native Mouse Control: Use native mouse events for macOS and Linux.
• Screenshot Capture: Capture screenshots of the browser window.
• Form Interaction: Fill out and submit forms.
• Shadow DOM Support: Interact with elements inside Shadow DOM.
• Element Interaction: Click, hover, and type text into elements.
• Navigation: Navigate to URLs and wait for page load.
• Docker xvfb Support: Dockerfile provided with xvfb setup for easy usage.

• Windows Support: Native mouse control is not yet supported on Windows.
• Headless Mode Complexity: Requires xvfb for headless mode, adding complexity due to different proportions.
• Anti-Bot Detection: Current systems can detect keyboard and mouse interactions via CDP.

Chromate provides native mouse control for macOS and Linux, which helps in creating more human-like interactions that are harder to detect by anti-bot systems. However, using native controls in headless mode requires additional setup, such as using xvfb (X Virtual Framebuffer) to simulate a display.

To simplify the setup process, Chromate includes a Dockerfile and an entrypoint script that handle the installation and configuration of necessary dependencies, including xvfb.

The Dockerfile sets up a minimal environment with all the necessary dependencies to run Chromate in headless mode with xvfb. It installs Chrome, xvfb, and other required libraries.

The entrypoint script ensures that xvfb is running before starting the main process. It removes any existing lock files, starts xvfb and a window manager (fluxbox), and waits for xvfb to initialize.

Here is an example of how you can use Chromate inside a Docker container:

# Build the Docker image
docker build -f dockerfiles/Dockerfile -t chromate .

# Run the Docker container
docker run -v $(pwd):/app -it chromate

# Inside the container, run your Ruby script
ruby your_script.rb # or bundle exec rspec

This setup ensures that all necessary dependencies are installed and configured correctly, allowing you to focus on writing your automation scripts without worrying about the underlying environment.

Chromate is an open-source project designed to provide a solid foundation for the creation of autonomous AI agents, fostering innovation and development in the field of artificial intelligence. This project is developed with an educational and collaborative spirit, aiming to promote responsible and ethical usage.

Under no circumstances is Chromate intended to be used for creating automated bots, scraping tools, or any other activities that violate platform policies or applicable laws. The author disclaims any responsibility for improper or illegal use of this project.

Users are encouraged to comply with platform terms of service and to adopt practices that adhere to ethical and legal standards.

Contributions are welcome! If you have suggestions for improvements or new features, please open an issue or submit a pull request on GitHub.

1. Fork the repository.
2. Create a new branch (git checkout -b feature-branch).
3. Make your changes.
4. Commit your changes (git commit -am 'Add new feature').
5. Push to the branch (git push origin feature-branch).
6. Create a new Pull Request.

Released under MIT by @eth3rnit3.