ActiveTree

This gem implements a denormalized database model for tree data backed up by the Postgres LTREE extension.

This gem is at home within a Rails 6+ console-only, API or full fledged application on top of a Postgres database.

Add this line to your application's Gemfile:

gem 'active_tree'

And then execute:

$ bundle install

Or install it yourself as:

$ gem install active_tree

Upon installing the gem you must run the install process in your Rails application's root:

$ rails g active_tree:install

This will generate a config/active_tree.yml which you may customize to your needs, an initializer and a migration file which you can also customize to add any database columns your models will require.

Include the ActiveTreeAble concern into one of your models which will own lifecycle trees (owner model):

    class User < ApplicationRecord
        include ActiveTree::ActiveTreeAble
        # ...
    end

This will extend your model and enable the following functionality:

# query with ActiveRecord syntax
User.last.active_trees
User.find_by(name: "Acme").active_trees.select("product_name, sum(product_price) as total_price").group(:product_name)
User.last.active_trees.where(...)
User.last.active_trees.where(...).group(...)
User.last.active_trees.where(...).limit(...).offset(...)
    
# AR query with ltree syntax
User.last.active_trees.disabled.match_path("*.ProductName.*")
User.last.active_trees.match_path("*{5,10}.CategoryName.*.ProductName.*")
User.last.active_trees.active.match_path("*.CategoryName.*.SubcategoryName.*.ProductName.*").where( product_price: [100..150]).sum(:product_price)

ActiveTree::Model.match_path("Top.Category.*").products.match_path("*.Scooter*").where( product_price: [ 1000..10000 ]).average(:product_price)
ActiveTree::Model.where(name: "RC Airplane").products.match_path("*.Battery.*").sum(:product_price)
ActiveTree::Model.where(owner: User.last).match_path("*{10,20}.*Category.*")
ActiveTree::Model.match_path("*.Product.*")
        
# pg_ltree queries
User.last.active_trees.last.parent
ActiveTree::Model.match_path("*.Category.*").children
    
# pg_ltree combined with AR syntax
User.last.active_trees(type: "Sellable::Product").children.match_path("*.Battery").children
    
# all queries can be directed to a specific partition:
ActiveTree::Model.owned_by( owner_id ).match_path("*.Category.*").where(currency: "USD").products.sum(:product_price)
    

To see what syntax to use for path traversal please check out the following resources:

• pg_ltree gem https://github.com/sjke/pg_ltree
• Postgres ltree extension documentation https://www.postgresql.org/docs/9.1/ltree.html

The ActiveTree gem is designed to be compatible with PostgREST. PostgREST is an amazing tool that generates a CRUD REST API for your Postgres database, read more about it here: https://postgrest.org

If the create_postgrest_roles setting is on each new owner will be assigned a Postgres role allowing them to access data within their partition using PostgREST. Your owner model will be extended with a .generate_jwt method you can use to generate the PostgREST authentication token.

The ActiveTree::Model comes with a JSONB column where you can store random information structured in any required way. Subclasses of the Model can implement methods to store/retrieve JSONB data as well as validations.

The ActiveTree::Metadata model can store key-value pairs queryable through ActiveRecord simple queries or joins:

ActiveTree::Model.match_path("*.Battery.*").metadata.where(key: "Shipping weight").sum(:value)

All data is partitioned for each owner using the owner_id as partition index. Through the yml configuration you can choose how the gem behaves when deleting an owner record - either delete the partition and all the data, or detach the partition and keep the data for later use.

Through subsequent ActiveRecord migrations the data can be federated from a separate Postgres server.

The main table as well as its partitions can be queried through PostgREST using the role attached to the owner model.

pg_ltree .child / .parent queries do not work across different models due to an ActiveRecord limitation that requires results to be related via inheritance.

• postgres RECURSIVE queries
• builders
• seeds/fixtures

Bug reports, pull requests and feature suggestions are welcome on GitHub at https://github.com/nicksterious/active_tree

The gem is available as open source under the terms of the MIT License.

This gem is tested in production. We use this gem at Start a sportsbook and sportsbook software to store complex hierarchical sports market data. Updates are handled in realtime using postgres_notifier's NOTIFY/LISTEN pattern and published to thousands of clients on hundreds of sports and gaming websites.