No release in over a year
Adds support for MariaDB's System-Versioned tables and Application Time periods into Rails based applications
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Development

~> 7.0.4
~> 13.0.6
~> 3.12.0
~> 6.0.1
~> 0.21.2
 Project Readme

MariaDB Temporal Tables

Adds support for MariaDB's System-Versioned tables and Application Time periods into Rails based applications

Installation

This gem is dependant on the composite_primary_keys gem and needs to be installed. Reference the documentation to find the correct version to use and add this to you Gemfile

gem 'composite_primary_keys', '=x.x.x'

Next also add this your Gemfile

gem 'mariadb_temporal_tables'

Then install gems by running:

bundle install

System Versioned Tables

Generating Migrations

To include system versioned tables, the first step is generate a migration that adds system versioning on a database level. This can be done manually, but rake tasks are also provided to automate this step.

To generate a simple migration for a table run this replacing table_name with your table name:

rails mariadb_temporal_tables:gen_migration_system -- --table=table_name

Additional options can also be added to utilize the full feature-set of the gem:

rails mariadb_temporal_tables:gen_migration_system -- --table=table_name --include_author_reference=true --include_change_list=true

This migration also adds columns to hold a reference for author_id as well a column for a change list of each version. Full list of options can be found here .

Note: In order for author id to be referenced in versions, call system_versioning_set_author somewhere in the controller.

For example:

class ApplicationController < ActionController::Base
  before_action :set_author
  
  def set_author
    system_versioning_set_author(current_user)
  end
  
end

Additional Note: Since this migration is MariaDB specific it cannot be stored in a regular schema.rb file. It is recommended to add this line to config/application.rb:

config.active_record.schema_format = :sql

This generates a structure.sql file instead which can hold migration results of MariaDB. mariadb-dump/mysqldump need to be available on host machine running the rails application for this to succeed

Adding the Concern

The migration on it's own is sufficient to add support for system versioned tables. The provided concerns make usage much easier and provide several convenience methods. To add the SystemVersioning concern to a model, just include as such:

class YourModel < ApplicationRecord
  include MariaDBTemporalTables::SystemVersioning
  ...
end

This concern provides the functionality of author reference and change list generation, as well as provides a series of methods (full list here)

The above implementation assumes all default options, options can be configured using the system_versioning_options method as such:

class YourModel < ApplicationRecord
  include MariaDBTemporalTables::SystemVersioning
  system_versioning_options :exclude_change_list => [:dont_add_me_to_change_list]
  ...
end

A full list options can be found here

Application Time Periods

Adding application time periods follows same procedure as system versioned tables. It is recommended you read through the previous section first.

Generating Migrations

First the migration has to be generated. This can be done by running:

rails mariadb_temporal_tables:gen_migration_application -- --table=table_name

Full list of options to this command found here

Adding the Concern

class YourModel < ApplicationRecord
  include MariaDBTemporalTables::ApplicationVersioning
  ...
end

Full list of methods here. Options can also be configured using the application_versioning_options method. Full list of options here

Bi-temporal Tables (System and Application versioning)

Having Bi-temporal tables is also possible with this gem. First migrations should be generated for each as explained above. Then a concern is provided to easily include both:

class YourModel < ApplicationRecord
  include MariaDBTemporalTables::CombinedVersioning
  ...
end

This concern accepts both application_versioning_options and system_versioning_options. It should be noted that in the case of conflicting options, latest will always be used.

Additional Note: By default MariaDB disables table alterations after system versioning is added. So either make the system versioning migration the last migration of a table, or disable this feature.

Custom Queries

Once the migrations are complete, the full feature set of MariaDB is available to use. The provided concerns provide the most straightforward functionalities that are most commonly used. If the need for a more complex and custom query is needed, this can done through the find_by_sql method provided by Rails.

YourModel.find_by_sql("YOUR_SQL_QUERY", [YOUR_BINDS_IF_ANY])

Some class instance methods are provided by the concerns that can be used in these queries system_versioning_start_column_name, system_versioning_end_column_name, application_versioning_start_column_name, application_versioning_end_column_name

Options & Methods

Migration Generators

mariadb_temporal_tables:gen_migration_system

option type default description
--table string none (required) Table to generate migration for
--include_change_list boolean false Whether change_list column should be added or not
--include_author_reference boolean false Whether reference of author id should be added or not
--author_table string users Table to reference author id from
--start_column_name string transaction_start Name of column that represents start of period (if this is set, concern option also has to be set to match)
--end_column_name string transaction_end Name of column that represents end of period (if this is set, concern option also has to be set to match

mariadb_temporal_tables:gen_migration_application

option type default description
--table string none (required) Table to generate migration for
--add_columns boolean true Whether columns should be added to table or not (set to false when using existing columns)
--replace_primary_key boolean true Whether end column should be added to primary key or not
--column_type DATE/ DATETIME/ TIMESTAMP DATE Type to use for column to be added
--start_column_name string valid_start Name of column that represents start of period (if this is set, concern option also has to be set to match)
--end_column_name string valid_end Name of column that represents end of period (if this is set, concern option also has to be set to match)

Concern Options

system_versioning_options

option type default description
:start_column_name String "transaction_start" Name of column that represents start of period of system versioning (has to match migration)
:end_column_name String "transaction_end" Name of column that represents end of period of system versioning (has to match migration)
:exclude_revert Array<String> [] Array of column names that should be excluded when reverting a record
:exclude_change_list Array<String> [] Array of column names that should be excluded when generating the change list
:primary_key Symbol/Array<Symbol> :id Primary key to be set as the model primary key (can be single or composite key)

application_versioning_options

option type default description
:start_column_name String "valid_start" Name of column that represents start of period of application versioning (has to match migration)
:end_column_name String "valid_end" Name of column that represents end of period of application versioning (has to match migration)
:primary_key Symbol/Array<Symbol> [:id, end_column_name] Primary key to be set as the model primary key (can be single or composite key)

Methods

SystemVersioning

method class or instance method description
versions instance Get all the previous versions of a record
revert instance Revert the current object to a specific version of an object with given id and time
all_as_of class Equivalent to rails all but with a given as of time
order_as_of class Equivalent to rails order but with a given as of time
where_as_of class Equivalent to rails where but with a given as of time
find_as_of class Equivalent to rails find but with a given as of time
versions_count_for_author class Gets the number of versions that an author has created

ApplicationVersioning

method class or instance method description
all_valid_at class Equivalent to rails all but with a given valid time
order_valid_at class Equivalent to rails order but with a given valid time
where_valid_at class Equivalent to rails where but with a given valid time

CombinedVersioning

method class or instance method description
all_valid_at_as_of class Combined functionality of all from system and application versioning
order_valid_at_as_of class Combined functionality of order from system and application versioning