ActiveModelCachers
ActiveModelCachers provides cachers to models and allows the users to specify what needs to be cached. The data will be cached at Rails.cache
and also at application level via RequestStore
, to cache values between requests. The cachers will maintain cached objects and expire them when they are changed (e.g. created, updated, destroyed, or deleted).
ActiveModelCachers:
- Uses multiple levels of cache (Multi-level Cache)
- Does not pollute the original ActiveModel API
- Has high test coverage
Supports
- Ruby 2.3 ~ 2.7
- Rails 3.2, 4.2, 5.0, 5.1, 5.2, 6.0
Table of contents
- Compare with identity_cache
- Installation
- Usage
- Examples
- Smart Caching
- Convenient syntax sugar for caching ActiveRecord
- Options
- Future Works
- Development
- Contributing
- License
Compare with identity_cache
active_model_cachers
allows you to specify what to cache and when to expire those caches, so that you can cache raw sql query results, time-consuming methods, responses of requests, and so on. It also supports AR associations/attributes (has_many, has_one, belongs_to) and secondary indexes.
identity_cache
focuses on AR, and doesn't have the flexibility to specify the query.identity_cache
has more features for caching AR associations/attributes. Some of these feature are: Caching attributes by multiple keys, embedding associations to load data in one fetch, non-unique secondary indexes, and caching polymorphic associations.
Another important difference is that active_model_cachers
encapsulates methods to cacher
, while identity_cache
adds a number of fetch_*
method to AR
directly, therefore it's more possible to have method name collision when using identity_cache
.
Installation
To install active_model_cachers, add this line to your application's Gemfile:
gem 'active_model_cachers'
Then execute:
$ bundle
Or install it yourself by executing:
$ gem install active_model_cachers
Add an initializer with this code to your project:
ActiveModelCachers.config do |config|
config.store = Rails.cache # specify where the cache will be stored
end
Usage
The cache_at
method
Use the cache_at
method to cache whatever you want. Specify a cache on the model:
cache_at(name, query = nil, options = {})
Parameters:
- name: the attribute name
- query: how to get data on cache miss. It will be set automatically if the name matches an association or an attribute.
- options: see here
Access the cached attributes
To avoid method name collision, all methods will be defined on the Cacher
instead of ActiveModel
. You can get the cacher
from the class or from the instance (e.g. User.cacher
or user.cacher
), then access cached attributes via the method defined by cache_at
(e.g. user.cacher.the_attribute_name
).
Basic Example
class User < ActiveRecord::Base
cache_at :something_you_want_to_cache, ->{ get_the_data_on_cache_miss }
end
user.cacher.something_you_want_to_cache
Examples
Example 1: Cache the number of active users
Specify the method name as active_count
. After using lambda User.active.count
to define how the data can be accessed when there is a cache miss, you can get the cached data by calling active_count
method on the cacher User.cacher
.
class User < ActiveRecord::Base
scope :active, ->{ where('last_login_at > ?', 7.days.ago) }
cache_at :active_count, ->{ active.count }, expire_by: 'User#last_login_at'
end
@count = User.cacher.active_count
You may want to flush cache on the number of active users changed. It can be done by setting expire_by
. In this case, User#last_login_at
means flushing the cache when a user's last_login_at
is changed (by save, update, create, destroy or delete).
Example 2: Cache the number of users
In this example, the cache should be cleaned on user destroyed
, or new user created
, but not on user updated
. You can specify the cleaning callback to only fire on certain events by on
.
class User < ActiveRecord::Base
cache_at :count, ->{ count }, expire_by: 'User', on: [:create, :destroy]
end
@count = User.cacher.count
Example 3: Access the cacher from a model instance
You could use the cacher from the instance scope, e.g. user.cacher
, instead of User.cacher
. The difference is that the binding
of query lambda is changed. In this example, you can write the query as posts.exists?
which is in instance scope. The binding of the lambda is user
, not User
, so that it accesses posts
method of user
.
# Access cacher from instance
class User < ActiveRecord::Base
has_many :posts
cache_at :has_post?, ->{ posts.exists? }, expire_by: :posts
end
user = User.take
do_something if user.cacher.has_post?
# Access cacher from class (It's useful when you don't want to do an extra query)
class User < ActiveRecord::Base
has_many :posts
cache_at :has_post?, ->(id){ Post.where(user_id: id).exists? }, expire_by: :posts
end
user_id = 1
do_something if User.cacher_at(user_id).has_post?
In this example, the cache should be cleaned when the posts
of the user is changed. If you set expire_by
to the association: :posts
, it will do all the work for you (It actually sets expire_by
to Post#user_id
and foreign_key
, which is needed for backtracing the user id from post, to :user_id
).
Example 4: Pass an argument to the query lambda
You can also cache the result of outer service.email_valid?
doesn't match an association or an attribute, so by default, the cache will not be cleaned by any changes.
class User < ActiveRecord::Base
cache_at :email_valid?, ->(email){ ValidEmail2::Address.new(email).valid_mx? }
end
render_error if not User.cacher_at('pearl@example.com').email_valid?
The query lambda can have one parameter. You can pass variable to it by using cacher_at
. For example, User.cacher_at(email)
.
class User < ActiveRecord::Base
cache_at :email_valid?, ->(email){ ValidEmail2::Address.new(email).valid_mx? }, primary_key: :email
end
render_error if not current_user.cacher.email_valid?
The query lambda can also be accessed from instance cacher, but you have to set primary_key
. The primary key specifies which attribute should be passed to the parameter.
Example 5: Store all data in hash
Sometimes you may need to query multiple objects. Although the query results will be cached, the application still needs to query the cache server multiple times. If one communication takes 0.1 ms, 1000 communications will take 100ms! For example:
class Skill < ActiveRecord::Base
cache_at :atk_power
end
# This will retrieve the data from cache servers multiple times.
@attack = skill_ids.inject(0){|sum, id| sum + Skill.cacher_at(id).atk_power }
One solution is to store a lookup table into the cache, so that only one cache object is stored. This will allow you to retrieve all of the needed data in one query.
class Skill < ActiveRecord::Base
cache_at :atk_powers, ->{ pluck(:id, :atk_power).to_h }, expire_by: 'Skill#atk_power'
end
# This will retrieve the data from cache servers only 1 times.
@attack = skill_ids.inject(0){|sum, id| sum + Skill.cacher.atk_powers[id] }
Example 6: Clean the cache manually
Sometimes it is necessary to maintain the cache manually (For example, after calling update_all
, delete_all
or import
records without calling callbacks).
class User < ActiveRecord::Base
has_one :profile
cache_at :profile
end
# clean the cache by name
current_user.cacher.clean(:profile)
# or calling the clean_* method
current_user.cacher.clean_profile
# clean the cache without loading model
User.cacher_at(user_id).clean_profile
Example 7: Peek the data stored in cache
If you only want to check the cached objects, but don't want it to load them from the database automatically when there is no cache, you can use peek
method on cacher
.
class User < ActiveRecord::Base
has_one :profile
cache_at :profile
end
# peek the cache by name
current_user.cacher.peek(:profile)
# or calling the peek_* method
current_user.cacher.peek_profile
# peek the cache without loading model
User.cacher_at(user_id).peek_profile
Smart Caching
Multi-level Cache
There is multi-level cache in order to increase the speed of data access.
- RequestStore
- Rails.cache
- Association Cache
- Database
RequestStore
is used to make sure the same object will not be loaded from cache twice, since the data transfer between Cache
and Application
consumes time.
Association Cache
prevents preloaded objects being loaded again.
For example:
user = User.includes(:posts).take
user.cacher.posts # => no query will be made even on cache miss.
Convenient syntax sugar for caching ActiveRecord
Caching Associations
class User < ActiveRecord::Base
has_one :profile
cache_at :profile
end
@profile = current_user.cacher.profile
# directly get profile without loading user.
@profile = User.cacher_at(user_id).profile
Caching Self
Cache self by id:
class User < ActiveRecord::Base
cache_self
end
@user = User.cacher.find_by(id: user_id)
# peek cache
User.cacher.peek_by(id: user_id)
# clean cache
User.cacher.clean_by(id: user_id)
Also support caching self by other columns:
class User < ActiveRecord::Base
cache_self by: :account
end
@user = User.cacher.find_by(account: 'khiav')
# peek cache
User.cacher.peek_by(account: 'khiav')
# clean cache
User.cacher.clean_by(account: 'khiav')
Caching Attributes
class Profile < ActiveRecord::Base
cache_at :point
end
@point = Profile.cacher_at(profile_id).point
Options
:expire_by
Monitor on the specific model. Clean the cached objects if targets are changed.
-
If empty, e.g.
nil
or''
: Monitoring nothing. -
If string, e.g.
User
: Monitoring all attributes ofUser
. -
If string with keyword
#
, e.g.User#last_login_in_at
: Monitoring only an specific attribute. -
If symbol, e.g.
:posts
: Monitoring on the association. It will monitor all attributes ofPost
and set the `foreign_key'. -
The default value depends on the
name
. Ifname
: -
Is an association, monitoring the association klass
-
Is an attribute, monitoring current klass and the attribute name
-
In other cases, monitoring nothing
:on
Fire changes only by a certain action with the on
option. Like the same option of after_commit.
-
if
:create
: Clean the cache only on new record is created, e.g.Model.create
. -
if
:update
: Clean the cache only on the record is updated, e.g.model.update
. -
if
:destroy
: Clean the cache only on the record id destroyed, e.g.model.destroy
,model.delete
. -
if
array
, e.g.[:create, :update]
: Clean the cache by any of specified actions. -
Default value is
[:create, :update, :destroy]
:foreign_key
-
Is needed only for caching assoication
-
Does not need to be set if
expire_by
is set to monitor association. -
Is used for backtracing the cache key from cached objects. For example, it is used if
user
has_manyposts
, andposts
is cached by user.id. If the post is changed, the column it is going to target must be specified so that the post can clean the cache at user (In this example mentioned, the column wasuser_id
). -
Has the default value
:id
. -
Will be automatically determined if
expire_by
is symbol
:primary_key
-
Determine which column is going to pass to the query lambda, and to be part of the cache key.
For example:-
User.cache_at :arbitrary, ->(id){ id }
The cache key will be
active_model_cachers_User_at_arbitrary_#{user.id}
-
User.cache_at :arbitrary, ->(email){ email }, primary_key: :email
The cache key will be
active_model_cachers_User_at_arbitrary_#{user.email}
-
-
Has the default value
:id
.
Future works
- caching polymorphic associations
- non-unique secondary indexes
- caching attributes by multiple keys
- testing counter cache
- testing has_many through
- testing has_and_belongs_to_many
Development
After checking out the repo, run bin/setup
to install dependencies. Then, run rake test
to run the tests. You can also run bin/console
for an interactive prompt that will allow you to experiment.
To install this gem onto your local machine, run bundle exec rake install
. To release a new version, update the version number in version.rb
before running bundle exec rake release
(This command will create a git tag for the version, push the git commits, tags and the .gem
files to rubygems.org).
Contributing
Bug reports and pull requests are welcome on GitHub at https://github.com/khiav223577/active_model_cachers. This project is intended to be a safe, welcoming space for collaboration, and contributors are expected to adhere to the Contributor Covenant code of conduct.
License
The gem is available as open source under the terms of the MIT License.