2019-12-10 08:52:11 -05:00
**If you're viewing this at https://github.com/DatabaseCleaner/database_cleaner,
you're reading the documentation for the `master` branch.
[View documentation for the latest release
(1.7.0).](https://github.com/DatabaseCleaner/database_cleaner/blob/v1.7.0/README.markdown)**
2012-10-23 22:08:38 -04:00
# Database Cleaner
2016-02-24 08:46:10 -05:00
[![Build Status ](https://travis-ci.org/DatabaseCleaner/database_cleaner.svg?branch=master )](https://travis-ci.org/DatabaseCleaner/database_cleaner)
[![Code Climate ](https://codeclimate.com/github/DatabaseCleaner/database_cleaner/badges/gpa.svg )](https://codeclimate.com/github/DatabaseCleaner/database_cleaner)
2019-05-20 13:07:28 -04:00
Database Cleaner is a set of gems containing strategies for cleaning your database in Ruby.
2012-10-23 22:08:38 -04:00
The original use case was to ensure a clean state during tests.
Each strategy is a small amount of code but is code that is usually needed in any ruby app that is testing with a database.
2016-01-22 14:50:46 -05:00
## Gem Setup
2012-10-23 22:08:38 -04:00
2019-05-20 13:07:28 -04:00
Instead of using the `database_cleaner` gem directly, each ORM has its own gem. Most projects will only need the `database_cleaner-active_record` gem:
2016-01-22 14:50:46 -05:00
```ruby
# Gemfile
group :test do
2019-05-20 13:07:28 -04:00
gem 'database_cleaner-active_record'
2016-01-22 14:50:46 -05:00
end
```
2012-10-23 22:08:38 -04:00
2019-05-20 13:07:28 -04:00
If you are using multiple ORMs, just load multiple gems:
2016-01-22 14:50:46 -05:00
2012-10-23 22:08:38 -04:00
2019-05-20 13:07:28 -04:00
```ruby
# Gemfile
group :test do
gem 'database_cleaner-active_record'
gem 'database_cleaner-redis'
end
```
2012-10-23 22:08:38 -04:00
2019-05-20 18:21:44 -04:00
## List of adapters
2012-10-23 22:08:38 -04:00
2019-05-20 18:21:44 -04:00
Here is an overview of the databases and ORMs supported by each adapter:
2012-10-23 22:08:38 -04:00
2019-05-20 18:21:44 -04:00
MySQL, PostgreSQL, SQLite, etc
2019-09-23 08:52:54 -04:00
* [database_cleaner-active_record ](adapters/database_cleaner-active_record )
* [database_cleaner-sequel ](adapters/database_cleaner-sequel )
* [database_cleaner-data_mapper ](adapters/database_cleaner-data_mapper )
2012-10-23 22:08:38 -04:00
2019-05-20 18:21:44 -04:00
CouchDB
2019-09-23 08:52:54 -04:00
* [database_cleaner-couch_potato ](adapters/database_cleaner-couch_potato )
2012-10-23 22:08:38 -04:00
2019-05-20 18:21:44 -04:00
MongoDB
2019-09-23 08:52:54 -04:00
* [database_cleaner-mongoid ](adapters/database_cleaner-mongoid )
* [database_cleaner-mongo_mapper ](adapters/database_cleaner-mongo_mapper )
* [database_cleaner-moped ](adapters/database_cleaner-moped )
* [database_cleaner-mongo ](adapters/database_cleaner-mongo )
2012-10-23 22:08:38 -04:00
2019-05-20 18:21:44 -04:00
Redis
2019-09-23 08:52:54 -04:00
* [database_cleaner-redis ](adapters/database_cleaner-redis )
* [database_cleaner-ohm ](adapters/database_cleaner-ohm )
2012-10-23 22:08:38 -04:00
2019-05-20 18:21:44 -04:00
Neo4j
2019-09-23 08:52:54 -04:00
* [database_cleaner-neo4j ](adapters/database_cleaner-neo4j )
2012-10-23 22:08:38 -04:00
2019-05-20 18:21:44 -04:00
More details on available configuration options can be found in the README for the specific adapter gem that you're using.
2012-10-23 22:08:38 -04:00
2019-12-10 12:58:58 -05:00
For support or to discuss development please use the [Google Group ](https://groups.google.com/group/database_cleaner ).
2012-10-23 22:08:38 -04:00
## How to use
```ruby
2019-05-20 13:07:28 -04:00
require 'database_cleaner/active_record'
2012-10-23 22:08:38 -04:00
DatabaseCleaner.strategy = :truncation
# then, whenever you need to clean the DB
DatabaseCleaner.clean
```
With the `:truncation` strategy you can also pass in options, for example:
```ruby
DatabaseCleaner.strategy = :truncation, {:only => %w[widgets dogs some_other_table]}
```
```ruby
DatabaseCleaner.strategy = :truncation, {:except => %w[widgets]}
```
(I should point out the truncation strategy will never truncate your schema_migrations table.)
2017-01-31 08:33:22 -05:00
Some strategies need to be started before tests are run (for example the `:transaction` strategy needs to know to open up a transaction). This can be accomplished by calling `DatabaseCleaner.start` at the beginning of the run, or by running the tests inside a block to `DatabaseCleaner.cleaning` . So you would have:
2012-10-23 22:08:38 -04:00
```ruby
2019-05-20 13:07:28 -04:00
require 'database_cleaner/active_record'
2012-10-23 22:08:38 -04:00
DatabaseCleaner.strategy = :transaction
DatabaseCleaner.start # usually this is called in setup of a test
dirty_the_db
DatabaseCleaner.clean # cleanup of the test
2014-01-24 23:20:00 -05:00
# OR
DatabaseCleaner.cleaning do
dirty_the_db
end
2012-10-23 22:08:38 -04:00
```
At times you may want to do a single clean with one strategy.
For example, you may want to start the process by truncating all the tables, but then use the faster transaction strategy the remaining time. To accomplish this you can say:
```ruby
2019-05-20 13:07:28 -04:00
require 'database_cleaner/active_record'
2012-10-23 22:08:38 -04:00
DatabaseCleaner.clean_with :truncation
DatabaseCleaner.strategy = :transaction
# then make the DatabaseCleaner.start and DatabaseCleaner.clean calls appropriately
```
2019-05-20 18:21:44 -04:00
## What strategy is fastest?
For the SQL libraries the fastest option will be to use `:transaction` as transactions are simply rolled back. If you can use this strategy you should. However, if you wind up needing to use multiple database connections in your tests (i.e. your tests run in a different process than your application) then using this strategy becomes a bit more difficult. You can get around the problem a number of ways.
One common approach is to force all processes to use the same database connection ([common ActiveRecord hack](http://blog.plataformatec.com.br/2011/12/three-tips-to-improve-the-performance-of-your-test-suite/)) however this approach has been reported to result in non-deterministic failures.
Another approach is to have the transactions rolled back in the application's process and relax the isolation level of the database (so the tests can read the uncommitted transactions).
An easier, but slower, solution is to use the `:truncation` or `:deletion` strategy.
2019-12-10 12:58:58 -05:00
So what is fastest out of `:deletion` and `:truncation` ? Well, it depends on your table structure and what percentage of tables you populate in an average test. The reasoning is out of the scope of this README but here is a [good SO answer on this topic for Postgres ](https://stackoverflow.com/questions/11419536/postgresql-truncation-speed/11423886#11423886 ).
2019-05-20 18:21:44 -04:00
Some people report much faster speeds with `:deletion` while others say `:truncation` is faster for them. The best approach therefore is it try all options on your test suite and see what is faster.
If you are using ActiveRecord then take a look at the [additional options ](#additional-activerecord-options-for-truncation ) available for `:truncation` .
Database Cleaner also includes a `null` strategy (that does no cleaning at all) which can be used with any ORM library.
You can also explicitly use it by setting your strategy to `nil` .
## Test Framework Examples
2012-10-23 22:08:38 -04:00
### RSpec Example
```ruby
RSpec.configure do |config|
config.before(:suite) do
DatabaseCleaner.strategy = :transaction
DatabaseCleaner.clean_with(:truncation)
end
2014-01-24 23:20:00 -05:00
config.around(:each) do |example|
DatabaseCleaner.cleaning do
example.run
end
2012-10-23 22:08:38 -04:00
end
end
```
2015-06-21 19:45:51 -04:00
### RSpec with Capybara Example
2015-07-14 12:30:56 -04:00
You'll typically discover a feature spec is incorrectly using transaction
instead of truncation strategy when the data created in the spec is not
visible in the app-under-test.
A frequently occurring example of this is when, after creating a user in a
spec, the spec mysteriously fails to login with the user. This happens because
the user is created inside of an uncommitted transaction on one database
connection, while the login attempt is made using a separate database
connection. This separate database connection cannot access the
uncommitted user data created over the first database connection due to
transaction isolation.
For feature specs using a Capybara driver for an external
JavaScript-capable browser (in practice this is all drivers except
`:rack_test` ), the Rack app under test and the specs do not share a
database connection.
When a spec and app-under-test do not share a database connection,
you'll likely need to use the truncation strategy instead of the
transaction strategy.
See the suggested config below to temporarily enable truncation strategy
for affected feature specs only. This config continues to use transaction
strategy for all other specs.
2015-06-21 19:45:51 -04:00
2016-01-15 10:37:32 -05:00
It's also recommended to use `append_after` to ensure `DatabaseCleaner.clean`
runs *after* the after-test cleanup `capybara/rspec` installs.
2015-06-21 19:45:51 -04:00
```ruby
2016-01-15 10:37:32 -05:00
require 'capybara/rspec'
#...
2015-06-21 19:45:51 -04:00
RSpec.configure do |config|
config.use_transactional_fixtures = false
config.before(:suite) do
2015-07-14 12:30:56 -04:00
if config.use_transactional_fixtures?
raise(< < -MSG )
Delete line `config.use_transactional_fixtures = true` from rails_helper.rb
(or set it to false) to prevent uncommitted transactions being used in
JavaScript-dependent specs.
During testing, the app-under-test that the browser driver connects to
uses a different database connection to the database connection used by
the spec. The app's database connection would not be able to access
uncommitted transaction data setup over the spec's database connection.
MSG
end
2015-06-21 19:45:51 -04:00
DatabaseCleaner.clean_with(:truncation)
2016-10-01 13:19:36 -04:00
end
2015-07-14 12:30:56 -04:00
config.before(:each) do
DatabaseCleaner.strategy = :transaction
end
config.before(:each, type: :feature) do
# :rack_test driver's Rack app under test shares database connection
# with the specs, so continue to use transaction strategy for speed.
driver_shares_db_connection_with_specs = Capybara.current_driver == :rack_test
2017-11-16 07:35:09 -05:00
unless driver_shares_db_connection_with_specs
2015-07-14 12:30:56 -04:00
# Driver is probably for an external browser with an app
# under test that does *not* share a database connection with the
# specs, so use truncation strategy.
DatabaseCleaner.strategy = :truncation
end
2015-06-21 19:45:51 -04:00
end
2015-07-14 12:30:56 -04:00
config.before(:each) do
2015-06-21 19:45:51 -04:00
DatabaseCleaner.start
end
2016-01-15 10:37:32 -05:00
config.append_after(:each) do
2015-06-21 19:45:51 -04:00
DatabaseCleaner.clean
end
end
```
2012-10-23 22:08:38 -04:00
### Minitest Example
```ruby
DatabaseCleaner.strategy = :transaction
2015-05-09 09:45:40 -04:00
class Minitest::Spec
2012-10-23 22:08:38 -04:00
before :each do
DatabaseCleaner.start
end
after :each do
DatabaseCleaner.clean
end
end
2014-01-24 23:20:00 -05:00
# with the minitest-around gem, this may be used instead:
class Minitest::Spec
around do |tests|
DatabaseCleaner.cleaning(& tests)
end
end
2012-10-23 22:08:38 -04:00
```
### Cucumber Example
If you're using Cucumber with Rails, just use the generator that ships with cucumber-rails, and that will create all the code you need to integrate DatabaseCleaner into your Rails project.
Otherwise, to add DatabaseCleaner to your project by hand, create a file `features/support/database_cleaner.rb` that looks like this:
```ruby
2019-05-20 13:07:28 -04:00
require 'database_cleaner/active_record'
2012-10-23 22:08:38 -04:00
2019-05-20 13:07:28 -04:00
DatabaseCleaner.strategy = :truncation
2012-10-23 22:08:38 -04:00
2014-01-24 23:20:00 -05:00
Around do |scenario, block|
DatabaseCleaner.cleaning(& block)
2012-10-23 22:08:38 -04:00
end
```
This should cover the basics of tear down between scenarios and keeping your database clean.
For more examples see the section ["Why?" ](#why ).
2017-08-03 13:18:12 -04:00
## How to use with multiple ORMs
2012-10-23 22:08:38 -04:00
Sometimes you need to use multiple ORMs in your application.
You can use DatabaseCleaner to clean multiple ORMs, and multiple connections for those ORMs.
```ruby
2019-05-20 13:07:28 -04:00
require 'database_cleaner/active_record'
require 'database_cleaner/mongo_mapper'
# How to specify particular orms
2012-10-23 22:08:38 -04:00
DatabaseCleaner[:active_record].strategy = :transaction
DatabaseCleaner[:mongo_mapper].strategy = :truncation
2019-05-20 13:07:28 -04:00
# How to specify particular connections
2015-06-29 10:36:06 -04:00
DatabaseCleaner[:active_record, { :connection => :two }]
2012-10-23 22:08:38 -04:00
# You may also pass in the model directly:
2015-06-29 10:36:06 -04:00
DatabaseCleaner[:active_record, { :model => ModelWithDifferentConnection }]
2012-10-23 22:08:38 -04:00
```
Usage beyond that remains the same with `DatabaseCleaner.start` calling any setup on the different configured connections, and `DatabaseCleaner.clean` executing afterwards.
## Why?
One of my motivations for writing this library was to have an easy way to turn on what Rails calls "transactional_fixtures" in my non-rails ActiveRecord projects.
2013-02-06 12:45:38 -05:00
After copying and pasting code to do this several times I decided to package it up as a gem and save everyone a bit of time.
2012-10-23 22:08:38 -04:00
## Common Errors
#### DatabaseCleaner is trying to use the wrong ORM
2019-05-20 13:50:40 -04:00
DatabaseCleaner has a deprecated autodetect mechanism where if you do not explicitly define your ORM it will use the first ORM it can detect that is loaded.
2012-10-23 22:08:38 -04:00
Since ActiveRecord is the most common ORM used that is the first one checked for.
2019-05-20 13:50:40 -04:00
Sometimes other libraries (e.g. ActiveAdmin) will load other ORMs (e.g. ActiveRecord) even though you are using a different ORM. This will result in DatabaseCleaner trying to use the wrong ORM (e.g. ActiveRecord) unless you explicitly require the correct adapter gem:
2012-10-23 22:08:38 -04:00
```ruby
2019-05-20 13:50:40 -04:00
# Gemfile
gem "database_cleaner-mongoid"
2012-10-23 22:08:38 -04:00
```
### STDERR is being flooded when using Postgres
2014-10-14 08:33:47 -04:00
If you are using Postgres and have foreign key constraints, the truncation strategy will cause a lot of extra noise to appear on STDERR (in the form of "NOTICE truncate cascades" messages).
To silence these warnings set the following log level in your `postgresql.conf` file:
2012-10-23 22:08:38 -04:00
```ruby
client_min_messages = warning
```
2014-10-14 08:33:47 -04:00
For ActiveRecord, you add the following parameter in your database.yml file:
< pre >
test:
adapter: postgresql
# ...
2016-10-01 13:19:36 -04:00
min_messages: WARNING
2014-10-14 08:33:47 -04:00
< / pre >
2018-03-24 12:05:29 -04:00
## Safeguards
DatabaseCleaner comes with safeguards against:
* Running in production (checking for `ENV` , `RACK_ENV` , and `RAILS_ENV` )
2018-05-02 05:31:35 -04:00
* Running against a remote database (checking for a `DATABASE_URL` that does not include `localhost` , `.local` or `127.0.0.1` )
2018-03-24 12:05:29 -04:00
Both safeguards can be disabled separately as follows.
Using environment variables:
```
export DATABASE_CLEANER_ALLOW_PRODUCTION=true
export DATABASE_CLEANER_ALLOW_REMOTE_DATABASE_URL=true
```
In Ruby:
```ruby
DatabaseCleaner.allow_production = true
DatabaseCleaner.allow_remote_database_url = true
```
2018-04-20 11:34:21 -04:00
In Ruby, a URL whitelist can be specified. When specified, DatabaseCleaner will only allow `DATABASE_URL` to be equal
to one of the values specified in the url whitelist like so:
```ruby
DatabaseCleaner.url_whitelist = ['postgres://postgres@localhost', 'postgres://foo@bar']
```
2012-10-23 22:08:38 -04:00
## COPYRIGHT
2019-05-20 13:07:28 -04:00
See [LICENSE] for details.