mirror of
https://github.com/rails/rails.git
synced 2022-11-09 12:12:34 -05:00
31461d8a79
This change allows for a connection to be swapped on role or shard for a class. Previously calling `connected_to` would swap all the connections to a particular role or shard. Granular connection swapping is useful for swapping one connection to reading while leaving all other connection classes on writing. The public methods on connection handler have been updated to behave the same as they did previously on the different handlers. The difference however is instead of calling `ActiveRecord::Base.connection_handlers[:reading].clear_all_connections!` you now call `ActiveRecord::Base.connection_handler.clear_all_connections!` which will clear based on current role set by a `connected_to` block. Outside the context of a `connected_to` block, `clear_all_connections!` can take an optional parameter to clear specific connections by role. The major changes in this PR are: * We introduced a `legacy_connection_handling` configuration option that is set to true by default. It will be set to `false` for all new applications. * In the new connection handling there will be one only connection handler. Previously there was a connection handler for each role. Now the role is stored in the `PoolManager`. In order to maintain backwards compatibility we introduced a `LegacyPoolManager` to avoid duplicate conditionals. See diagram in PR body for changes to connection management. * `connected_to` will now use a stacked concurrent map to keep track of the connection for each class. For each opened block the `class`, `role`, and `shard` will be added to the stack, when the block is exited the `class`, `role`, `shard` array will be removed from the stack. * With these changes `ActiveRecord::Base.connected_to` will remain global. If called all connections in the block will use the `role` and `shard` that was switched to. If called with a parent class like `AnimalsRecord.connected_to` only models under `AnimalsRecord` will be switched and everything else will remain the same. Examples: Given an application we have a `User` model that inherits from `ApplicationRecord` and a `Dog` model that inherits from `AnimalsRecord`. `AnimalsRecord` and `ApplicationRecord` have writing and reading connections as well as shard `default`, `one`, and `two`. ```ruby ActiveRecord::Base.connected_to(role: :reading) do User.first # reads from default replica Dog.first # reads from default replica AnimalsRecord.connected_to(role: :writing, shard: :one) do User.first # reads from default replica Dog.first # reads from shard one primary end User.first # reads from default replica Dog.first # reads from default replica ApplicationRecord.connected_to(role: :writing, shard: :two) do User.first # reads from shard two primary Dog.first # reads from default replica end end ``` Things this PR does not solve: * Currently there is no API for swapping more than one but not all connections. Apps with many primaries may want to swap 3 but not all 10 connections. We plan to build an API for that in a followup PR. * The middleware remains the same and is using the global switching methods. Therefore at this time to use this new feature applications must manually switch connections. We will also address this in a followup PR. * The `schema_cache` is currently on the `PoolConfig`. We plan on trying to move this up to the `PoolManager` or elsewhere later on so each `PoolConfig` doesn't need to hold a reference to the `schema_cache`. Co-authored-by: John Crepezzi <john.crepezzi@gmail.com>
224 lines
6.1 KiB
Ruby
224 lines
6.1 KiB
Ruby
# frozen_string_literal: true
|
|
|
|
require "config"
|
|
|
|
require "stringio"
|
|
|
|
require "active_record"
|
|
require "cases/test_case"
|
|
require "active_support/dependencies"
|
|
require "active_support/logger"
|
|
require "active_support/core_ext/kernel/singleton_class"
|
|
|
|
require "support/config"
|
|
require "support/connection"
|
|
|
|
# TODO: Move all these random hacks into the ARTest namespace and into the support/ dir
|
|
|
|
Thread.abort_on_exception = true
|
|
|
|
# Show backtraces for deprecated behavior for quicker cleanup.
|
|
ActiveSupport::Deprecation.debug = true
|
|
|
|
# Disable available locale checks to avoid warnings running the test suite.
|
|
I18n.enforce_available_locales = false
|
|
|
|
# Connect to the database
|
|
ARTest.connect
|
|
|
|
# Quote "type" if it's a reserved word for the current connection.
|
|
QUOTED_TYPE = ActiveRecord::Base.connection.quote_column_name("type")
|
|
|
|
def current_adapter?(*types)
|
|
types.any? do |type|
|
|
ActiveRecord::ConnectionAdapters.const_defined?(type) &&
|
|
ActiveRecord::Base.connection.is_a?(ActiveRecord::ConnectionAdapters.const_get(type))
|
|
end
|
|
end
|
|
|
|
def in_memory_db?
|
|
current_adapter?(:SQLite3Adapter) &&
|
|
ActiveRecord::Base.connection_pool.db_config.database == ":memory:"
|
|
end
|
|
|
|
def mysql_enforcing_gtid_consistency?
|
|
current_adapter?(:Mysql2Adapter) && "ON" == ActiveRecord::Base.connection.show_variable("enforce_gtid_consistency")
|
|
end
|
|
|
|
def supports_default_expression?
|
|
if current_adapter?(:PostgreSQLAdapter)
|
|
true
|
|
elsif current_adapter?(:Mysql2Adapter)
|
|
conn = ActiveRecord::Base.connection
|
|
!conn.mariadb? && conn.database_version >= "8.0.13"
|
|
end
|
|
end
|
|
|
|
%w[
|
|
supports_savepoints?
|
|
supports_partial_index?
|
|
supports_partitioned_indexes?
|
|
supports_expression_index?
|
|
supports_insert_returning?
|
|
supports_insert_on_duplicate_skip?
|
|
supports_insert_on_duplicate_update?
|
|
supports_insert_conflict_target?
|
|
supports_optimizer_hints?
|
|
supports_datetime_with_precision?
|
|
].each do |method_name|
|
|
define_method method_name do
|
|
ActiveRecord::Base.connection.public_send(method_name)
|
|
end
|
|
end
|
|
|
|
def with_env_tz(new_tz = "US/Eastern")
|
|
old_tz, ENV["TZ"] = ENV["TZ"], new_tz
|
|
yield
|
|
ensure
|
|
old_tz ? ENV["TZ"] = old_tz : ENV.delete("TZ")
|
|
end
|
|
|
|
def with_timezone_config(cfg)
|
|
verify_default_timezone_config
|
|
|
|
old_default_zone = ActiveRecord::Base.default_timezone
|
|
old_awareness = ActiveRecord::Base.time_zone_aware_attributes
|
|
old_zone = Time.zone
|
|
|
|
if cfg.has_key?(:default)
|
|
ActiveRecord::Base.default_timezone = cfg[:default]
|
|
end
|
|
if cfg.has_key?(:aware_attributes)
|
|
ActiveRecord::Base.time_zone_aware_attributes = cfg[:aware_attributes]
|
|
end
|
|
if cfg.has_key?(:zone)
|
|
Time.zone = cfg[:zone]
|
|
end
|
|
yield
|
|
ensure
|
|
ActiveRecord::Base.default_timezone = old_default_zone
|
|
ActiveRecord::Base.time_zone_aware_attributes = old_awareness
|
|
Time.zone = old_zone
|
|
end
|
|
|
|
# This method makes sure that tests don't leak global state related to time zones.
|
|
EXPECTED_ZONE = nil
|
|
EXPECTED_DEFAULT_TIMEZONE = :utc
|
|
EXPECTED_TIME_ZONE_AWARE_ATTRIBUTES = false
|
|
def verify_default_timezone_config
|
|
if Time.zone != EXPECTED_ZONE
|
|
$stderr.puts <<-MSG
|
|
\n#{self}
|
|
Global state `Time.zone` was leaked.
|
|
Expected: #{EXPECTED_ZONE}
|
|
Got: #{Time.zone}
|
|
MSG
|
|
end
|
|
if ActiveRecord::Base.default_timezone != EXPECTED_DEFAULT_TIMEZONE
|
|
$stderr.puts <<-MSG
|
|
\n#{self}
|
|
Global state `ActiveRecord::Base.default_timezone` was leaked.
|
|
Expected: #{EXPECTED_DEFAULT_TIMEZONE}
|
|
Got: #{ActiveRecord::Base.default_timezone}
|
|
MSG
|
|
end
|
|
if ActiveRecord::Base.time_zone_aware_attributes != EXPECTED_TIME_ZONE_AWARE_ATTRIBUTES
|
|
$stderr.puts <<-MSG
|
|
\n#{self}
|
|
Global state `ActiveRecord::Base.time_zone_aware_attributes` was leaked.
|
|
Expected: #{EXPECTED_TIME_ZONE_AWARE_ATTRIBUTES}
|
|
Got: #{ActiveRecord::Base.time_zone_aware_attributes}
|
|
MSG
|
|
end
|
|
end
|
|
|
|
def enable_extension!(extension, connection)
|
|
return false unless connection.supports_extensions?
|
|
return connection.reconnect! if connection.extension_enabled?(extension)
|
|
|
|
connection.enable_extension extension
|
|
connection.commit_db_transaction if connection.transaction_open?
|
|
connection.reconnect!
|
|
end
|
|
|
|
def disable_extension!(extension, connection)
|
|
return false unless connection.supports_extensions?
|
|
return true unless connection.extension_enabled?(extension)
|
|
|
|
connection.disable_extension extension
|
|
connection.reconnect!
|
|
end
|
|
|
|
def clean_up_legacy_connection_handlers
|
|
handler = ActiveRecord::Base.default_connection_handler
|
|
ActiveRecord::Base.connection_handlers = {}
|
|
|
|
handler.connection_pool_names.each do |name|
|
|
next if ["ActiveRecord::Base", "ARUnit2Model", "Contact", "ContactSti"].include?(name)
|
|
|
|
handler.send(:owner_to_pool_manager).delete(name)
|
|
end
|
|
end
|
|
|
|
def clean_up_connection_handler
|
|
handler = ActiveRecord::Base.connection_handler
|
|
handler.instance_variable_get(:@owner_to_pool_manager).each do |owner, pool_manager|
|
|
pool_manager.role_names.each do |role_name|
|
|
next if role_name == ActiveRecord::Base.default_role
|
|
pool_manager.remove_role(role_name)
|
|
end
|
|
end
|
|
end
|
|
|
|
def load_schema
|
|
# silence verbose schema loading
|
|
original_stdout = $stdout
|
|
$stdout = StringIO.new
|
|
|
|
adapter_name = ActiveRecord::Base.connection.adapter_name.downcase
|
|
adapter_specific_schema_file = SCHEMA_ROOT + "/#{adapter_name}_specific_schema.rb"
|
|
|
|
load SCHEMA_ROOT + "/schema.rb"
|
|
|
|
if File.exist?(adapter_specific_schema_file)
|
|
load adapter_specific_schema_file
|
|
end
|
|
|
|
ActiveRecord::FixtureSet.reset_cache
|
|
ensure
|
|
$stdout = original_stdout
|
|
end
|
|
|
|
load_schema
|
|
|
|
class SQLSubscriber
|
|
attr_reader :logged
|
|
attr_reader :payloads
|
|
|
|
def initialize
|
|
@logged = []
|
|
@payloads = []
|
|
end
|
|
|
|
def start(name, id, payload)
|
|
@payloads << payload
|
|
@logged << [payload[:sql].squish, payload[:name], payload[:binds]]
|
|
end
|
|
|
|
def finish(name, id, payload); end
|
|
end
|
|
|
|
module InTimeZone
|
|
private
|
|
def in_time_zone(zone)
|
|
old_zone = Time.zone
|
|
old_tz = ActiveRecord::Base.time_zone_aware_attributes
|
|
|
|
Time.zone = zone ? ActiveSupport::TimeZone[zone] : nil
|
|
ActiveRecord::Base.time_zone_aware_attributes = !zone.nil?
|
|
yield
|
|
ensure
|
|
Time.zone = old_zone
|
|
ActiveRecord::Base.time_zone_aware_attributes = old_tz
|
|
end
|
|
end
|