Stop calling UnlinkRepositoryFromObjectPool RPC

Fixes https://gitlab.com/gitlab-org/gitlab-ce/issues/59777.

In earlier iterations of our implementation of Git object deduplication
we thought we would be making extensive use of Git remotes in pool
repositories in the future, and that we should manage these remotes
carefully from the start. We now expect we only care about one remote,
namely the source project. The other remotes are there only for forensic
purposes.

Before this MR we tried to also remove pool remotes when member projects
got deleted, with the UnlinkRepositoryFromObjectPool RPC. This is
fragile when there are race conditions (see
https://gitlab.com/gitlab-org/gitaly/issues/1568#note_153955926). We
have spent some time making this RPC less fragile in
https://gitlab.com/gitlab-org/gitaly/merge_requests/1151 but looking at
this problem again, I think we should just stop calling it.
This commit is contained in:
Jacob Vosmaer 2019-04-02 13:20:26 +00:00 committed by Grzegorz Bizon
parent 4b9dbec33c
commit 35b9274f12
5 changed files with 6 additions and 19 deletions

View file

@ -81,10 +81,7 @@ class PoolRepository < ApplicationRecord
object_pool.link(repository.raw)
end
# This RPC can cause data loss, as not all objects are present the local repository
def unlink_repository(repository)
object_pool.unlink_repository(repository.raw)
def mark_obsolete_if_last(repository)
if member_projects.where.not(id: repository.project.id).exists?
true
else

View file

@ -2128,7 +2128,7 @@ class Project < ApplicationRecord
end
def leave_pool_repository
pool_repository&.unlink_repository(repository) && update_column(:pool_repository_id, nil)
pool_repository&.mark_obsolete_if_last(repository) && update_column(:pool_repository_id, nil)
end
def link_pool_repository

View file

@ -8,7 +8,7 @@ module Gitlab
GL_REPOSITORY = ""
delegate :exists?, :size, to: :repository
delegate :unlink_repository, :delete, to: :object_pool_service
delegate :delete, to: :object_pool_service
attr_reader :storage, :relative_path, :source_repository, :gl_project_path

View file

@ -33,16 +33,6 @@ module Gitlab
GitalyClient.call(storage, :object_pool_service, :link_repository_to_object_pool,
request, timeout: GitalyClient.fast_timeout)
end
def unlink_repository(repository)
request = Gitaly::UnlinkRepositoryFromObjectPoolRequest.new(
object_pool: object_pool,
repository: repository.gitaly_repository
)
GitalyClient.call(storage, :object_pool_service, :unlink_repository_from_object_pool,
request, timeout: GitalyClient.fast_timeout)
end
end
end
end

View file

@ -24,14 +24,14 @@ describe PoolRepository do
end
end
describe '#unlink_repository' do
describe '#mark_obsolete_if_last' do
let(:pool) { create(:pool_repository, :ready) }
context 'when the last member leaves' do
it 'schedules pool removal' do
expect(::ObjectPool::DestroyWorker).to receive(:perform_async).with(pool.id).and_call_original
pool.unlink_repository(pool.source_project.repository)
pool.mark_obsolete_if_last(pool.source_project.repository)
end
end
@ -40,7 +40,7 @@ describe PoolRepository do
create(:project, :repository, pool_repository: pool)
expect(::ObjectPool::DestroyWorker).not_to receive(:perform_async).with(pool.id)
pool.unlink_repository(pool.source_project.repository)
pool.mark_obsolete_if_last(pool.source_project.repository)
end
end
end