The setup was wrong, and due to Gitaly being a bit more strict it had to match up. The test is now accurate and passing again.