This is another option we missed when moving things into the
Configuration object.
I had to make substantial changes to the tests, because many of them
were using the stderr option for new connections. However, I think the
end result is actually cleaner.