I split up the test so we could stop redirecting stderr to stdout but I forgot to include that part in the previous commit.