Test fails when run through Pkg.test() but not when run interactively

It’s possible that during testing in your other environment, Pkg resolves new versions and installs them. Can you explicitly go into that test environment, activate it and check the versions? Are they still the versions that you expected? Can you run runtests.jl from your test environment manually (the the test environment activated and seperately with the project environment activated)? Do you still observe the difference?