I’m beginning to think we should mostly stop running package CI against nightly. Not just because of appearances, but because if package devs are pro-actively adapting to Julia changes, it might hide unintended breakages of backwards compatibility from PkgEval. PkgEval runs start in earnest after the feature freeze, so much of the time they are not being run.
There will be exceptions, of course: packages used to develop Julia (Cthulhu, Revise, Debugger, JET, etc) need to test against nightly. But I have the growing sense that it’s a mistake to have most packages do so.