So, I think setting julia.executablePath to something like julia +1.9 should work.
What does not work (but really should) is that the VS Code extension picks up Juliaup directory overrides or the env var. That is a bit of a shame, and I hope to fix that sometime soon.