Portable Julia and VSCode

I have two copies of Julia. One is my normal one that I use on my PC. The other is a recently downloaded Portable version on a USB stick.

I am trying to set up a Portable version of Julia to work with my portable version of VScode.
I have set up VScode and also made sure it was pointing to the right path (The Julia executable on the USB drive).

But when I run the portable Julia, it seems to still refer back to the normal PC Julia. I know this because when I check the package status on the portable julia, it still shows me all the packages in added to my my normal PC julia version instead of no packages.