What is the elegant way to use julia (or/and juliaup) portably?

If I want to use julia on a portable drive, and keep all the user settings (e.g., the startup.jl file) along with the installation path, and, I also want to update julia and manage its different versions conveniently, then what will be the most elegant way?