I don´t know what’s about that ssh key, but if you make your code a proper package, you will just tell the users to “add” the package and that will the care of all dependencies, with proper versions, etc.
(absolutely tell them to install julia with juliaup).
This is one way to have scripts working with minimal startup time: Creating a standalone app on different platforms - #3 by lmiq