Here are a few videos on how to use PackageCompiler.jl to create binary executables and shared libraries.
The documentation for this can be found below:
As for the REPL, if you do not want to use for its interactive features, I would consider using it as a development tool that implements a compilation cache.