A workaround I am using in projects is to deploy Pluto notebooks in a git repo sharing a common environment. They would just activate this environment, disabling the Pluto package manager. So once this environment is instantiated, loading times would go down.
Of course this would introduce quite some inconveniences in the context of teaching and disable an important advantage of Pluto in this context…