From Todd Gamblin on Twitter: I keep reading papers saying containers are the only path to scalable python/shared lib loading. Large HPC jobs can DDOS filesystems by loading many libs/.py files. Spindle solves this generally: It does not need containers or special staging.
https://github.com/hpc/Spindle
I have no feeling if this would be useful for Julia on large HPC clusters.
I can imagine if a sysimage is being used on thousands of nodes it will be useful.
Aha: Spindle takes over the library loading mechanism. Hmmmm… might not be that useful for Julia then.