Have you considered having multiple depots? Only the first depot of the stack is supposed to be writable, all the others can safely be read-only. So for each user you could have
export JULIA_DEPOT_PATH=":/path/to/shared/depot"
and no one would clash with anyone else. There would still be some duplication across users, but a lot less than the no-shared-depot scenario.