Celeste is an interesting case because they don’t actually have an explicit dependency on MPI.jl, and it’s a bit tricky to figure out exactly what they were doing from looking at the source, but they do mention in interviews
we have integrated the DTree scheduler and utilized MPI-3 one-sided communication primitives
so they must have been hooking in to the cluster’s MPI at some level.