Developing a Beginner's Roadmap to Learn Julia High Performance Computing for Data Science

Celeste is an interesting case because they don’t actually have an explicit dependency on MPI.jl, and it’s a bit tricky to figure out exactly what they were doing from looking at the source, but they do mention in interviews

we have integrated the DTree scheduler and utilized MPI-3 one-sided communication primitives

so they must have been hooking in to the cluster’s MPI at some level.

1 Like