How to avoid repeated data movement between processes?

Try using a CachingPool: https://docs.julialang.org/en/stable/stdlib/parallel/#Base.Distributed.CachingPool

2 Likes