I am considering using shared array to distribute large amounts of data to child processes in multiprocessing. However, I begin to wonder whether this will work for multiprocessing across computing nodes. Presumably, shared array will not work across nodes since they don’t share memory. Therefore, I would like to make every node own a copy of the shared array. However, I find it difficult to write such a program. What’s the programming pattern for such a purpose?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Alternative to SharedArrays for multi-node cluster? | 9 | 1126 | April 20, 2020 | |
Shared Memory with MPI.jl | 1 | 694 | June 20, 2020 | |
Struggling to figure out how I should use shared arrays on a slurm cluster using remote workers | 11 | 1063 | May 8, 2020 | |
@spawnat with SlurmClusterManager | 3 | 612 | April 4, 2022 | |
Difference between SharedArrays and DistributedArrays | 7 | 3665 | February 14, 2022 |