SharedArray on multiple nodes?

[Chong_Wang]

I am considering using shared array to distribute large amounts of data to child processes in multiprocessing. However, I begin to wonder whether this will work for multiprocessing across computing nodes. Presumably, shared array will not work across nodes since they don’t share memory. Therefore, I would like to make every node own a copy of the shared array. However, I find it difficult to write such a program. What’s the programming pattern for such a purpose?