ANN: SPMD mode in DistributedArrays.jl

Community
1

Hi all,

DistributedArrays.jl now has a basic SPMD mode for running Julia functions MPI style over distributed data. Would love to hear any feedback about the feature.

Please see https://github.com/JuliaParallel/DistributedArrays.jl#spmd-mode-an-mpi-style-spmd-mode-with-mpi-like-primitives

Amit

6 Likes
2

What is an SPMD mode?

3

Very nice! Couldn’t recvfrom_any be a method of recvfrom?

4

What is an SPMD mode?

Single Program Multiple Data. In this case the same function is executed in parallel on all participating nodes. This is the typical style of MPI programs where the same program is executed on all processors. A very basic subset of MPI-like primitives have been implemented which can be expanded in due course. As a programming model it should appeal to folks coming from an MPI background as its something they are familiar with.

5

Yes, it can. Good suggestion.

6

Thanks. It would be good to include this paragraph or similar explanation in the readme. In particular, unexplained acronyms should be banned in general!

1 Like