Using Distributed.jl, is there no built-in way to find out which workers are on the same shared-memory node? This post: [image] @spawnat with SlurmClusterManager General Usage It seems the following works, though isn’t amazingly pretty. Thoughts appreciated. @everywhere b…

Is this any help? [image] How to get more info on w ∈ workers() Julia at Scale 1 i’m not sure about that but seems RemoteException type is for this purpose, maybe you can refer to julia manual here Distributed Computing · The Julia Language 2 you can use Distributed.map_p…

Well, since Distributed.map_pid_wrkr is not documented or exported, I’d be hesitant to rely on it. And it seems like the suggestion pretty much the equivalent of pmap(_ -> gethostname(), procs())?

I just noticed that Distributed does at least export check_same_host(pids) (no documentation, though), which also seems to be used by SharedArrays, and while that does allow one to check if the given processes are on the same node, it’d be pretty cumbersome and inefficient to use that to partition t…

Distributed.jl: Group myid() by computing nodes?

Specific Domains Julia at Scale

johnh June 21, 2023, 1:40am 2

Is this any help?

Topic		Replies	Views
Getting started with distributed Julia computations on a cluster Julia at Scale	1	620	September 27, 2020
How to have each node in a cluster run a parallel job on its own CPUs, using SSH? Julia at Scale	4	801	October 14, 2024
@spawnat with SlurmClusterManager General Usage question , distributed	3	663	April 4, 2022
Identifying wokers and CPU sockets Julia at Scale	1	536	November 20, 2018
Getting started with HPC and Julia General Usage distributed	23	1388	September 28, 2023

Distributed.jl: Group myid() by computing nodes?

Related topics