I am trying to run a simple file that is pasted below: using Distributed addprocs(4) println("Number of processes: ", nprocs()) println("Number of workers: ", nworkers()) @sync @distributed for i in 1:4 sleep(1) id, pid, host = myid(), getpid(), gethostname() println(id, " " , pid, "…

I’ve had a similar issue with SlurmManager but have not had enough time to explore/diagnose it for bug reporting. However, I’ve found that manually creating adding worker processes on the remote nodes of the cluster has worked well: using Distributed # Extract all the hostname info from slurm job…

I am unable to run a simple distributed.jl code on my slurm cluster

Specific Domains Julia at Scale

affans February 7, 2024, 7:49pm 3

Take a look at my reply here as well as the entire thread.

1 Like

Topic		Replies	Views
How to parallel Julia on multiple nodes on HPC (slurm)? Julia at Scale question	11	3644	May 20, 2020
Distributed Computing with Slurm and Julia Julia at Scale	9	3640	February 10, 2022
Running Julia in a SLURM Cluster Performance parallel , cluster , distributed	6	7844	April 11, 2024
Error when using @distributed for on cluster with multiple nodes Julia at Scale cluster	4	1788	August 31, 2018
Code that works fine distributed across processes on one node using slurm seems to fail when trying to generate workers across many Julia at Scale question	2	1421	May 19, 2022

I am unable to run a simple distributed.jl code on my slurm cluster

Related topics