Spent last week fighting with issues on a slurm cluster, and having finally figured it out, I wanted to share the result (and a warning): I had been parallelizing through a slurm batch script with this call: julia --machinefile $SLURM_NODEFILE indiv_array.jl (For full script, see here ) Turns out…

Using srun should be fine since that is the correct way of starting a job. The workflow should work something like this: salloc | sbatch # create resources. julia> addprocs(SlurmManager(2)) # SlurmManager should inherit the outside allocation.

OH! So an srun executed inside a slurm allocation doesn’t try to create a new allocaiton; it start processes in that existing allocation?

Yes. See Slurm Workload Manager - srun Run a parallel job on cluster managed by Slurm. If necessary, srun will first create a resource allocation in which to run the parallel job. srun in general is the right way of starting jobs within an allocation and crucially within sbatch. https://slurm.s…

This conversation is revelatory. Thank you!!

Huh, I didn’t know that would work either. Awesome @vchuravy . One note: does default addprocs() do the correct thing like addprocs(SlurmManager(2)) when in a cluster job? What I mean is, does addprocs() automatically recognize that it should use the SlurmManager with 2 process when it’s called from…

That is asking to much. We would have to redefine addprocs when loading ClusterManager.

Issues with machinefile and SLURM

Specific Domains Julia at Scale

Topic		Replies	Views
Configure Slurm File for Parallelization Julia at Scale parallel , cluster , distributed , slurm	4	225	October 13, 2024
Addprocs_slurm not connecting to all available workers Julia at Scale question , parallel , cluster , distributed , high-performance	7	213	December 4, 2024
SLURM manager: one node with multiple tasks General Usage slurm	2	243	December 28, 2024
SlurmClusterManagers timeout Julia at Scale slurm	2	99	June 19, 2025
Running Julia in a SLURM Cluster Performance parallel , cluster , distributed	6	8157	April 11, 2024

Issues with machinefile and SLURM

Related topics