Spent last week fighting with issues on a slurm cluster, and having finally figured it out, I wanted to share the result (and a warning): I had been parallelizing through a slurm batch script with this call: julia --machinefile $SLURM_NODEFILE indiv_array.jl (For full script, see here ) Turns out…

Using srun should be fine since that is the correct way of starting a job. The workflow should work something like this: salloc | sbatch # create resources. julia> addprocs(SlurmManager(2)) # SlurmManager should inherit the outside allocation.

Issues with machinefile and SLURM

Specific Domains Julia at Scale

vchuravy Split this topic December 21, 2017, 8:56pm 8

A post was split to a new topic: Issues running on a PBS cluster

Topic		Replies	Views
Configure Slurm File for Parallelization Julia at Scale parallel , cluster , distributed , slurm	4	133	October 13, 2024
Addprocs_slurm not connecting to all available workers Julia at Scale question , parallel , cluster , distributed , high-performance	7	117	December 4, 2024
SLURM manager: one node with multiple tasks General Usage slurm	2	161	December 28, 2024
SlurmClusterManagers timeout Julia at Scale slurm	2	47	June 19, 2025
Running Julia in a SLURM Cluster Performance parallel , cluster , distributed	6	7653	April 11, 2024

Issues with machinefile and SLURM

Related topics