Spent last week fighting with issues on a slurm cluster, and having finally figured it out, I wanted to share the result (and a warning): I had been parallelizing through a slurm batch script with this call: julia --machinefile $SLURM_NODEFILE indiv_array.jl (For full script, see here ) Turns out…

Using srun should be fine since that is the correct way of starting a job. The workflow should work something like this: salloc | sbatch # create resources. julia> addprocs(SlurmManager(2)) # SlurmManager should inherit the outside allocation.

Issues with machinefile and SLURM

Specific Domains Julia at Scale

vchuravy Split this topic December 21, 2017, 8:56pm 8

A post was split to a new topic: Issues running on a PBS cluster

Topic		Replies	Views
[Ann] julia in parallel batch mode: job schedulers, etc Julia at Scale announcement	2	1748	November 26, 2018
Issues running on a PBS cluster Julia at Scale parallel , cluster , distributed	0	854	December 21, 2017
Debugging possible issue with `machinefile` option on SLURM system Julia at Scale	9	1726	December 19, 2017
Julia crashes when started on the nodes of a HPC cluster General Usage question , hpc , debug , cluster	8	2207	January 3, 2018
How to parallel Julia on multiple nodes on HPC (slurm)? Julia at Scale question	11	3621	May 20, 2020

Issues with machinefile and SLURM

Related topics