Hi, I am trying to run some distributed code on a slurm cluster using an sbatch file as below: #!/bin/bash #SBATCH --nodes=1 #SBATCH --tasks-per-node=28 #SBATCH --mem-per-cpu=4571 #SBATCH --time=24:00:00 #SBATCH -o slurm.%N.%j.out # STDOUT #SBATCH -e slurm.%N.%j.err # STDERR # Create the machine f…

I’m doing it as part of the sbatch script, it should be set on the compute node. But I’m not using machine files so maybe it’s different? I just start the processes from within the Julia script with using ClusterManagers addprocs(SlurmManager(nworkers)) The is also the --project=path/to/environme…

Using a machine file on a cluster but also propagating environment to the remote workers

Specific Domains Julia at Scale

HarrisonWilde May 7, 2020, 1:51pm 5

Interesting, how do you set that environment variable? Should I do export JULIA_PROJECT path/to/env on the login node or something else?

Topic		Replies	Views
How to run Julia on Cluster? Julia at Scale question , package , cluster	11	5440	March 16, 2021
Using Julia on Cluster New to Julia question	2	624	March 6, 2023
Julia on a cluster using SLURM, dependencies New to Julia	11	1644	November 4, 2022
How to get --machine-file for array tasks? Performance question	0	481	November 18, 2020
Debugging possible issue with `machinefile` option on SLURM system Julia at Scale	9	1709	December 19, 2017

Using a machine file on a cluster but also propagating environment to the remote workers

Related topics