I have access to a cluster with multiple nodes, connected thorugh SSH, each of which has multiple CPUs. My algorithm uses DistributedArrays.jl to create a distributed array and have multiple processes work on it: at the end of the simulation, the result is returned to the master worker. Since I have…

How to have each node in a cluster run a parallel job on its own CPUs, using SSH?

draftman9 October 14, 2024, 11:05am 5

Topic		Replies	Views
Running a function over multiple nodes on a julia cluster, from within a julia script Julia at Scale hpc , cluster , distributed , slurm	5	215	August 14, 2024
Running a process on several nodes on cluster Performance cluster , distributed	12	1531	December 6, 2022
Getting started with distributed Julia computations on a cluster Julia at Scale	1	581	September 27, 2020
Correct way of parallelizing on a HPC remote cluster machine Performance question , hpc , parallel , distributed , threads	8	1282	August 25, 2020
Extend distributed pmap to mutliple nodes using SLURM Julia at Scale hpc , parallel , distributed , pmap , slurm	2	309	May 3, 2023