# Tutorial and best practices for distributed processing with Julia on a cluster

**URL:** https://discourse.julialang.org/t/tutorial-and-best-practices-for-distributed-processing-with-julia-on-a-cluster/83878
**Category:** General Usage
**Tags:** parallel, distributed
**Created:** [July 7, 2022, 6:20am UTC](https://discourse.julialang.org/t/tutorial-and-best-practices-for-distributed-processing-with-julia-on-a-cluster/83878 "2022-07-07T06:20:08Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![amrods](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/amrods/32/2543_2.png) [@amrods](https://discourse.julialang.org/u/amrods)
#### Post date: [July 7, 2022, 6:20am UTC](https://discourse.julialang.org/t/tutorial-and-best-practices-for-distributed-processing-with-julia-on-a-cluster/83878/1 "2022-07-07T06:20:08Z")

</div>

Can anyone provide a tutorial and best practices for running distributed computations on a cluster? In particular using `Folds`.

---

<div class="post-metadata">

### Author: ![amrods](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/amrods/32/2543_2.png) [@amrods](https://discourse.julialang.org/u/amrods)
#### Post date: [July 7, 2022, 10:30am UTC](https://discourse.julialang.org/t/tutorial-and-best-practices-for-distributed-processing-with-julia-on-a-cluster/83878/2 "2022-07-07T10:30:28Z")

</div>

Is it worth buying [Julia High Performance](https://www.amazon.com/Julia-High-Performance-Avik-Sengupta/dp/178829811X) given that it was written in 2019?

---

<div class="post-metadata">

### Author: ![bernhard](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/bernhard/32/2619_2.png) [@bernhard](https://discourse.julialang.org/u/bernhard)
#### Post date: [July 7, 2022, 10:55am UTC](https://discourse.julialang.org/t/tutorial-and-best-practices-for-distributed-processing-with-julia-on-a-cluster/83878/3 "2022-07-07T10:55:34Z")

</div>

Given that there is so much content available online (much for free), including tons of forums (such as this one and stack overflow), I would personally not buy a book. Also, it seems to mention 1.0. There have been quite some developments between 1.0 and 1.9.

---

<div class="post-metadata">

### Author: ![amrods](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/amrods/32/2543_2.png) [@amrods](https://discourse.julialang.org/u/amrods)
#### Post date: [July 7, 2022, 11:12am UTC](https://discourse.julialang.org/t/tutorial-and-best-practices-for-distributed-processing-with-julia-on-a-cluster/83878/4 "2022-07-07T11:12:46Z")

</div>

Can you provide some tutorial?  
I have programmed some complex computation that I can multithread on my laptop, but now I’m trying to have it run on my computer cluster. I’m having trouble going from multithreading to multiprocessor (I’m using `Folds`). I think it’s because of the way I have set up my script, with many of `const`s that are scalars and matrices. I am struggling to find a MWE that crashes the same way my real program does.

---

<div class="post-metadata">

### Author: ![bernhard](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/bernhard/32/2619_2.png) [@bernhard](https://discourse.julialang.org/u/bernhard)
#### Post date: [July 11, 2022, 8:21am UTC](https://discourse.julialang.org/t/tutorial-and-best-practices-for-distributed-processing-with-julia-on-a-cluster/83878/5 "2022-07-11T08:21:43Z")

</div>

you can try keyword search on this forum, e.g. HPC. I have no experience with clusters myself. But I did see that there is a julia package MPI.jl, might this be of relevance?  
Posting your error message here might help too.
