# What's the easiest way to set up multi-node distributed computing with Julia?

**URL:** <https://discourse.julialang.org/t/whats-the-easiest-way-to-set-up-multi-node-distributed-computing-with-julia/46169>\
**Category:** New to Julia\
**Created:** [September 7, 2020, 12:14am UTC](https://discourse.julialang.org/t/whats-the-easiest-way-to-set-up-multi-node-distributed-computing-with-julia/46169 "2020-09-07T00:14:21Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![xiaodai](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/xiaodai/32/15937_2.png) [@xiaodai](https://discourse.julialang.org/u/xiaodai)\
**Post date:** [September 7, 2020, 12:14am UTC](https://discourse.julialang.org/t/whats-the-easiest-way-to-set-up-multi-node-distributed-computing-with-julia/46169/1 "2020-09-07T00:14:21Z")

</div>

I was thinking, is it easier to just buy another Raspberry pi, install Julia and then try to set up SSH into it?

Or is it just to spinning a few EC2 instances and do it from there?

Does anyone have advice on what can be done with setting a distribute environment that is actually multinode not just multiprocess on the same machine?

Ideally, it will be easy to maintain and cheap.

---

<div class="post-metadata">

**Author:** ![tbeason](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tbeason/32/15898_2.png) [@tbeason](https://discourse.julialang.org/u/tbeason)\
**Post date:** [September 7, 2020, 3:01am UTC](https://discourse.julialang.org/t/whats-the-easiest-way-to-set-up-multi-node-distributed-computing-with-julia/46169/2 "2020-09-07T03:01:02Z")

</div>

You should only go the RPi route if you actually want to tinker with the hardware. I have not used mine in a while, but I know it would be silly to try to do any real work on it. They just aren’t as powerful as you’d hope. Even the smallest EC2 would beat it. Perhaps it would be a lower cost way to browse the Discourse…

---

<div class="post-metadata">

**Author:** ![johnh](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/johnh/32/3615_2.png) [@johnh](https://discourse.julialang.org/u/johnh)\
**Post date:** [September 7, 2020, 7:23am UTC](https://discourse.julialang.org/t/whats-the-easiest-way-to-set-up-multi-node-distributed-computing-with-julia/46169/3 "2020-09-07T07:23:46Z")

</div>

AWS Parallelcluster is easy to set up. You can set it up on the free tier to play around with.  
As usual though - make sure to terminate all instances and gateways which you are not using.

> **[AWS ParallelCluster - Amazon Web Services](https://aws.amazon.com/hpc/parallelcluster/)**

Should you wish to go with Azure I can get you some advice.

---

<div class="post-metadata">

**Author:** ![Elrod](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/elrod/32/22461_2.png) [@Elrod](https://discourse.julialang.org/u/Elrod)\
**Post date:** [September 7, 2020, 7:41am UTC](https://discourse.julialang.org/t/whats-the-easiest-way-to-set-up-multi-node-distributed-computing-with-julia/46169/4 "2020-09-07T07:41:48Z")

</div>

Coming soon:

[![](https://global.discourse-cdn.com/julialang/original/3X/d/1/d105a3602fad01de65374de66301890990ce58f2.jpeg "JuliaCon 2020 | Sponsor Talk: Effortless Parallel Computing on JuliaHub | Julia Computing") ](https://www.youtube.com/watch?v=JVUJ5Oohuhs)

Doesn’t get much easier than that!

I like playing with hardware.  
Right now, I have:

- 10980XE, overclocked to 4.1 GHz AVX512 all-core (18 cores)
- 7980XE, overclocked to 3.8 GHz AVX512 all-core (18 cores)
- 7900X, stock speed I think, 3.3 GHz AVX512 all-core (10 cores)

I also have a 9940X (14 cores) sitting in a box, and an old infiniband switch.  
I plan on getting around to experimenting with running it as a cluster at some point, so I’d be interested in suggestions on the easiest way. Probably `SSHManager`, although the different clock speeds probably means I’d need `pmap` to distribute work?

---

<div class="post-metadata">

**Author:** ![johnh](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/johnh/32/3615_2.png) [@johnh](https://discourse.julialang.org/u/johnh)\
**Post date:** [September 7, 2020, 9:28am UTC](https://discourse.julialang.org/t/whats-the-easiest-way-to-set-up-multi-node-distributed-computing-with-julia/46169/5 "2020-09-07T09:28:02Z")

</div>

Cluster toolkits:  
[https://openhpc.community/](https://openhpc.community/)

Bright Cluster Manager - free for 8 nodes [Easy8](https://www.brightcomputing.com/easy8)

Qlustar [https://qlustar.com/](https://qlustar.com/)

If anyone is building an HPC cluster please PM me. That what I do for a day job.