# \#cluster

**URL:** https://discourse.julialang.org/tag/cluster/111.md

[Latest](https://discourse.julialang.org/latest.md) · [Categories](https://discourse.julialang.org/categories.md) · [Tags](https://discourse.julialang.org/tags.md)

---

## [\[ANN\] KaimonSlate.jl: a reactive environment for ambitious work](https://discourse.julialang.org/t/ann-kaimonslate-jl-a-reactive-environment-for-ambitious-work/139185)

<div class="topic-metadata">

**Author:** [@kahliburke](https://discourse.julialang.org/u/kahliburke)\
**Replies:** 23\
**Last updated:** [September 24, 2026, 11:27pm UTC](https://discourse.julialang.org/t/ann-kaimonslate-jl-a-reactive-environment-for-ambitious-work/139185 "2026-09-24T23:27:10Z")

</div>

I’ve been building KaimonSlate.jl, a reactive computing environment for Julia, for a while now. It’s fully available in General, and I’d like to take a quick tour of it here. Julia got rid of the two-language problem. S…

---

## [New package for clustering - need for an arXiv endorser](https://discourse.julialang.org/t/new-package-for-clustering-need-for-an-arxiv-endorser/128983)

<div class="topic-metadata">

**Author:** [@uwestoehr](https://discourse.julialang.org/u/uwestoehr)\
**Replies:** 3\
**Last updated:** [April 13, 2026, 2:30pm UTC](https://discourse.julialang.org/t/new-package-for-clustering-need-for-an-arxiv-endorser/128983 "2026-04-13T14:30:42Z")

</div>

Hi I am Uwe, a MEMS engineer. During evaluation of some measurement data I had an idea for a clustering algorithm and started with Julia to be able to implement this algorithm as I had it in mind. That succeeded and the …

---

## [Ask for official guide for Julia installation, deployment and use on Linux cluster](https://discourse.julialang.org/t/ask-for-official-guide-for-julia-installation-deployment-and-use-on-linux-cluster/109396)

<div class="topic-metadata">

**Author:** [@WuSiren](https://discourse.julialang.org/u/WuSiren)\
**Replies:** 31\
**Last updated:** [December 1, 2025, 11:10am UTC](https://discourse.julialang.org/t/ask-for-official-guide-for-julia-installation-deployment-and-use-on-linux-cluster/109396 "2025-12-01T11:10:11Z")

</div>

Is there any official guide for Julia installation, deployment and use on Linux cluster to someone who is new to both Julia and cluster like me? Known: As far as I know, the cluster uses SLURM for task scheduling; I was…

---

## [\[ANN\] UnsupervisedClustering.jl, a unified interface for clustering with optimization techniques](https://discourse.julialang.org/t/ann-unsupervisedclustering-jl-a-unified-interface-for-clustering-with-optimization-techniques/132720)

<div class="topic-metadata">

**Author:** [@raphasampaio](https://discourse.julialang.org/u/raphasampaio)\
**Replies:** 0\
**Last updated:** [September 27, 2025, 9:57pm UTC](https://discourse.julialang.org/t/ann-unsupervisedclustering-jl-a-unified-interface-for-clustering-with-optimization-techniques/132720 "2025-09-27T21:57:34Z")

</div>

I’m happy to announce UnsupervisedClustering.jl, a Julia package that provides a consistent interface for unsupervised clustering algorithms, along with strategies to escape local optima and reduce overfitting. Unsuperv…

---

## [Timeout issues on slurm cluster](https://discourse.julialang.org/t/timeout-issues-on-slurm-cluster/58303)

<div class="topic-metadata">

**Author:** [@ffreyer](https://discourse.julialang.org/u/ffreyer)\
**Replies:** 7\
**Last updated:** [June 4, 2025, 9:20am UTC](https://discourse.julialang.org/t/timeout-issues-on-slurm-cluster/58303 "2025-06-04T09:20:33Z")

</div>

I’ve been running into IOError: connect: connection timed out (ETIMEDOUT) with about half my jobs using ClusterManagers on a slurm cluster. This issue started appearing about a month ago with julia 1.3 and ClusterManager…

---

## [Running batch jobs on cluster](https://discourse.julialang.org/t/running-batch-jobs-on-cluster/129117)

<div class="topic-metadata">

**Author:** [@bulbul](https://discourse.julialang.org/u/bulbul)\
**Replies:** 3\
**Last updated:** [May 20, 2025, 2:04pm UTC](https://discourse.julialang.org/t/running-batch-jobs-on-cluster/129117 "2025-05-20T14:04:16Z")

</div>

I am trying to run a number of instances of a program on a cluster. The job submit script is as follows #!/bin/bash #SBATCH --job-name=open\_array #SBATCH --array=1-96 #SBATCH --nodes=1 #SBATCH --ntasks-per-node=1 #SBATC…

---

## [Files quota exceeded when trying to install Julia on a cluster with juliaup](https://discourse.julialang.org/t/files-quota-exceeded-when-trying-to-install-julia-on-a-cluster-with-juliaup/128469)

<div class="topic-metadata">

**Author:** [@e3c6](https://discourse.julialang.org/u/e3c6)\
**Replies:** 2\
**Last updated:** [May 1, 2025, 5:14am UTC](https://discourse.julialang.org/t/files-quota-exceeded-when-trying-to-install-julia-on-a-cluster-with-juliaup/128469 "2025-05-01T05:14:04Z")

</div>

I’m trying to install Julia on a cluster, running this: curl -fsSL https://install.julialang.org | sh -s -- --path $JULIAUP\_DEPOT\_PATH But I get the following error: Now installing Juliaup Error: Failed to extract dow…

---

## [Tasks from Distributed don't release memory](https://discourse.julialang.org/t/tasks-from-distributed-dont-release-memory/127801)

<div class="topic-metadata">

**Author:** [@alequa](https://discourse.julialang.org/u/alequa)\
**Replies:** 0\
**Last updated:** [April 7, 2025, 2:36pm UTC](https://discourse.julialang.org/t/tasks-from-distributed-dont-release-memory/127801 "2025-04-07T14:36:44Z")

</div>

Hello, I use Julia on a SlurmCluster. I recently encountered several problems with OutOfMemory errors. I run a package for Spiking Neural Network simulations that I co-develop, and in which I have no explicit memory ma…

---

## [Addprocs\_slurm not connecting to all available workers](https://discourse.julialang.org/t/addprocs-slurm-not-connecting-to-all-available-workers/123149)

<div class="topic-metadata">

**Author:** [@jewh](https://discourse.julialang.org/u/jewh)\
**Replies:** 7\
**Last updated:** [December 4, 2024, 7:17am UTC](https://discourse.julialang.org/t/addprocs-slurm-not-connecting-to-all-available-workers/123149 "2024-12-04T07:17:47Z")

</div>

I’m using Distributed and ClusterManagers to run large numbers of simulations in parallel on my university HPC cluster. Scheduling and job management on the cluster is handled by Slurm. I initialise each of the parallel…

---

## [Configure Slurm File for Parallelization](https://discourse.julialang.org/t/configure-slurm-file-for-parallelization/121239)

<div class="topic-metadata">

**Author:** [@benjamin.nunez](https://discourse.julialang.org/u/benjamin.nunez)\
**Replies:** 4\
**Last updated:** [October 13, 2024, 7:41pm UTC](https://discourse.julialang.org/t/configure-slurm-file-for-parallelization/121239 "2024-10-13T19:41:57Z")

</div>

Hello everyone! I am using a computer cluster to parallelize the execution of my Julia code. The partition I am using has a total of 14 nodes, and my goal is to connect to this partition and execute my main.jl file, wh…

---

## [Heap-size-hint in MPIClusterManager.jl for out of memory problems](https://discourse.julialang.org/t/heap-size-hint-in-mpiclustermanager-jl-for-out-of-memory-problems/121050)

<div class="topic-metadata">

**Author:** [@sparrowhawk](https://discourse.julialang.org/u/sparrowhawk)\
**Replies:** 3\
**Last updated:** [October 8, 2024, 2:23pm UTC](https://discourse.julialang.org/t/heap-size-hint-in-mpiclustermanager-jl-for-out-of-memory-problems/121050 "2024-10-08T14:23:15Z")

</div>

Hi, for the MPI transport option, where only MPI can be used for communication on the cluster, I’ve gotten the example from MPIClusterManagers.jl working well for my use case. However, I would like to add a heap size hin…

---

## [How can I check the running progress or intermediate output of tasks submitted to the cluster?](https://discourse.julialang.org/t/how-can-i-check-the-running-progress-or-intermediate-output-of-tasks-submitted-to-the-cluster/119737)

<div class="topic-metadata">

**Author:** [@WuSiren](https://discourse.julialang.org/u/WuSiren)\
**Replies:** 1\
**Last updated:** [September 23, 2024, 11:33am UTC](https://discourse.julialang.org/t/how-can-i-check-the-running-progress-or-intermediate-output-of-tasks-submitted-to-the-cluster/119737 "2024-09-23T11:33:12Z")

</div>

My script contains println or other codes to output some progress information to monitor the running progress of the script. After submitting it through SLURM, the script starts running. However, during the execution of …

---

## [Running a function over multiple nodes on a julia cluster, from within a julia script](https://discourse.julialang.org/t/running-a-function-over-multiple-nodes-on-a-julia-cluster-from-within-a-julia-script/118153)

<div class="topic-metadata">

**Author:** [@eveningsilverfox](https://discourse.julialang.org/u/eveningsilverfox)\
**Replies:** 5\
**Last updated:** [August 14, 2024, 3:27pm UTC](https://discourse.julialang.org/t/running-a-function-over-multiple-nodes-on-a-julia-cluster-from-within-a-julia-script/118153 "2024-08-14T15:27:56Z")

</div>

I have a function whose skeleton looks like this: function inner(a,ij) return a\*ij; end function outer(a,N) arr = zeros(ComplexF64, N); for ij = 1:N arr\[ij\] = inner(a,ij); end return sum(arr) end…

---

## [AssertionError in K-medoids algorithm](https://discourse.julialang.org/t/assertionerror-in-k-medoids-algorithm/116425)

<div class="topic-metadata">

**Author:** [@Hasselvej](https://discourse.julialang.org/u/Hasselvej)\
**Replies:** 0\
**Last updated:** [June 30, 2024, 12:12pm UTC](https://discourse.julialang.org/t/assertionerror-in-k-medoids-algorithm/116425 "2024-06-30T12:12:20Z")

</div>

I am using K-medoids to reduce my data (potential future scenarios of a stock’s price) from 400 scenarios to n = 25. I computed the distance matrix based on the Eucledian distance: C = pairwise(Euclidean(), data', data'…

---

## [Distributed performance depends on the number of workers?](https://discourse.julialang.org/t/distributed-performance-depends-on-the-number-of-workers/115514)

<div class="topic-metadata">

**Author:** [@greivin](https://discourse.julialang.org/u/greivin)\
**Replies:** 0\
**Last updated:** [June 11, 2024, 9:01pm UTC](https://discourse.julialang.org/t/distributed-performance-depends-on-the-number-of-workers/115514 "2024-06-11T21:01:09Z")

</div>

I’m executing a code that solves a linear system (Ax = b) for a fixed matrix A, and for several vectors b\_i here i runs from 1 to N. I set N to match the number of available cores in my system, therefore I’ll be solving …

---

## [Clustering\_quality not defined](https://discourse.julialang.org/t/clustering-quality-not-defined/114309)

<div class="topic-metadata">

**Author:** [@GiuliaM](https://discourse.julialang.org/u/GiuliaM)\
**Replies:** 1\
**Last updated:** [May 15, 2024, 5:47pm UTC](https://discourse.julialang.org/t/clustering-quality-not-defined/114309 "2024-05-15T17:47:11Z")

</div>

Hello everyone! I’m trying to use the package Clustering.jl. The documentation reports this code to calculate different performance indices. using Plots, Clustering X = hcat(\[4., 5.\] .+ 0.4 \* randn(2, 10), \[9.,…

---

## [RFC: ClusteringAPI.jl](https://discourse.julialang.org/t/rfc-clusteringapi-jl/112258)

<div class="topic-metadata">

**Author:** [@Datseris](https://discourse.julialang.org/u/Datseris)\
**Replies:** 27\
**Last updated:** [April 18, 2024, 9:11pm UTC](https://discourse.julialang.org/t/rfc-clusteringapi-jl/112258 "2024-04-18T21:11:54Z")

</div>

Hi all, this could go either in statistics, data, or machine learning domains, please share. Alright, so I was trying to test various different clustering algorithms to see which one best clusters my data. In doing so,…

---

## [Multithreading problems in running Julia in a Slurm cluster](https://discourse.julialang.org/t/multithreading-problems-in-running-julia-in-a-slurm-cluster/112826)

<div class="topic-metadata">

**Author:** [@maphdze](https://discourse.julialang.org/u/maphdze)\
**Replies:** 8\
**Last updated:** [April 18, 2024, 7:34am UTC](https://discourse.julialang.org/t/multithreading-problems-in-running-julia-in-a-slurm-cluster/112826 "2024-04-18T07:34:03Z")

</div>

Hi! I am confused about running Julia code in a Slurm cluster. I am solving a nonlinear PDE so I have to solve it step by step. In each step a linear equation system Ax=b (from FEM so A is sparse) is solved by \\ which …

---

## [Running Julia in a SLURM Cluster](https://discourse.julialang.org/t/running-julia-in-a-slurm-cluster/67614)

<div class="topic-metadata">

**Author:** [@Noah\_Guzman](https://discourse.julialang.org/u/Noah_Guzman)\
**Replies:** 6\
**Last updated:** [April 11, 2024, 11:11am UTC](https://discourse.julialang.org/t/running-julia-in-a-slurm-cluster/67614 "2024-04-11T11:11:15Z")

</div>

I’m looking to provide an explicit explanation of the simplest way to get a Julia program running in parallel across multiple nodes in a SLURM cluster (basically a minimal working example that illustrates the logic). My…

---

## [Running independent variable-length simulations on busy Slurm cluster](https://discourse.julialang.org/t/running-independent-variable-length-simulations-on-busy-slurm-cluster/112162)

<div class="topic-metadata">

**Author:** [@Sevi](https://discourse.julialang.org/u/Sevi)\
**Replies:** 2\
**Last updated:** [April 5, 2024, 7:40am UTC](https://discourse.julialang.org/t/running-independent-variable-length-simulations-on-busy-slurm-cluster/112162 "2024-04-05T07:40:19Z")

</div>

I’m running Julia code on a Slurm cluster, but this question is not entirely specific to Julia. I hope it’s OK to post it here anyway (I am also fine with a Julia-specific solution): Problem Suppose we have a large numb…

---

## [Is there a cluster manager for Google?](https://discourse.julialang.org/t/is-there-a-cluster-manager-for-google/111358)

<div class="topic-metadata">

**Author:** [@schlichtanders](https://discourse.julialang.org/u/schlichtanders)\
**Replies:** 0\
**Last updated:** [March 8, 2024, 2:18pm UTC](https://discourse.julialang.org/t/is-there-a-cluster-manager-for-google/111358 "2024-03-08T14:18:51Z")

</div>

I haven’t used gcloud yet, hence sorry if this question does not make sense. We have AWSClusterManagers.jl for AWS and AzManagers.jl for Azure and K8sClusterManagers.jl for Kubernetes. Is there one for GCloud?

---

## [Who is using AWSClusterManagers.jl?](https://discourse.julialang.org/t/who-is-using-awsclustermanagers-jl/111357)

<div class="topic-metadata">

**Author:** [@schlichtanders](https://discourse.julialang.org/u/schlichtanders)\
**Replies:** 0\
**Last updated:** [March 8, 2024, 2:16pm UTC](https://discourse.julialang.org/t/who-is-using-awsclustermanagers-jl/111357 "2024-03-08T14:16:18Z")

</div>

I am wondering whether AWSClusterManagers.jl is still used, as it hasn’t seen any updates since a couple of years.

---

## [Code after @sync gets executed while @async blocks are still running](https://discourse.julialang.org/t/code-after-sync-gets-executed-while-async-blocks-are-still-running/108854)

<div class="topic-metadata">

**Author:** [@novalex98](https://discourse.julialang.org/u/novalex98)\
**Replies:** 3\
**Last updated:** [January 16, 2024, 9:15am UTC](https://discourse.julialang.org/t/code-after-sync-gets-executed-while-async-blocks-are-still-running/108854 "2024-01-16T09:15:43Z")

</div>

I am using Distributed.jl and trying to parallelize a for loop on a slurm cluster (Hyak klone at the University of Washington). I mark the loop with the @sync macro, then I enclose its insides in an @async macro. There’s…

---

## [Error precompiling on cluster](https://discourse.julialang.org/t/error-precompiling-on-cluster/104974)

<div class="topic-metadata">

**Author:** [@roi.holtzman](https://discourse.julialang.org/u/roi.holtzman)\
**Replies:** 26\
**Last updated:** [January 9, 2024, 2:14am UTC](https://discourse.julialang.org/t/error-precompiling-on-cluster/104974 "2024-01-09T02:14:09Z")

</div>

I am running a simple script on a cluster. I simply perform many instances of the same script. I get the following error: \<E2\>\<94\>\<8C\> Warning: The call to compilecache failed to create a usable precompiled cache file …

---

## [Troubleshooting an Unhandled error in Parallel Computation on a Slurm Cluster](https://discourse.julialang.org/t/troubleshooting-an-unhandled-error-in-parallel-computation-on-a-slurm-cluster/107427)

<div class="topic-metadata">

**Author:** [@shahmari](https://discourse.julialang.org/u/shahmari)\
**Replies:** 0\
**Last updated:** [December 11, 2023, 10:43am UTC](https://discourse.julialang.org/t/troubleshooting-an-unhandled-error-in-parallel-computation-on-a-slurm-cluster/107427 "2023-12-11T10:43:26Z")

</div>

Hello Julia community! I’m encountering an issue with distributing some computation across threads of multiple nodes in a Slurm cluster. I’m using Distributed.jl, SlurmClusterManager.jl, and SharedArrays.jl to paralleli…

---

## [How to properly run julia 1.9 on LSF cluster](https://discourse.julialang.org/t/how-to-properly-run-julia-1-9-on-lsf-cluster/104999)

<div class="topic-metadata">

**Author:** [@roi.holtzman](https://discourse.julialang.org/u/roi.holtzman)\
**Replies:** 3\
**Last updated:** [October 19, 2023, 8:48am UTC](https://discourse.julialang.org/t/how-to-properly-run-julia-1-9-on-lsf-cluster/104999 "2023-10-19T08:48:02Z")

</div>

I updated to julia 1.9.3, and I am unable to run my code on a cluster. The 1st issue is the precompilation. It seems to me that every time I open a new session with the cluster, I need to precompile my project. As far a…

---

## [Constant out of memory error of VSCode extension](https://discourse.julialang.org/t/constant-out-of-memory-error-of-vscode-extension/101323)

<div class="topic-metadata">

**Author:** [@wujinq](https://discourse.julialang.org/u/wujinq)\
**Replies:** 8\
**Last updated:** [July 13, 2023, 11:49pm UTC](https://discourse.julialang.org/t/constant-out-of-memory-error-of-vscode-extension/101323 "2023-07-13T23:49:10Z")

</div>

So I use VSCode to login in to the supercomputer I’m working with, and I installed the Julia extension on it. It works well, but recently I noticed that the following error appears frequently: \[ Info: Loading GPUArraysC…

---

## [Integrating bash/Julia script](https://discourse.julialang.org/t/integrating-bash-julia-script/101167)

<div class="topic-metadata">

**Author:** [@99dB](https://discourse.julialang.org/u/99dB)\
**Replies:** 5\
**Last updated:** [July 10, 2023, 11:48am UTC](https://discourse.julialang.org/t/integrating-bash-julia-script/101167 "2023-07-10T11:48:45Z")

</div>

Hello all, I have some csv files and I want to read and process theme using a Julia script by running a bash script on a cluster. For each csv, I want an independent job on the cluster. Is there a smart way of doing th…

---

## [Installation on managed cluster](https://discourse.julialang.org/t/installation-on-managed-cluster/100145)

<div class="topic-metadata">

**Author:** [@VictorEijkhout](https://discourse.julialang.org/u/VictorEijkhout)\
**Replies:** 25\
**Last updated:** [July 4, 2023, 8:46pm UTC](https://discourse.julialang.org/t/installation-on-managed-cluster/100145 "2023-07-04T20:46:45Z")

</div>

I install scientific software on a big supercomputer cluster, and we have occasional requests for Julia. So I thought I’d make an installation that contains a bunch of popular packages such as HDF5 and MPI. Installing …

---

## [MPIClusterManagers task split across nodes](https://discourse.julialang.org/t/mpiclustermanagers-task-split-across-nodes/97983)

<div class="topic-metadata">

**Author:** [@sparrowhawk](https://discourse.julialang.org/u/sparrowhawk)\
**Replies:** 2\
**Last updated:** [April 28, 2023, 2:02am UTC](https://discourse.julialang.org/t/mpiclustermanagers-task-split-across-nodes/97983 "2023-04-28T02:02:31Z")

</div>

Hi all, I’ve been using Julia on the cluster quite successfully with MPIClusterManagers.jl and MPI.jl with the MPIClusterManagers.start\_main\_loop(MPI\_TRANSPORT\_ALL) option and using native julia constructs after that su…

[Next page](https://discourse.julialang.org/tag/cluster/111.md?match_all_tags=true&page=1&tags%5B%5D=cluster)