It seems that when a worker process is added on a thread with threadid != 1 (probably), it can’t be naively removed. For example using Distributed new_proc = fetch(Threads.@spawn addprocs(1)) |> only rmprocs(new_proc) results in ERROR: ConcurrencyViolationError("lock must be held") Stacktrace: …

Unfortunately Distributed was never threadsafe :upside_down_face: That has been fixed in Julia 1.12, and indeed your MWE works for me in the 1.12 beta.

Can't remove process when added on different thread

General Usage

JamesNZ May 26, 2025, 9:02pm 2

Unfortunately Distributed was never threadsafe That has been fixed in Julia 1.12, and indeed your MWE works for me in the 1.12 beta.

3 Likes

Topic		Replies	Views
Concurrency violation on interplay between Distributed and Base.Threads Julia at Scale question	4	992	September 23, 2020
Two @spawnat runs in the same thread New to Julia question	4	719	November 30, 2019
Concurrency violation during garbage collections? General Usage	1	445	April 1, 2021
Problem combining worker processes and threads General Usage question	8	930	July 21, 2021
Purpose of lock in addprocs General Usage	0	304	November 25, 2016

Can't remove process when added on different thread

Related topics