I am trying to create a SharedArray on a different worker in julia 1.3.0. Consider the following code snippet: using Distributed addprocs(1) using SharedArrays f = @spawnat 2 SharedVector{Float64}(10) fetch(f) If I try to execute it, I get an error ERROR: On worker 2: UndefVarError: SharedVe…

Hello, @Gregstrq . I think you have to create the SharedArray first, and later you can work with it with the different process. It has not sense to try to create the shared vector only in one process. A shared vector is a vector whose values are distributed between several processes, see Parallel Co…

Check this thread: [image] Should a view of a SharedArray be also shared between workers? Internals & Design Consider the following simple example, where we try to fill a view of a SharedArray on a worker (I’ve tested it on julia 1.1.0): using Distributed w = addprocs(1)[…

In that thread, the function was not defined on the other worker. Here, using SharedArrays should have defined the necessary structures on all of the workers.

I don’t think so. Here and there it should be @everywhere using SharedArrays

I think you have to create the SharedArray first, and later you can work with it with the different process. It has not sense to try to create the shared vector only in one process. A shared vector is a vector whose values are distributed between several processes, see Parallel Computing · The Juli…

I don’t think so. Here and there it should be @everywhere using SharedArrays My bad. You were right. using loads the package but doesn’t bring it into scope on other workers. I should have checked the docs more thoroughly.

If someone else encounters a similar problem, I should also point out that the alternative to @everywhere using SharedArrays is to use f = @spawnat 2 SharedArrays.SharedVector{Float64}(10)

I may be talking out of turn here. On a large NUMA machine I have lot of experience in using cpusets and corresponding memory sets (768 core SGI UV 1000) These days you would be using cgroups for this. Which then leads to containerisarion. So I think the answer to what you are wanting to accompli…

Do you know of a good guide about using Julia with cgroups?

How to create SharedArrays on other workers

General Usage Performance

oheil January 21, 2020, 1:51pm 3

Check this thread:

Topic		Replies	Views
Memory Usage and SharedArrays Julia at Scale parallel , memory-allocation , distributed	8	1481	December 6, 2019
SharedArray undefined on worker General Usage	7	1744	March 10, 2021
All workers not have access to a sharedarray New to Julia question , parallel , sharedarrays	3	740	November 26, 2020
Difference between SharedArrays and DistributedArrays General Usage question , parallel , multithreading , distributed , sharedarrays	7	3831	February 14, 2022
How to bind an existing SharedArray to new worker process? New to Julia parallel	8	1474	January 17, 2018

How to create SharedArrays on other workers

Related topics