# Load modules in several workers

**URL:** <https://discourse.julialang.org/t/load-modules-in-several-workers/17521>\
**Category:** General Usage\
**Created:** [November 14, 2018, 4:19pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521 "2018-11-14T16:19:13Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ferran\_Mazzanti](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ferran_mazzanti/32/7458_2.png) [@Ferran\_Mazzanti](https://discourse.julialang.org/u/Ferran_Mazzanti)\
**Post date:** [November 14, 2018, 4:19pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/1 "2018-11-14T16:19:13Z")

</div>

Hi folks,  
I’m just running into (another) problem, this time related to loading modules in several workers at the same time.  
I have this simple module

```julia
module My_mod

export My_Type, f

mutable struct My_type
	x::Int
end

f(x) = x^2 + 1

println("Loaded !!")

end

```

which I want to load in several workers.

In julia 0.6.4 I could simply do the following

```julia
addprocs(3)
@everywhere using My_mod

```

and the whole module was loaded in all workers. Now in julia 1.0.2 I try

```julia
using Distributed
addprocs(3)
@everywhere using My_mod

```

I get the message

```julia
Loaded !!

On worker 2:
ArgumentError: Package My_mod not found in current path:
- Run `import Pkg; Pkg.add("My_mod")` to install the My_mod package.

require at ./loading.jl:823
eval at ./boot.jl:319
#116 at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/process_messages.jl:276
run_work_thunk at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/process_messages.jl:56
run_work_thunk at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/process_messages.jl:65
#102 at ./task.jl:259
#remotecall_wait#154(::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}, ::Function, ::Function, ::Distributed.Worker, ::Module, ::Vararg{Any,N} where N) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/remotecall.jl:421
remotecall_wait(::Function, ::Distributed.Worker, ::Module, ::Vararg{Any,N} where N) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/remotecall.jl:412
#remotecall_wait#157(::Base.Iterators.Pairs{Union{},Union{},Tuple{},NamedTuple{(),Tuple{}}}, ::Function, ::Function, ::Int64, ::Module, ::Vararg{Any,N} where N) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/remotecall.jl:433
remotecall_wait(::Function, ::Int64, ::Module, ::Vararg{Any,N} where N) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/remotecall.jl:433
(::getfield(Distributed, Symbol("##163#165")){Module,Expr})() at ./task.jl:259

...and 3 more exception(s).

Stacktrace:
 [1] sync_end(::Array{Any,1}) at ./task.jl:226
 [2] remotecall_eval(::Module, ::Array{Int64,1}, ::Expr) at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/macros.jl:207
 [3] top-level scope at /buildworker/worker/package_linux64/build/usr/share/julia/stdlib/v1.0/Distributed/src/macros.jl:190
 [4] top-level scope at In[5]:1

```

and,as you can see, it fails to load already in worker 2.  
Now the message says I must do import Pkg etc… which does not seem to be the right thing here, as I do not want to install any package but to load a module.  
I’m sure I’m probably misunderstanding something, so I could use a bit of help and get the correct way to load my (personal) modules into several workers at once…

Thx in advance,

Ferran.

---

<div class="post-metadata">

**Author:** ![adamslc](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/adamslc/32/3452_2.png) [@adamslc](https://discourse.julialang.org/u/adamslc)\
**Post date:** [November 14, 2018, 4:42pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/2 "2018-11-14T16:42:27Z")

</div>

A bit more detail would help. In particular, how are you loading `My_mod`? Also see [this comment](https://discourse.julialang.org/t/how-to-import-json-when-using-parallel-mode/17513/3).

---

<div class="post-metadata">

**Author:** ![Ferran\_Mazzanti](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ferran_mazzanti/32/7458_2.png) [@Ferran\_Mazzanti](https://discourse.julialang.org/u/Ferran_Mazzanti)\
**Post date:** [November 14, 2018, 4:57pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/3 "2018-11-14T16:57:16Z")

</div>

Uh… I don’t know what else to say ☹ I just wrote the whole code, which is just a test to check if functions and modules get loaded in every workout as it did doing exactly and only that in Julia 0.6.4  
…but now it seems to fail.  
So the question is: I have this module which I want to load in all workers I define: how shall I do that?

---

<div class="post-metadata">

**Author:** ![adamslc](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/adamslc/32/3452_2.png) [@adamslc](https://discourse.julialang.org/u/adamslc)\
**Post date:** [November 14, 2018, 5:01pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/4 "2018-11-14T17:01:06Z")

</div>

Is the module saved in its own file? Did you write it at the `repl`? Is there an associated `Project.toml` file?

---

<div class="post-metadata">

**Author:** ![Ferran\_Mazzanti](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ferran_mazzanti/32/7458_2.png) [@Ferran\_Mazzanti](https://discourse.julialang.org/u/Ferran_Mazzanti)\
**Post date:** [November 14, 2018, 5:14pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/5 "2018-11-14T17:14:20Z")

</div>

Ah, now I understand your question, thanks. Yes the module is stored in its own file My\_mod.jl, which is in the LUBRARY\_PATH directory… You see the first worker finds and loads it, the rest doesn’t

---

<div class="post-metadata">

**Author:** ![Ferran\_Mazzanti](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ferran_mazzanti/32/7458_2.png) [@Ferran\_Mazzanti](https://discourse.julialang.org/u/Ferran_Mazzanti)\
**Post date:** [November 14, 2018, 5:33pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/6 "2018-11-14T17:33:55Z")

</div>

…and I work in IJuoyter, and there is no project.toml thing. Actually and when everything is in place, I will move the code to a script .JL file that loads the module in its separate file.  
I have been doing that in 0.6.4 without problems.

---

<div class="post-metadata">

**Author:** ![adamslc](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/adamslc/32/3452_2.png) [@adamslc](https://discourse.julialang.org/u/adamslc)\
**Post date:** [November 14, 2018, 6:01pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/7 "2018-11-14T18:01:22Z")

</div>

I don’t have any experience with Jupyter notebook, but the first thing I would try is to `@everywhere include("My_mod.jl")`, and see if that helps.

---

<div class="post-metadata">

**Author:** ![Ferran\_Mazzanti](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ferran_mazzanti/32/7458_2.png) [@Ferran\_Mazzanti](https://discourse.julialang.org/u/Ferran_Mazzanti)\
**Post date:** [November 14, 2018, 6:10pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/8 "2018-11-14T18:10:13Z")

</div>

Aha! That seems to do the trck, thanks… Now when I do the

```julia
@everywhere include("My_mod.jl")

```

it spits

```julia
Loaded !!
      From worker 3:	Loaded !!
      From worker 4:	Loaded !!
      From worker 2:	Loaded !!

```

which I guess means we succeeded 🙂

Now I’m safe, but keep wondering why the

```julia
@everywhere using My_mod

```

has changed to

```julia
@everywhere include("My_mod.jl")

```

but I guess I can live with the change 🙂

Thanks for your help,

Ferran.

---

<div class="post-metadata">

**Author:** ![Christopher\_Fisher](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/christopher_fisher/32/26132_2.png) [@Christopher\_Fisher](https://discourse.julialang.org/u/Christopher_Fisher)\
**Post date:** [November 14, 2018, 6:14pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/9 "2018-11-14T18:14:31Z")

</div>

Here is how I load my modules on other workers

```julia
using Distributed
addprocs(4)
#mypath is the path the module file
@everywhere push!(LOAD_PATH,$mypath)
@everywhere using myModule

```

---

<div class="post-metadata">

**Author:** ![Ferran\_Mazzanti](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ferran_mazzanti/32/7458_2.png) [@Ferran\_Mazzanti](https://discourse.julialang.org/u/Ferran_Mazzanti)\
**Post date:** [November 14, 2018, 7:43pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/10 "2018-11-14T19:43:26Z")

</div>

Ah! now I see what happens! It is just the @everywhere in front of

```julia
@everywhere push!(LOAD_PATH,$mypath)

```

that makes the trick. That was not needed before in 0.6.4, but now I see that things only work in later releases if you tell every worker of the LOAD\_PATH variable.  
Thanks a lot to you also, Christopher 🙂

---

<div class="post-metadata">

**Author:** ![lcosta](https://avatars.discourse-cdn.com/v4/letter/l/eb8c5e/32.png) [@lcosta](https://discourse.julialang.org/u/lcosta)\
**Post date:** [November 14, 2018, 9:11pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/11 "2018-11-14T21:11:47Z")

</div>

Has anyone had the same issue with packages? I cannot get them to load on workers. As an example, the following script returns a file not found in current path error when it hits the @everywhere commands:

```julia
using Distributed
using SharedArrays
using Interpolations
addprocs(2)

@everywhere using Interpolations
@everywhere using SharedArrays

vector1 = collect(range(1.0,stop=200.0,length=20))
vector2 = collect(range(100.0,stop=2000.0,length=20))
test = SharedArray{Float64,1}((20))

@distributed for i=1:20
    interp_linear = LinearInterpolation((vector1),vector2, extrapolation_bc = -1e6)
    test[i] = interp_linear(2 .* i)
end

```

If I modify the script as below to activate packages on the workers, it will run but it doesn’t actually interpolate anything (the vector “test” remains all zeroes; if I delete the @distributed before the for loop, it interpolates correctly). Note that if I include the commented out lines, it returns the same error described above.

```julia
using Distributed
using SharedArrays
using Interpolations
addprocs(2)

@everywhere using Pkg
@everywhere Pkg.activate("Interpolations")
@everywhere Pkg.activate("SharedArrays")
#@everywhere using Interpolations
#@everywhere using SharedArrays

vector1 = collect(range(1.0,stop=200.0,length=20))
vector2 = collect(range(100.0,stop=2000.0,length=20))
test = SharedArray{Float64,1}((20))

@distributed for i=1:20
    interp_linear = LinearInterpolation((vector1),vector2, extrapolation_bc = -1e6)
    test[i] = interp_linear(2 .* i)
end

```

Finally, I can get distributed for loops to run so long as they do not need any packages (unfortunately this makes them pretty useless). Thanks for any ideas.

---

<div class="post-metadata">

**Author:** ![greg\_plowman](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/greg_plowman/32/8100_2.png) [@greg\_plowman](https://discourse.julialang.org/u/greg_plowman)\
**Post date:** [November 14, 2018, 10:26pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/12 "2018-11-14T22:26:29Z")

</div>

This works for me (note the order):

```julia
using Distributed
addprocs(2)
@everywhere using SharedArrays
@everywhere using Interpolations
...

```

.

> [@lcosta](#):
>
> the vector “test” remains all zeroes

Are you waiting long enough for the result?

`@distributed` (without a reduction operator) runs asynchronously and returns immediately.  
You can see the return value at the REPL (something like `Task (queued) @0x00000000069559f0`)

You can wait by calling `fetch` on the task, or by wrapping the loop with `@sync` :

```julia
@sync @distributed for i=1:20
    interp_linear = LinearInterpolation((vector1),vector2, extrapolation_bc = -1e6)
    test[i] = interp_linear(2 .* i)
end

```

See the manual: [Parallel Computing · The Julia Language](https://docs.julialang.org/en/v1/manual/parallel-computing/#Parallel-Map-and-Loops-1)

---

<div class="post-metadata">

**Author:** ![lcosta](https://avatars.discourse-cdn.com/v4/letter/l/eb8c5e/32.png) [@lcosta](https://discourse.julialang.org/u/lcosta)\
**Post date:** [November 15, 2018, 3:34am UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/13 "2018-11-15T03:34:42Z")

</div>

Thanks but unfortunately it looks like that exact order still gives me the same error as when I had the using commands both before and after addprocs. Running…

```julia
using Distributed

addprocs(2)

@everywhere using Interpolations
@everywhere using SharedArrays

```

… I get the following error for the Interpolations package (running for SharedArrays just before Interpolations as in your note has the same behavior):

```julia
ERROR: LoadError: On worker 2:
ArgumentError: Package Interpolations not found in current path:
- Run `import Pkg; Pkg.add("Interpolations")` to install the Interpolations package.

```

As for the second point, I was waiting for the script to finish. I’m not sure why going the Pkg.activate route isn’t throwing an error but it doesn’t seem to be activating anything on the workers.

---

<div class="post-metadata">

**Author:** ![natk](https://avatars.discourse-cdn.com/v4/letter/n/46a35a/32.png) [@natk](https://discourse.julialang.org/u/natk)\
**Post date:** [June 12, 2019, 11:55pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/14 "2019-06-12T23:55:22Z")

</div>

Hi, were you able to resolve the issue in the end? I’m running into the same issue, but couldn’t find anywhere a solution to this… Thanks

---

<div class="post-metadata">

**Author:** ![lcosta](https://avatars.discourse-cdn.com/v4/letter/l/eb8c5e/32.png) [@lcosta](https://discourse.julialang.org/u/lcosta)\
**Post date:** [June 13, 2019, 12:39am UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/15 "2019-06-13T00:39:11Z")

</div>

No I wasn’t sadly. It looks to me like it’s just a bug in Julia so I don’t know how to get around it. I switched back to MATLAB with C-MEX.

---

<div class="post-metadata">

**Author:** ![bernhard](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/bernhard/32/2619_2.png) [@bernhard](https://discourse.julialang.org/u/bernhard)\
**Post date:** [June 13, 2019, 4:53am UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/16 "2019-06-13T04:53:37Z")

</div>

Well, this might be because of the location of the environment.  
Have you tried something along

EDIT: Actually depending on your setup it might not be pwd() that you need to activate, but some other environment (maybe “C:\users\myname\.julia\environments\v1.0”)

```julia
current_dir=pwd()
@everywhere current_dir=$current_dir
@everywhere import Pkg
@everywhere Pkg.activate(current_dir)
@everywhere using Interpolations

```

---

<div class="post-metadata">

**Author:** ![greg\_plowman](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/greg_plowman/32/8100_2.png) [@greg\_plowman](https://discourse.julialang.org/u/greg_plowman)\
**Post date:** [June 13, 2019, 9:15am UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/17 "2019-06-13T09:15:48Z")

</div>

Perhaps compare the output of `load_path()` on master vs worker processes (maybe there’s a path missing from the worker process).

This works for me on Windows, Julia v1.1.1 with a fresh REPL.

```julia
julia> using Distributed

julia> addprocs(2)
2-element Array{Int64,1}:
 2
 3

julia> @everywhere using SharedArrays

julia> @everywhere using Interpolations

julia> Base.load_path()
2-element Array{String,1}:
 "C:\\Users\\Greg\\.julia\\environments\\v1.1\\Project.toml"
 "C:\\Program Files\\Julia-1.1.1\\share\\julia\\stdlib\\v1.1"

julia> remotecall_fetch(Base.load_path, 2)
2-element Array{String,1}:
 "C:\\Users\\Greg\\.julia\\environments\\v1.1\\Project.toml"
 "C:\\Program Files\\Julia-1.1.1\\share\\julia\\stdlib\\v1.1"

```

---

<div class="post-metadata">

**Author:** ![natk](https://avatars.discourse-cdn.com/v4/letter/n/46a35a/32.png) [@natk](https://discourse.julialang.org/u/natk)\
**Post date:** [June 14, 2019, 12:24am UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/18 "2019-06-14T00:24:30Z")

</div>

The output of load\_path is different in my case. I also tried with Julia v1.1.1, the same issue arises. How should I fix this?

```julia
julia> Base.load_path()
2-element Array{String,1}:
 "/Users/nk/.juliapro/JuliaPro_v1.0.4.1/environments/v1.0/Project.toml"                                        
 "/Applications/JuliaPro-1.0.4.1.app/Contents/Resources/julia/Contents/Resources/julia/share/julia/stdlib/v1.0"

julia> remotecall_fetch(Base.load_path, 2)
2-element Array{String,1}:
 "/Users/nk/.julia/environments/v1.0/Project.toml"                                                            
 "/Applications/JuliaPro-1.0.4.1.app/Contents/Resources/julia/Contents/Resources/julia/share/julia/stdlib/v1.0"

```

I tried adding the missing path to worker processes by running `dir=Base.load_path() @everywhere push!(LOAD_PATH,$dir[1])`. But I’m still getting the same error message…

```julia
LoadError: On worker 2:
ArgumentError: Package Interpolations [a98d9a8b-a2ab-59e6-89dd-64a1c18fca59] is required but does not seem to be installed:

```

---

<div class="post-metadata">

**Author:** ![greg\_plowman](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/greg_plowman/32/8100_2.png) [@greg\_plowman](https://discourse.julialang.org/u/greg_plowman)\
**Post date:** [June 14, 2019, 2:49am UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/19 "2019-06-14T02:49:58Z")

</div>

Do you have both standard Julia and JuliaPro installed?

Similar problems have been reported before:

- [JuliaDB with Parallel Procs Not Working in JuliaPro - #22 by dburch](https://discourse.julialang.org/t/juliadb-with-parallel-procs-not-working-in-juliapro/24892/22)
- [Bug? JuliaPro Distributed Procs](https://discourse.julialang.org/t/bug-juliapro-distributed-procs/24964)
- [Julia 1.0.2 after installed JuliaPro 1.0.2.1](https://discourse.julialang.org/t/julia-1-0-2-after-installed-juliapro-1-0-2-1/18210)
- [Workers do not find packages in spite of @everywhere and Pkg.activate commands](https://discourse.julialang.org/t/workers-do-not-find-packages-in-spite-of-everywhere-and-pkg-activate-commands/23441)

Clean installs seem to have resolved the issues.

---

<div class="post-metadata">

**Author:** ![squirrel](https://avatars.discourse-cdn.com/v4/letter/s/96bed5/32.png) [@squirrel](https://discourse.julialang.org/u/squirrel)\
**Post date:** [January 27, 2020, 7:47pm UTC](https://discourse.julialang.org/t/load-modules-in-several-workers/17521/20 "2020-01-27T19:47:02Z")

</div>

I did at some point have both Julia and JuliaPro installed. I uninstalled them both and reinstalled JuliaPro 1.2 after I encountered some other issues.

I’m still getting these issues even though I thought I did have a “clean install.” I even tried uninstalling everything again and deleting all the odd files I could find. How do I get a “clean install” when it looks like everything was uninstalled?