Julia environments with multiple workers

General Usage
1

How is the instantiation of an environment handled in multiple-worker settings? Should I run

using Distributed
@everywhere begin
	using Pkg
	Pkg.activate(".")
end

? I do seem to get some warning messages about access to caches during pre-compilation and such. Should then the activation of the environment be performed only on the process 1?

1 Like
2

Bump. Any parallel-computing experts still up?

3

The best discussion I am aware of is Packages and workers - #9 by teored90, which links to this issue: Workers should inherit Pkg environment · Issue #28781 · JuliaLang/julia · GitHub. As far as I am aware, Pkg/code-loading does not provide any mechanisms to further streamline the process.

1 Like
4

Great find, thanks a million!