How to activate the current project with Distributed

General Usage
, ,
1

I am trying to activate the current project with Distributed, which fails:

using Distributed

@everywhere begin
  cd("..")
  using Pkg; Pkg.activate(@__DIR__)
  Pkg.instantiate(); Pkg.precompile()
  Pkg.status()
end

Output:

julia> include("src/dist.jl")
  Activating project at `~/repos/WindTurbines/src`
      From worker 7:      Activating project at `~/repos/WindTurbines/src`

It tries to find Project.toml in the folder src, but it is in the base folder.

How can I fix that?

2

If your source file is src/dist.jl, then within it @__DIR__ == "/path/to/project/src". So you have to go up one directory to retrieve the top-level project directory:

@everywhere begin
    import Pkg
    Pkg.activate(joinpath(@__DIR__, ".."))
end

If your julia depot is on a shared filesystem, I would also recommend to take the appropriate steps for the project to be compiled on one node beforehand, so that when starting the distributed computations everything is already done. Last time I checked, problems could arise if several processes attempted to precompile the same set of packages at the same time.

1 Like