Set a function on master and send it to all workers

#1

Hello,
I would like to construct an interpolation function from a very large dataset in a serialized way(master worker) and then send it to all workers for parallel computing.

I tried sendto(workers(),interp_function=interp_function) from ParallelDataTransfer.jl, but I got issues similar to https://github.com/ChrisRackauckas/ParallelDataTransfer.jl/issues/16.

Is there another function I can use?

Thank you for your help,

0 Likes

#2

Here’s an old but related question on StackOverflow: https://stackoverflow.com/questions/30730507/julia-parallel-programming-making-existing-function-available-to-all-workers/38146308#38146308

Maybe there’s a more recent answer, along using Threads (https://docs.julialang.org/en/v1/manual/parallel-computing/index.html#Multi-Threading-(Experimental)-1) that share their memory

0 Likes