Parallel for loop without reduction

New to Julia
1

I believe I have a problem using a parallel for loop without a reduction operator/function. I tried the following code, hoping to get a pmap-like behaviour:

a = @parallel for i in 1:100
      i^2
end;
a

But this was the result:

1-element Array{Future,1}:
 Future(1,1,3,#NULL)

Also fetch(a) gives me the same thing:

1-element Array{Future,1}:
 Future(1,1,3,#NULL)

And fetch(a[1]) sometimes freezes the Julia session and sometimes returns nothing. Please let me know how to use the parallel for loop in a way that mimics pmap.

Also is there a similar abstraction to this for GPUs, i.e. a GPU for loop? I know ArrayFire in C++ offers a gfor loop, but is there something similar which uses CUDANative.jl?

2

Reduce with (vcat).

Why not just use pmap with a larger batch size?

3

Right, I could. I tried reducing with vcat, it worked, but it was super slow. I could use pmap, but I found this example in the documentation and thought it was often more convenient when programming, so I wondered why it doesn’t work.

I think changing this to a pmap of an anonymous function behind the scenes could make it faster than using vcat, maybe worth modifying the source code of @parallel.

4

Maybe look at @parallel with SharedArray?

a = SharedArray(Int,100);
@parallel for i in 1:100
    a[i] = i^2
end;
a

https://docs.julialang.org/en/stable/manual/parallel-computing/#parallel-map-and-loops

3 Likes