The following suboptimal behavior of the parallel map has been observed: 53.927 s (82132566 allocations: 2.81 GiB) 2.011 s (8000041 allocations: 167.85 MiB) 18.922 ms (2 allocations: 7.63 MiB) 20.058 ms (3 allocations: 7.63 MiB) The above was obtained with N = 1_000_000 a = rand(N) + rand…

pmap is using interprocess communication 1 million times to execute the function. That’s a lot of overhead relative to a vectorized function call. Why would you expect it to be as fast? It’s intended to be used for executing functions with non-trivial run-time. I suppose pmap could be designed t…

Weird behavior of pmap

General Usage

robsmith11 July 2, 2019, 8:15pm 5

Yeah pmap is lower level than that. Maybe check out something like
https://github.com/JuliaParallel/Blocks.jl

1 Like

Topic		Replies	Views
Struggling with pmap New to Julia parallel	8	1034	September 5, 2019
Why is the parallel map so slow? General Usage parallel , optimization , pmap	2	3259	May 10, 2020
Is this parallel performance correct? General Usage performance , parallel	1	770	June 20, 2017
unexpected pmap behaviour New to Julia performance , parallel , regex	0	483	March 4, 2019
Pmap usage Performance question , parallel	1	375	December 13, 2020

Weird behavior of pmap

Related topics