Multithreaded broadcast?

Elrod · May 6, 2021, 2:43am

github.com/JuliaSIMD/ThreadingUtilities.jl

Does not play nicely with `Threads.@spawn` or `Threads.@threads`

opened 02:43AM - 06 May 21 UTC

Two problems: 1. Possible race conditions. @tkf suggested a good fix here, whic…h is to have a "job started" stated. Then, if the job hasn't started, `ThreadingUtilitilies.wait` can steal the task back (note that the overhead on this will be much higher than that of a proper work stealing implementation, which would use jumps). 2. ThreadingUtilities' tasks currently still spend some time before going to sleep. This gets in the way of `Threads.@spawn` and `Threads.@threads`, causing bad performance. It'd be great if there were something they could check to go to sleep immediately if someone used `Thread.@spawn` or `Threads.@threads`.

Topic		Replies	Views
Multithreading broadcasted array ops General Usage	4	164	March 13, 2025
Multithreading broadcast/map calls Performance multithreading	7	717	April 30, 2023
Threads/Parallel New to Julia	22	8864	October 24, 2017
Threads question Performance threads	4	898	March 20, 2023
What is the “standard” way to use multi-threading with dot-calls (vectorized/broadcast)? General Usage multithreading	5	593	April 26, 2024

Multithreaded broadcast?

Related topics