What’s a good pattern for preallocating buffers in a multithreaded setting? I want to avoid allocating new memory whenever I launch a task on a thread. So far I’ve been using the following pattern, which maintains a pool of ids which are used to index into a collection of buffers. In retrospect, …

Depending on the run-time of the computation, I think it’s cleaner to distribute the item in data using a channel: provider = Channel() do provider for x in data put!(provider, x) end end ntasks = Threads.nthreads() # or some other positive integer @sync for _ in 1:ntasks buff…

Pattern for managing thread local storage?

General Usage

tkf May 14, 2021, 10:10pm 5

There are a couple of solutions discussed in Thread safe buffer correctness

Topic		Replies	Views
Thread safe buffer correctness General Usage multithreading	13	2096	May 2, 2021
Task/thread-local caches/buffers Performance question , multithreading , concurrency	12	570	July 9, 2023
Pre-allocate intermediate arrays for multi-threading Performance multithreading	12	238	April 24, 2025
Multithreading, preallocation of objects, threadid() and task migration General Usage multithreading	18	1894	September 6, 2021
Pre-allocated, thread-save buffer arrays General Usage	0	366	March 8, 2021

Pattern for managing thread local storage?

Related topics