What’s a good pattern for preallocating buffers in a multithreaded setting? I want to avoid allocating new memory whenever I launch a task on a thread. So far I’ve been using the following pattern, which maintains a pool of ids which are used to index into a collection of buffers. In retrospect, …

Depending on the run-time of the computation, I think it’s cleaner to distribute the item in data using a channel: provider = Channel() do provider for x in data put!(provider, x) end end ntasks = Threads.nthreads() # or some other positive integer @sync for _ in 1:ntasks buff…

Depending on the run-time of the computation, I think it’s cleaner to distribute the item in data using a channel Also, I’d put buffers directly in the channel for simplicity, if I were to go with the strategy in the OP. Nice approach, I will try this, thanks! For my use case, I’m reading into…

I have had a similar problem where I had most of the CPU kept busy reallocating a large matrix at each function call where it was required. I have opted for a pre-allocated matrix kept in a ‘context’ global structure passed around. However, this clearly goes in the way of, at some future point, mult…

Pattern for managing thread local storage?

General Usage

tkf May 14, 2021, 10:10pm 5

There are a couple of solutions discussed in Thread safe buffer correctness

Topic		Replies	Views
Thread safe buffer correctness General Usage multithreading	13	2238	May 2, 2021
Task/thread-local caches/buffers Performance question , multithreading , concurrency	12	692	July 9, 2023
Pre-allocate intermediate arrays for multi-threading Performance multithreading	12	323	April 24, 2025
Multithreading, preallocation of objects, threadid() and task migration General Usage multithreading	18	2027	September 6, 2021
Pre-allocated, thread-save buffer arrays General Usage	0	381	March 8, 2021

Pattern for managing thread local storage?

Related topics