What’s a good pattern for preallocating buffers in a multithreaded setting? I want to avoid allocating new memory whenever I launch a task on a thread. So far I’ve been using the following pattern, which maintains a pool of ids which are used to index into a collection of buffers. In retrospect, …

Depending on the run-time of the computation, I think it’s cleaner to distribute the item in data using a channel: provider = Channel() do provider for x in data put!(provider, x) end end ntasks = Threads.nthreads() # or some other positive integer @sync for _ in 1:ntasks buff…

Depending on the run-time of the computation, I think it’s cleaner to distribute the item in data using a channel Also, I’d put buffers directly in the channel for simplicity, if I were to go with the strategy in the OP. Nice approach, I will try this, thanks! For my use case, I’m reading into…

I have had a similar problem where I had most of the CPU kept busy reallocating a large matrix at each function call where it was required. I have opted for a pre-allocated matrix kept in a ‘context’ global structure passed around. However, this clearly goes in the way of, at some future point, mult…

Pattern for managing thread local storage?

General Usage

tkf May 14, 2021, 10:10pm 5

There are a couple of solutions discussed in Thread safe buffer correctness

Topic		Replies	Views
Writing to a shared buffer in multi-threaded for loop Performance multithreading	17	506	June 7, 2026
Thread safe buffer correctness General Usage multithreading	13	2275	May 2, 2021
Task/thread-local caches/buffers Performance question , multithreading , concurrency	12	710	July 9, 2023
Pre-allocate intermediate arrays for multi-threading Performance multithreading	12	332	April 24, 2025
Multithreading, preallocation of objects, threadid() and task migration General Usage multithreading	18	2048	September 6, 2021

Pattern for managing thread local storage?

Related topics