Runnable code and benchmark at this gist . This is a widespread pattern for columnar-storage access, usually each column is too large to fit in ram, so it’s chunked in to clusters, and each cluster is individually compressed on disk. When user getindex(col, idx), you first need to find the cluster,…

How to correctly design multi-thread cache that's transparent to user iteration?

Mason May 30, 2023, 9:07pm 5

Could you elaborate on this? I don’t understand what you mean.

Topic		Replies	Views
Task/thread-local caches/buffers Performance question , multithreading , concurrency	12	680	July 9, 2023
Multithreading with seperate caches for each thread? General Usage	7	233	June 30, 2024
Multithreading with shared memory caches Performance question , performance , multithreading	27	2107	June 13, 2023
No more threadid indexing? [thread-local storage] Performance multithreading , threads	36	1312	August 15, 2025
How to use many (non-sticky) tasks while maximizing local storage reuse? General Usage multithreading , task_local_storage	9	966	August 1, 2023