Runnable code and benchmark at this gist . This is a widespread pattern for columnar-storage access, usually each column is too large to fit in ram, so it’s chunked in to clusters, and each cluster is individually compressed on disk. When user getindex(col, idx), you first need to find the cluster…

How to correctly design multi-thread cache that's transparent to user iteration?

Mason May 30, 2023, 9:07pm 5

Could you elaborate on this? I don’t understand what you mean.

Topic		Replies	Views
Task/thread-local caches/buffers Performance question , multithreading , concurrency	12	626	July 9, 2023
Multithreading with shared memory caches Performance question , performance , multithreading	27	2010	June 13, 2023
Support `@threads` for a lazy object Performance question	0	260	July 11, 2021
Multi-threading doesn't seem to scale well on this counting problem Performance multithreading	15	2180	January 14, 2018
Data structures for threaded computing Performance	23	2922	October 23, 2019