I need to generate a very large matrix (too big for memory), so I’m using memory mapped arrays. I’m trying to benchmark the code and understand some of the variation in run times. Right now, I’m looking at the time it takes to write the files to disk so I’m generating random numbers to test the wri…

Performance of Memory Mapped Arrays (vs. JLD2)

Tamas_Papp October 26, 2018, 5:31am 2

Please include a self-contained MWE.

Topic		Replies	Views
Writing an array too large to store in memory Performance question , jld	2	2188	March 16, 2018
JLD2 seems slow at write operations compared to serialize and HDF5 General Usage data	3	1151	November 20, 2017
Write/read multiple arrays of different types 300+ Million elements each. Brute force .jld seems stupid. Performance	14	740	September 21, 2018
Efficient Disk Usage and JLD General Usage	5	632	April 18, 2018
Performance of writing binary files Performance binaryio , performance , io	2	1280	April 30, 2022