I need to generate a very large matrix (too big for memory), so I’m using memory mapped arrays. I’m trying to benchmark the code and understand some of the variation in run times. Right now, I’m looking at the time it takes to write the files to disk so I’m generating random numbers to test the wri…

Performance of Memory Mapped Arrays (vs. JLD2)

Tamas_Papp October 26, 2018, 5:31am 2

Please include a self-contained MWE.

Topic		Replies	Views
Writing an array too large to store in memory Performance question , jld	2	2221	March 16, 2018
JLD2 seems slow at write operations compared to serialize and HDF5 General Usage data	3	1181	November 20, 2017
Use of Memory-mapped I/O General Usage memory , memory-allocation	9	2964	September 5, 2019
Write to the file the structure of the form (key => value) followed by reading using Mmap.mmap General Usage mmap	12	902	December 16, 2018
Loading/writing a single element from an array in JLD Data jld	3	1885	December 3, 2017