Hello, I’ve a large number of time series as result of my simulations. As today the dataset is made of ~1e7 time series (100 points each), stored on disk in .csv files (each one containing 5 of them). I’ll have more (10x more) in the future and I need to find a good way of exploring the dataset. I…

Storing lots of time series

stevengj Split this topic June 5, 2024, 7:56pm 13

4 posts were split to a new topic: Storge format for lots of strings

Topic		Replies	Views
TimeSeries Database General Usage question , data , time-series , csv , database	8	675	February 21, 2023
Recommendations for larger than memory data General Usage big-data	4	138	May 15, 2025
How to handle and store large amounts of (distributed) generated data? Data	4	1445	April 15, 2017
What software/packages/databases to work with 100GB datasets? Offtopic	12	3526	December 18, 2018
Saving and updating in-memory HDF5 files? Performance hdf5	3	299	April 2, 2024