Storing lots of time series

alemelis
Tue, 04 Jun 2024 13:28:20 +0000
Data

Hello,
I’ve a large number of time series as result of my simulations.

As today the dataset is made of ~1e7 time series (100 points each), stored on disk in .csv files (each one containing 5 of them). I’ll have more (10x more) in the future and I need to find a good way of exploring the dataset.

I am thinking of a SQL database (like timescale) but I wonder if that would be overkill for my use case.

Any recommendation along these lines?

14 posts - 8 participants