# Julia data storage

**URL:** https://discourse.julialang.org/t/julia-data-storage/44283
**Category:** New to Julia
**Tags:** question
**Created:** [August 4, 2020, 7:52pm UTC](https://discourse.julialang.org/t/julia-data-storage/44283 "2020-08-04T19:52:45Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![andrey2185](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/andrey2185/32/9889_2.png) [@andrey2185](https://discourse.julialang.org/u/andrey2185)
#### Post date: [August 4, 2020, 7:52pm UTC](https://discourse.julialang.org/t/julia-data-storage/44283/1 "2020-08-04T19:52:45Z")

</div>

Hello,  
Please advise a reliable, stable and simple package for long-term data storage in a universal cross-platform format?

it is desirable to support dataframe

---

<div class="post-metadata">

### Author: ![lungben](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/lungben/32/12314_2.png) [@lungben](https://discourse.julialang.org/u/lungben)
#### Post date: [August 4, 2020, 8:45pm UTC](https://discourse.julialang.org/t/julia-data-storage/44283/2 "2020-08-04T20:45:31Z")

</div>

Probably CSV is the best option for your requirements.  
You can read/ write them efficiently with the CSV.jl package.

---

<div class="post-metadata">

### Author: ![xiaodai](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/xiaodai/32/15937_2.png) [@xiaodai](https://discourse.julialang.org/u/xiaodai)
#### Post date: [August 4, 2020, 11:48pm UTC](https://discourse.julialang.org/t/julia-data-storage/44283/3 "2020-08-04T23:48:13Z")

</div>

Reliable - CSV, Parquet, Serialization, JDF  
Stable - CSV, Parquet,  
Simple - CSV, Parquet, JDF  
Long term - CSV, Parquet  
Universal Cross platform - you mean OS or langauge? CSV, Parquet

[JDF.jl](https://github.com/xiaodaigh/JDF.jl) is what I would use in the Julia ecosystem and given the recent interest. I will try to update it soon. I see a way forward for it to multi-language too.

---

<div class="post-metadata">

### Author: ![andrey2185](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/andrey2185/32/9889_2.png) [@andrey2185](https://discourse.julialang.org/u/andrey2185)
#### Post date: [August 5, 2020, 7:44am UTC](https://discourse.julialang.org/t/julia-data-storage/44283/4 "2020-08-05T07:44:06Z")

</div>

Thank you!  
So can you tell me why JDF reads so fast compared to boxed serialization? ))

---

<div class="post-metadata">

### Author: ![xiaodai](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/xiaodai/32/15937_2.png) [@xiaodai](https://discourse.julialang.org/u/xiaodai)
#### Post date: [August 5, 2020, 8:01am UTC](https://discourse.julialang.org/t/julia-data-storage/44283/5 "2020-08-05T08:01:44Z")

</div>

Compression.

Most of the time in reading a file is taken up by reading from hard drive . As the hard drive (even ssd) are slow compared to RAM. So if you compress the data so you read less from hard drive, and trade it off with decompression time on CPU. Overal it is still faster.

---

<div class="post-metadata">

### Author: ![xiaodai](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/xiaodai/32/15937_2.png) [@xiaodai](https://discourse.julialang.org/u/xiaodai)
#### Post date: [August 5, 2020, 8:10am UTC](https://discourse.julialang.org/t/julia-data-storage/44283/6 "2020-08-05T08:10:21Z")

</div>

@andrey2185 [https://github.com/xiaodaigh/JDF.jl/issues](https://github.com/xiaodaigh/JDF.jl/issues)

If you like you can write down the key features you want in such a format so I can note it down. I am close to getting more done for JDF.
