# \[ANN\] JDF.jl - Experimental Julia DataFrames serialization format

**URL:** <https://discourse.julialang.org/t/ann-jdf-jl-experimental-julia-dataframes-serialization-format/29067>\
**Category:** Package Announcements\
**Created:** [September 23, 2019, 11:06am UTC](https://discourse.julialang.org/t/ann-jdf-jl-experimental-julia-dataframes-serialization-format/29067 "2019-09-23T11:06:49Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![tbenst](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tbenst/32/3029_2.png) [@tbenst](https://discourse.julialang.org/u/tbenst)\
**Post date:** [January 19, 2020, 9:13pm UTC](https://discourse.julialang.org/t/ann-jdf-jl-experimental-julia-dataframes-serialization-format/29067/4 "2020-01-19T21:13:11Z")

</div>

Thanks for sharing this! Found from google while looking for the equivalent of [`pandas.DataFrame.to_hdf`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.DataFrame.to_hdf.html), [`pandas.read_hdf`](https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.read_hdf.html), [`xarray.Dataset.to_netcdf`](http://xarray.pydata.org/en/stable/io.html), etc in Julia. It would be nice to have interop compatibility with other languages via HDF5, which seems to be a fairly standard way to serialize tables. As a bonus, makes it easy to do chunking & `blosc:zstd` compression, which is necessary for serializing large data structures.

Seems there’s an issue for this already: [Opening Pytables/Pandas file · Issue #92 · JuliaIO/HDF5.jl · GitHub](https://github.com/JuliaIO/HDF5.jl/issues/92).

Python and R already have decent DataFrame interop. It’d be great to be able to have interop with Julia, too!

edit: just read more about Parquet, looks like good interop across R, Python & Julia. But sounds like writing from Julia is [still a bit painful](https://discourse.julialang.org/t/writing-parquet-files/11221). It looks like Arrow (backend for Feather) 1.0.0 is just around the corner, though! [Introducing Apache Arrow Flight: A Framework for Fast Data Transport | Apache Arrow](https://arrow.apache.org/blog/2019/10/13/introducing-arrow-flight/) and stability guarantees here: [arrow/Versioning.rst at master · apache/arrow · GitHub](https://github.com/apache/arrow/blob/master/docs/source/format/Versioning.rst)

---

_[View the full topic](https://discourse.julialang.org/t/ann-jdf-jl-experimental-julia-dataframes-serialization-format/29067)._