Repartitioning 2TB of csv into parquets

[johnh]

Would DatFramesDBs be of any help?

[ANN] DataFrameDBs.jl

Hi all! Julia is my hobby and I had some free time for the last 4 weeks, so here is the first results of my experiments GitHub - waralex/DataFrameDBs.jl: The DateFrameDBs is the prototype of persistent, space efficient columnar database on pure Julia It is the prototype of columnar, persistent, type stable and space efficient database in pure Julia. Some examples on this dataset imported to DataFrameDBs julia> using DataFrameDBs julia> t = open_table("ecommerce") DFTable path: ecommerce 10×6…

GitHub - waralex/DataFrameDBs.jl: The DateFrameDBs is the prototype of...