What’s the difference between CSV.jl and CSVFiles.jl? When should I use each of them? [image] GitHub - queryverse/CSVFiles.jl: FileIO.jl integration for CSV files FileIO.jl integration for CSV files. Contribute to queryverse/CSVFiles.jl development by creating an account on GitHub. …

I did some benchmarks and CSVFiles is an order of magnitude more resource intensive than CSV, and twice as slow even on a second run, i.e. after being compiled. I’m lumping Queryverse in with the Julia Computing “products” as “considered harmful” packages that should be taken out of the registry.

Your notion of what role Julia Computing plays in the Julia ecosystem seems like it may be misguided. This blog post may help clarify: The Julia Project and Its Entities The Julia Project and Its Entities | There are a number of entities surrounding the Julia programming language. Unde…

It is pretty well-established now that CSV.jl is the best CSV reader in Julia. For Queryverse, I know I wouldn’t use Query.jl because it has poor group_by performance.

[image] FredC: I’m lumping Queryverse in with … packages that should be taken out of the registry. No need to be rude. Just because something doesn’t work for your use-case doesn’t mean it is some kind of antipattern. Queryverse doesn’t fit my workflow, but I know many others find it usefu…

I apologize. While I’m not a fan of what I’ve used from Queryverse, it hasn’t been the kind of time-burning bait-and-switch I’ve experienced with the Julia Computing packages. I’m absolutely baffled at the way things like JuliaDB are being recommended and marketed despite being severely broken. The…

[image] Juan: binary large binary files? Have u tried JDF.jl?

[image] FredC: CSVFiles is an order of magnitude more resource intensive than CSV What resources are you referring to? Main memory, or something else? What OS are you on?

[image] FredC: I’m absolutely baffled at the way things like JuliaDB are being recommended and marketed despite being severely broken. If you’re talking about JuliaDB in particular, then the main developer started a PhD and left the project. The other main contributors also contribute a lot t…

What alternative do we have instead of JuliaDB?

What alternative do we have instead of JuliaDB? So so many. Dending what you want I think there are like over a dozen packages that support the Tables.jl interface. Though many are specific purpose, like for various file loading, e.g. Feather.jl, CSV.jl etc Some are for databases, like SQLLit…

What's the difference between CSV.jl and CSVFiles.jl?

New to Julia

simonbyrne Split this topic October 28, 2019, 5:16pm 19

9 posts were split to a new topic: Why do you use JuliaDB?

Topic		Replies	Views
CSV Reading (rewrite in C?) Internals & Design	50	5400	October 1, 2018
My experiences reading CSVs from the Fannie Mae datasets Data performance , csv	62	6507	August 26, 2019
[ANN] TableReader.jl - A fast and simple CSV parser Package Announcements package , announcement , data , csv	24	6061	March 28, 2019
Alternative to DataFrame Readtable to read large data files with headers Data	17	4140	November 12, 2018
CSV.read extremely slow wrt readtable Data	14	3711	July 27, 2018

What's the difference between CSV.jl and CSVFiles.jl?

Related topics