CSV.jl "corrupts" data when a field is very large

[TimG]

Here’s another possible option:

@aplavin

For a CSV reader/writer robust in edgecases like that, you may try duckdb – convenient to use from Julia though QuackIO.jl.

Also, have you tried using CSV with ntasks=1. Multi-threading in CSV sometimes has some issues (e.g. with a \n character in a quoted string) and working single threaded can avoid these.