I’d like to import a .tsv file which CSV.read(file, DataFrame) doesn’t like. The error I get is ArgumentError: length argument to Parsers.PosLen (204996615) is too large; max length allowed is 1048575 I found an alternative that should work csv_rows_file = CSV.Rows(file_path) # load file path…

I found a workaround through R, in case someone runs into the same problem: using RCall x = reval("read.delim('/folder/file_path')") df = rcopy(x) gives a dataframe as expected. (substitute “/folder/file_path” with your file’s file location. dont forget the ’ '!)

Issues reading big CSV file despite using CSV.Row

Specific Domains Data

nilshg July 18, 2022, 9:59am 2

This is not a memory issue, but an issue with strings in your file being too long, see:

https://github.com/JuliaData/CSV.jl/issues/1009

Topic		Replies	Views
Errors in Parsers.PosLen loading dataframe from large CSV file (80M rows) New to Julia dataframes , csv , io	7	882	August 2, 2022
CSV.write("*.txt",DataFrame) ReadOnlyMemoryError() General Usage dataframes	14	1070	January 9, 2020
ReadOnlyMemoryError in CSV.read New to Julia csv	12	1380	July 2, 2019
Reading huge csv files Data	5	4100	January 19, 2019
CSV mmap error when parsing large file General Usage package	6	2433	May 25, 2019

Issues reading big CSV file despite using CSV.Row

Related topics