I have big 10+GB files which I need to load and process line by line. I’m trying to use CSV package, but appears this package preload entire file. Can anyone help or point to example of code which works with big files?

Need example of processing csv file in chunks

Skoffer January 4, 2021, 5:29pm 3

If you want to process data row by row, then maybe Rows can be useful? Home · CSV.jl

1 Like

Topic		Replies	Views
Reading huge csv files Data	5	4110	January 19, 2019
How to read big data chunk by chunk(column-wise chunking)? General Usage question	5	2585	June 9, 2019
CSVFiles line by line New to Julia	5	2747	December 29, 2018
How can I split large data using a faster and more efficient function (data science)? New to Julia csv	9	863	October 27, 2022
Partition a large CSV file into smaller files without loading into memory General Usage question , csv , io	6	3725	March 10, 2019