Need example of processing csv file in chunks

I have big 10+GB files which I need to load and process line by line. I’m trying to use CSV package, but appears this package preload entire file.

Can anyone help or point to example of code which works with big files?

This might help:

If you want to process data row by row, then maybe Rows can be useful? CSV.jl Documentation · CSV.jl

1 Like

Have a look at JuliaDB too.

1 Like