Hi, I would like to read a portion of a lot of big files, as I know that the lines that interest me are located within line x and line y Currently, I load the files with CSV.File and read parts, but the loading overhead is way too much. The same process in shell (with sed/grep…) takes 27 minutes,…

Reading a file from line x to line y

rafael.guerra May 17, 2024, 10:58am 6

Please check also this thread.

Topic		Replies	Views
Skipping a lot of lines in CSV.read() allocates too much memory Performance csv , io	77	2149	February 23, 2024
How to subset a stream I/O and pass it to TensorFlow.jl? (question has been updated) Data question	61	4385	May 6, 2017
CSV Reading (rewrite in C?) Internals & Design	50	5131	October 1, 2018
How can I split large data using a faster and more efficient function (data science)? New to Julia csv	9	834	October 27, 2022
Partition a large CSV file into smaller files without loading into memory General Usage question , csv , io	6	3711	March 10, 2019