Hi, I would like to read a portion of a lot of big files, as I know that the lines that interest me are located within line x and line y Currently, I load the files with CSV.File and read parts, but the loading overhead is way too much. The same process in shell (with sed/grep…) takes 27 minutes,…

Reading a file from line x to line y

rafael.guerra May 17, 2024, 10:58am 6

Please check also this thread.

Topic		Replies	Views
Skipping a lot of lines in CSV.read() allocates too much memory Performance csv , io	77	2346	February 23, 2024
Reading a few rows from a BIG CSV file General Usage dataframes , csv , big-data	39	4773	January 18, 2024
How can I split large data using a faster and more efficient function (data science)? New to Julia csv	9	864	October 27, 2022
Importing only specific lines from large csv file Data csv	6	1035	January 11, 2024
Read text file containing proper CSV data chunks Data dataframes , csv	11	616	December 20, 2023