I have a text file representing k-mer counts. It’s order of magnitude a billion lines long, 14 gigabytes gzipped. It looks like so (4 early rows shown by zless): AAAAAAAAAAAAAAAAAAAAGATTTTAAATATGCAAATTT 6 1 3 0 2 1 2 1 0 0 1 AAAAAAAAAAAAAAAAAAAAGTTAAAAAAAAAAAAAAAAA 0 2 1 1 0 0 0 0 0 0 1 AAAAAAAAAAA…

Efficiently filter rows while reading very large CSV-ish file

rafael.guerra August 14, 2024, 2:41pm 4

Topic		Replies	Views
Is it possible to iterate over a very large CSV in Windows? New to Julia	9	1002	August 23, 2019
How to subset a stream I/O and pass it to TensorFlow.jl? (question has been updated) Data question	61	4385	May 6, 2017
Reading huge csv files Data	5	4088	January 19, 2019
Reading a few rows from a BIG CSV file General Usage dataframes , csv , big-data	39	4646	January 18, 2024
Is this an efficient way to read a .csv file row by row? General Usage	9	3105	January 27, 2019