I have a text file representing k-mer counts. It’s order of magnitude a billion lines long, 14 gigabytes gzipped. It looks like so (4 early rows shown by zless): AAAAAAAAAAAAAAAAAAAAGATTTTAAATATGCAAATTT 6 1 3 0 2 1 2 1 0 0 1 AAAAAAAAAAAAAAAAAAAAGTTAAAAAAAAAAAAAAAAA 0 2 1 1 0 0 0 0 0 0 1 AAAAAAAAAAA…

Efficiently filter rows while reading very large CSV-ish file

rafael.guerra August 14, 2024, 2:41pm 4

Topic		Replies	Views
Read text file containing proper CSV data chunks Data dataframes , csv	11	520	December 20, 2023
Processing multiple large zipped csv files Data csv , zip	2	744	April 4, 2022
Reading huge csv files Data	5	4034	January 19, 2019
Importing only specific lines from large csv file Data csv	6	807	January 11, 2024
[ANN] New CSV.jl 0.5 Release Package Announcements data , csv	18	5062	October 20, 2019