Skipping a lot of lines in CSV.read() allocates too much memory

,

Here how to use arrow format instead of csv for better performance is discussed

2 Likes