One interesting thing that I noticed during these benchmarkings is that for the 1e9 join
task, the combination of InMemoryDatasets
and DLMReader
finish reading and processing data long before other packages realise that they are failing in the reading part!
2 Likes