Hi Juliohm
I actually have files growing to about 5GB in csv form, and this is why I append relatively small chunks (1000 lines) to it at at every step of a loop. May be other formats work better with this, but I already have a collection of files like this.
I agree that in the best possible world one needs to learn new language as a new langage to appreciate its features, and I wish I could do this, but many of us need something done quickly, do no have time for any reading, unfortunately, and go for julia as it speeds up noticeably (in my experience), so here is: let me rewrite the existing code somehow so that it works and it works faster, and I will sort out nice things later on…
hence the absence of documentation when you search for a very particular thing is frustrating and the forum is the only option.