Disk based data manipulation framework needed

Custom types are helpful especially when I have large amounts of data: I can compress the representation, and still work with it seamlessly. Eg using 16-bit integers for dates saves 75%, see

i really like fstpackage.org it provides random access to rows and columns. The interface is in C++ so is not restricted to R

3 posts were split to a new topic: Question: JuliaDB and regression models