The Mmap package provides memory-mapped file-based arrays that sound like they should do what you want. Only the portion you are accessing is paged into memory.
(Every AbstractArray subtype supports @views and subarrays.)
6 Likes