@fabiangans thinking about what you said a separate interface for disk-based arrays is really something that is missing here.
An AbstractDiskArray
that follows AbstractArray
indexing correctly, but defines more sensible baviors for disk-backed array-like data - like avoiding the issues with show
or broadcast. Traits could be used for chunking? There are quite a few formats that could benefit from this. It would definitely make writing GeoData.jl a lot easier.
BTW I think some of the issues mentioned for HDF5.jl may also apply to Zarr.jl - the indexing doesn’t exactly match AbstractArray