ANN: OffsetBuffers.jl - for streaming data processing

https://github.com/sairus7/OffsetBuffers.jl

Buffer counts items pushed to the end and uses counted value as index for last buffered items.

It may be useful for stream processing, when you have long arrays / signals streaming in chunks or single points, and to process them you need to store some previous buffered history and preserve point position relative to the start of the stream.

6 Likes

Very cool! I might want to use it with VideoIO.jl to explore video that are larger than memory, ultimately to be used in a Julian video player…

2 Likes

Not to take away from OffsetBuffers (:+1:), but for AVI purposes you can already do that (and more) with StreamingContainer:
https://github.com/JuliaImages/ImageAxes.jl/blob/e6f7a611010f9cbdcfc11f8e119108fe6861fee7/src/ImageAxes.jl#L197-L263

2 Likes

Wow. Wish I knew this earlier. OK, I’ll try to use that. Thanks Tim.