# ANN: OffsetBuffers.jl - for streaming data processing

**URL:** https://discourse.julialang.org/t/ann-offsetbuffers-jl-for-streaming-data-processing/29316
**Category:** Package Announcements
**Created:** [September 30, 2019, 10:25am UTC](https://discourse.julialang.org/t/ann-offsetbuffers-jl-for-streaming-data-processing/29316 "2019-09-30T10:25:15Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![sairus7](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/sairus7/32/10816_2.png) [@sairus7](https://discourse.julialang.org/u/sairus7)
#### Post date: [September 30, 2019, 10:25am UTC](https://discourse.julialang.org/t/ann-offsetbuffers-jl-for-streaming-data-processing/29316/1 "2019-09-30T10:25:15Z")

</div>

[https://github.com/sairus7/OffsetBuffers.jl](https://github.com/sairus7/OffsetBuffers.jl)

Buffer counts items pushed to the end and uses counted value as index for last buffered items.

It may be useful for stream processing, when you have long arrays / signals streaming in chunks or single points, and to process them you need to store some previous buffered history and preserve point position relative to the start of the stream.

---

<div class="post-metadata">

### Author: ![yakir12](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/yakir12/32/297_2.png) [@yakir12](https://discourse.julialang.org/u/yakir12)
#### Post date: [September 30, 2019, 11:27am UTC](https://discourse.julialang.org/t/ann-offsetbuffers-jl-for-streaming-data-processing/29316/2 "2019-09-30T11:27:02Z")

</div>

Very cool! I might want to use it with VideoIO.jl to explore video that are larger than memory, ultimately to be used in a Julian video player…

---

<div class="post-metadata">

### Author: ![tim.holy](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tim.holy/32/52_2.png) [@tim.holy](https://discourse.julialang.org/u/tim.holy)
#### Post date: [September 30, 2019, 8:21pm UTC](https://discourse.julialang.org/t/ann-offsetbuffers-jl-for-streaming-data-processing/29316/3 "2019-09-30T20:21:37Z")

</div>

Not to take away from OffsetBuffers (👍), but for AVI purposes you can already do that (and more) with `StreamingContainer`:  
[https://github.com/JuliaImages/ImageAxes.jl/blob/e6f7a611010f9cbdcfc11f8e119108fe6861fee7/src/ImageAxes.jl#L197-L263](https://github.com/JuliaImages/ImageAxes.jl/blob/e6f7a611010f9cbdcfc11f8e119108fe6861fee7/src/ImageAxes.jl#L197-L263)

---

<div class="post-metadata">

### Author: ![yakir12](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/yakir12/32/297_2.png) [@yakir12](https://discourse.julialang.org/u/yakir12)
#### Post date: [October 1, 2019, 6:56am UTC](https://discourse.julialang.org/t/ann-offsetbuffers-jl-for-streaming-data-processing/29316/4 "2019-10-01T06:56:30Z")

</div>

Wow. Wish I knew this earlier. OK, I’ll try to use that. Thanks Tim.
