What libraries are available to work with streams?

It would be interesting to collect the possible tools available to work with streams of data.

From my knowledge I can recall the following libraries, but I am sure I am missing something.

  • BufferedStream.jl
  • BufferedFiles.jl
  • FileIO.jl
  • OnlineStats.jl
  • TranscodingStreams.jl

Especially stream processing besides statistical use cases seems to be missing (Like find / replace / regex / parsing / lexing)
Maybe Transducers.jl fills that gap, but I am not so familiar with it.

I am sure an overview of available tools would help when a project starts considering stream processing. So if anyone knows useful libraries tell me and I will add them to the list above.

2 Likes

Would you concider creating a section for JuliaPackageComparisons? I am just staring some work with data streams, and I initially felt very much lost on the possible workflows.

I would contribute a small example workflow using standard libraries as well. I am currently exploring stuff, as disscussed in this post.