How to optimaly comprssing and save long strings ( 10^6 char and more)

General Usage
1

how to optimaly comprssing and save long strings ( 10^6 char and more)
HDF5 I cant do “compress” another oprtions ? Formats?
Paul

2

Unicode? Ascii, what type of text are stored?

3

Thanks, Unicode!

4

um, I don’t know if this is a Julia problem since this is just like compression for any thing, for example, jpg; some committee somewhere probably have an algorithm for it

5

Store in CSV / JSON and zip it?

Or use something like https://github.com/stevengj/Blosc.jl or https://bicycle1885.github.io/TranscodingStreams.jl/v0.2/#Introduction-1.

2 Likes