Package for approximate small quantiles

Anybody knows about a package that might be used for fast estimation of approximated quantiles? I’m looking for an efficient method that might be used with very large datasets, without having to store all the values (I can obtain them with an iterator). E.g. Greenwald’s and Khanna’s method (https://doi.org/10.1145/375663.375670), or perhaps Cormode’s et al. (Effective computation of biased quantiles over data streams | IEEE Conference Publication | IEEE Xplore), or any other that works nice with small quantiles (around q=0.05).

Try OnlineStats.jl:

2 Likes