[ANN] Cleaner.jl: A toolbox of simple solutions for common data cleaning problems

[juliohm]

We announced two very similar packages on the same day

[ANN] TableTransforms.jl

TableTransforms.jl is a new package for transforms and pipelines commonly used in statistics and machine learning. It works with general Tables.jl and has some unique features compared to previous attempts: The package has been submitted for registration and should be available soon as a dependency for other packages. We invite the community to contribute with more tests.

I wonder if we should join efforts in TableTransforms.jl @TheRoniOne because these cleaning transformations are a small subset of the kinds of transforms people need to do with tabular data. We have worked out a simple API for lazy pipelines and exploit Transducers.jl for parallelism.

Let me know if you are interested in following the same API. I’d be happy to help migrating some of the cleaning operations over there. We will end up adding cleaning operations as well at some point, so that is why I am asking here before duplicating the work.