Transform several columns of an MLJ model using one transformer

Specific Domains Machine Learning
, ,
1

Is there an easy way to transform several columns of a table using the same MLJ transformer? So if I have a transformer like UnivariateBoxCoxTransformer, I’d like to apply it only to columns 2, 3, and 4.

Alternatively, some way to avoid applying a transformer (like Standardizer) to some columns.

2

If you can’t find a solution with MLJ.jl take a look at TableTransforms.jl.

1 Like
3

Thanks, but unfortunately, I’m looking for an answer to make a PR to MLJ.jl, and I’d rather not add a dependency :sweat_smile:

4

I’ve long thought we should have this, but we don’t. An issue was opened some time ago:

1 Like
5

Please! It is very cumbersome, like this


# 1. loading  package
using  DataFrames,TableTransforms
using  Random
Random.seed!(34343)

# 2. loading  data -> dataframe
df=load_csv("BostonHousing")

# 3. tranformation
table=(eachcol(df))|>Functional(
                  1=>log,
                  2=>x->x/10,
                  3=>log,
                  4=>x->x,
                  5=>log,
                  6=>log,
                  7=>x->(x^2.5)/10000,
                  8=>log,
                  9=>log,
                  10=>log,
                  11=>x->exp(0.4*x)/1000,
                  12=>x->x/100,
                  13=>x->sqrt(x),
                  14=>log
)
first(table,10)

[1,3,5,6,8,9,10,14] better be one line

1 Like
6

Damn. So TIL about Functional, which is a huge quality-of-life improvement already. Actually, as I’m reading more about TableTransforms.jl, I’m thinking this is a great consolidation opportunity; most of the built-in transformations in MLJModels.jl might fit better in TableTransforms.

7

TableTransforms.jl has very flexible column selection features:

Functional([1,3,5,6,8,9,10,14] => log)

You can use lists of symbols, strings, integers, regex, …

1 Like
8

Ooh, neat! Perhaps this could be more clearly documented?

9

All transforms should have a clear docstring explaining these options.

10

this method doesn’t work right now

11

You need to be more explicit about which method doesn’t work. Can you please share a MWE?

12

Is there a way to use TableTransforms.jl together with MLJ transforms?

13

Not currently. The main issues are:

  1. (abstract type roadblock) MLJModelInterface requires new algorithms to subtype an abstract type owned by MLJModelInterface (Unsupervised or Static) but TableTransforms.jl, as I understand it, is trying for a pure functional interface, and without depending on externally owned types.

  2. (limitation on functionality) The MLJTuning.jl API for tuning models is based on mutation of the hyperparameter struct, and so not suited to TableTransforms.jl transformer structs, which are immutable. This currently rules out optimization of transformer hyperparameters in MLJ pipelines.

One day MLJ may rid itself of its abstract model type hierarchy (for efforts in this direction, see this announcement). However, it is substantially embedded in the ecosystem and unlikely to disappear in the near future.

A simple, but unattractive, solution to 1. would be for MLJModels.jl or TableTransforms.jl to provide a wrapper. The only way I can think of to avoid the wrapper in the status quo would require metaprogramming hacks that would likely be brittle.

1 Like
14

Sounds good to me!