There is CategoricalArray that supports only mutually exclusive categories (you can have only one caterory from a dictionary). But what if I need to store a combinations of several binary features, say: “Visible”: true, false, “Clicked”: true, false, “Moved”: true, false, Probably the most compa…

There is an inherent trade-off between data size and access speed (similar to BitVector vs Vector{Bool}). If you want to use bitflags, and need generic code for this, you could experiment with a type like struct FlagContainer{T} flags::T end where T is a Tuple of keys, eg (:top, :down, :left,…

This would be a nice package to have around. I’d love to see how others implement this too.

[image] Tamas_Papp: and clever code uses this to figure out the bit masks, possibly using Base.pure (see examples for the NamedTuple code in Base ). Did you mean @pure macro? Any references to that examples? Actually I thougth of using named tuples with names for categories and values for ma…

Yes, that’s a typo, I mean Base.@pure. I agree that implementing this well is not trivial, I would recommend that you experiment with something simple (single feature) and build up from there.

If you take the time to comb through discourse you’ll get an idea of how to appropriately use pure

Wrote a first version of bit categories: https://github.com/sairus7/try_bitcategories.jl There are some questions and insonsistence in: Value of two-valued BinaryFeature: boolean (present - true or absent - false) or equals to feature name and some default name when it is absent (in this case :n…

[image] sairus7: be able to check and set individual feature values @jw3126 ’s PhaseSpaceIO.jl has an interesting usage of Setfield.jl to get and set values packed in bits. Even if you don’t use Setfield.jl, I think it’s worth considering to support ConstructionBase.jl API so that it works wi…

It would be nice if there were some sort of syntax for constructing these similar to @enum where you could just do: @features Directions begin Top Bottom Left Right end You would probably need to add some extra syntax to this though to account for appropriate masking between features.

I am using this approach for a while and I think it is a very good API for manipulating packed bit objects. You need to implement ConstructionBase.setproperties once an then it pays off very quickly. You don’t need to think about bitmasks ever again. (I also recommend overloading Base.show, Base.pro…

Coimbination of categories / nominal features encoding

General Usage

tkf December 22, 2019, 8:15am 10

For enum-like interface [ANN] New package: BitFlags.jl — An enum-like type for bit flags

1 Like

Topic		Replies	Views
[ANN] New package: BitFlags.jl — An enum-like type for bit flags Community enum	6	1507	March 10, 2019
All the ways to do one-hot encoding General Usage	30	11706	October 20, 2024
Encoding categorical variables within a matrix Machine Learning machine-learning	3	2768	December 28, 2019
Arrow's DictEncode to CategoricalArray? Data dataframes , arrow	18	1851	February 11, 2025
Faster way to find all bit arrays of weight n Performance	14	585	May 2, 2024

Coimbination of categories / nominal features encoding

Related topics