Kolmogorov-Arnold network

A new architecture was dropped, vastly different from deep learning. In case you were interested in implementing something in Julia, maybe this?

21 Likes

Any movement on this? Has anyone implemented an example from the paper using Flux.jl? Its a bit beyond my knowledge but would be super curious to see how its done.

There seems to be a new package implementation now: GitHub - rbSparky/KolmogorovArnoldNetworks.jl: KolmogorovArnoldNetworks.jl is a Julia library providing implementations of Kolmogorov-Arnold neural networks

7 Likes

Wow! Julians are fast! Let’s see how well we do!

Still, this is arguably the early day of KAN. Let’s see where it goes.

KAN was a more elegant replacement for something like MLP, but what about CNN or Transformer? Only time will tell. Or well, if you want to try your luck, maybe go implement it?

Here’s another Julia implementation if people want to start experimenting. This contains some key implementation changes that speed up the evaluation in comparison to the original architecture.

6 Likes

Very helpful and user friendly library, can we expect it coming to julia registry soon?