# Kolmogorov-Arnold network

**URL:** <https://discourse.julialang.org/t/kolmogorov-arnold-network/113712>\
**Category:** Machine Learning\
**Created:** [May 2, 2024, 12:03am UTC](https://discourse.julialang.org/t/kolmogorov-arnold-network/113712 "2024-05-02T00:03:53Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Tarny\_GG\_Channie](https://avatars.discourse-cdn.com/v4/letter/t/3bc359/32.png) [@Tarny\_GG\_Channie](https://discourse.julialang.org/u/Tarny_GG_Channie)\
**Post date:** [May 2, 2024, 12:03am UTC](https://discourse.julialang.org/t/kolmogorov-arnold-network/113712/1 "2024-05-02T00:03:53Z")

</div>

> **[KAN: Kolmogorov-Arnold Networks](https://arxiv.org/abs/2404.19756)**
>
> Inspired by the Kolmogorov-Arnold representation theorem, we propose Kolmogorov-Arnold Networks (KANs) as promising alternatives to Multi-Layer Perceptrons (MLPs). While MLPs have fixed activation functions on nodes ("neurons"), KANs have learnable...

A new architecture was dropped, vastly different from deep learning. In case you were interested in implementing something in Julia, maybe this?

---

<div class="post-metadata">

**Author:** ![Stefan\_Bringuier](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/stefan_bringuier/32/20132_2.png) [@Stefan\_Bringuier](https://discourse.julialang.org/u/Stefan_Bringuier)\
**Post date:** [May 7, 2024, 6:43pm UTC](https://discourse.julialang.org/t/kolmogorov-arnold-network/113712/2 "2024-05-07T18:43:42Z")

</div>

Any movement on this? Has anyone implemented an example from the paper using [Flux.jl](https://fluxml.ai/Flux.jl/stable/)? Its a bit beyond my knowledge but would be super curious to see how its done.

---

<div class="post-metadata">

**Author:** ![camilogarciabotero](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/camilogarciabotero/32/35000_2.png) [@camilogarciabotero](https://discourse.julialang.org/u/camilogarciabotero)\
**Post date:** [May 7, 2024, 6:58pm UTC](https://discourse.julialang.org/t/kolmogorov-arnold-network/113712/3 "2024-05-07T18:58:28Z")

</div>

There seems to be a new package implementation now: [GitHub - rbSparky/KolmogorovArnoldNetworks.jl: KolmogorovArnoldNetworks.jl is a Julia library providing implementations of Kolmogorov-Arnold neural networks](https://github.com/rbSparky/KolmogorovArnoldNetworks.jl)

---

<div class="post-metadata">

**Author:** ![Tarny\_GG\_Channie](https://avatars.discourse-cdn.com/v4/letter/t/3bc359/32.png) [@Tarny\_GG\_Channie](https://discourse.julialang.org/u/Tarny_GG_Channie)\
**Post date:** [May 7, 2024, 8:45pm UTC](https://discourse.julialang.org/t/kolmogorov-arnold-network/113712/4 "2024-05-07T20:45:06Z")

</div>

Wow! Julians are fast! Let’s see how well we do!

Still, this is arguably the early day of KAN. Let’s see where it goes.

KAN was a more elegant replacement for something like MLP, but what about CNN or Transformer? Only time will tell. Or well, if you want to try your luck, maybe go implement it?

---

<div class="post-metadata">

**Author:** ![vpuri3](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/vpuri3/32/30292_2.png) [@vpuri3](https://discourse.julialang.org/u/vpuri3)\
**Post date:** [May 12, 2024, 9:30pm UTC](https://discourse.julialang.org/t/kolmogorov-arnold-network/113712/6 "2024-05-12T21:30:20Z")

</div>

Here’s another Julia implementation if people want to start experimenting. This contains some key implementation changes that speed up the evaluation in comparison to the original architecture.

> **[GitHub - vpuri3/KolmogorovArnold.jl](https://github.com/vpuri3/KolmogorovArnold.jl)**
>
> Contribute to vpuri3/KolmogorovArnold.jl development by creating an account on GitHub.

---

<div class="post-metadata">

**Author:** ![ANANDHU\_SURESH\_B14ME](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/anandhu_suresh_b14me/32/202801_2.png) [@ANANDHU\_SURESH\_B14ME](https://discourse.julialang.org/u/ANANDHU_SURESH_B14ME)\
**Post date:** [July 2, 2024, 7:08am UTC](https://discourse.julialang.org/t/kolmogorov-arnold-network/113712/7 "2024-07-02T07:08:15Z")

</div>

Very helpful and user friendly library, can we expect it coming to julia registry soon?