# Has anyone tried implementing the LiMuon Optimizer?

**URL:** <https://discourse.julialang.org/t/has-anyone-tried-implementing-the-limuon-optimizer/132742>\
**Category:** Machine Learning\
**Tags:** question, optimization, neural-network\
**Created:** [September 29, 2025, 8:41am UTC](https://discourse.julialang.org/t/has-anyone-tried-implementing-the-limuon-optimizer/132742 "2025-09-29T08:41:57Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![DoktorMike](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/doktormike/32/2736_2.png) [@DoktorMike](https://discourse.julialang.org/u/DoktorMike)\
**Post date:** [September 29, 2025, 8:41am UTC](https://discourse.julialang.org/t/has-anyone-tried-implementing-the-limuon-optimizer/132742/1 "2025-09-29T08:41:57Z")

</div>

Has anyone tried implementing the [LiMuon optimizer](https://arxiv.org/abs/2509.14562)?

I made an issue [here](https://github.com/FluxML/Optimisers.jl/issues/213) in the Optimisers.jl package but thought I’d ask here as well if someone has implemented it elsewhere? Also any hands on experience with the method itself would be interesting to hear about.

According to the paper it beats AdamW in a few benchmarks both on training/testing error and convergence speed.

---

<div class="post-metadata">

**Author:** ![txenakis](https://avatars.discourse-cdn.com/v4/letter/t/df705f/32.png) [@txenakis](https://discourse.julialang.org/u/txenakis)\
**Post date:** [November 6, 2025, 10:17pm UTC](https://discourse.julialang.org/t/has-anyone-tried-implementing-the-limuon-optimizer/132742/3 "2025-11-06T22:17:50Z")

</div>

Would be interesting to implement it. Neither “normal” Muon has been implemented, right?

---

<div class="post-metadata">

**Author:** ![DoktorMike](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/doktormike/32/2736_2.png) [@DoktorMike](https://discourse.julialang.org/u/DoktorMike)\
**Post date:** [November 7, 2025, 8:33pm UTC](https://discourse.julialang.org/t/has-anyone-tried-implementing-the-limuon-optimizer/132742/4 "2025-11-07T20:33:54Z")

</div>

I have not seen it at least.