# Hyperbolic Deep Learning

**URL:** <https://discourse.julialang.org/t/hyperbolic-deep-learning/45895>\
**Category:** Machine Learning\
**Created:** [September 1, 2020, 1:44pm UTC](https://discourse.julialang.org/t/hyperbolic-deep-learning/45895 "2020-09-01T13:44:57Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![tbreloff](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tbreloff/32/68_2.png) [@tbreloff](https://discourse.julialang.org/u/tbreloff)\
**Post date:** [September 1, 2020, 1:44pm UTC](https://discourse.julialang.org/t/hyperbolic-deep-learning/45895/1 "2020-09-01T13:44:57Z")

</div>

Are there any active communities working in the space of hyperbolic deep learning? I’m specifically interested in Flux-compatible libraries which define the basic DL operations for either the Poincare or Lorentz hyperbolic spaces: addition, multiplication, softmax, etc. Bonus points for hyperbolic versions of Adam, etc, along with docs/examples.

If these don’t exist and I was to build them, is there an existing org where the package could/should live?

---

<div class="post-metadata">

**Author:** ![Palli](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/palli/32/3380_2.png) [@Palli](https://discourse.julialang.org/u/Palli)\
**Post date:** [September 1, 2020, 2:18pm UTC](https://discourse.julialang.org/t/hyperbolic-deep-learning/45895/2 "2020-09-01T14:18:51Z")

</div>

Not sure, this is the first time I hear of this interesting thing:  
[http://hyperbolicdeeplearning.com/hyperbolic-neural-networks/](http://hyperbolicdeeplearning.com/hyperbolic-neural-networks/)

Again it uses Python/PyTouch, do you have good reason to think Julia would be better? [Why is Python, not Julia, still used for most state-of-the-art AI research? - #4 by Palli](https://discourse.julialang.org/t/why-is-python-not-julia-still-used-for-most-state-of-the-art-ai-research/45896/4)

> [@tbreloff](#):
>
> hyperbolic versions of Adam

The Adam optimizer?

It’s amazing to me how advanced math (e.g. softmax and tanh) has anything to do with even natural language processing (in ordinary ANNs), and now more advanced geometry than Euclidean: [https://arxiv.org/pdf/1006.5169.pdf](https://arxiv.org/pdf/1006.5169.pdf)

> Hyperbolic Geometry of Complex Networks

> […] SNLI task and dataset. We evaluate our method on two tasks. The first is natural language inference, or textual entailment

---

<div class="post-metadata">

**Author:** ![tbreloff](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tbreloff/32/68_2.png) [@tbreloff](https://discourse.julialang.org/u/tbreloff)\
**Post date:** [September 1, 2020, 3:02pm UTC](https://discourse.julialang.org/t/hyperbolic-deep-learning/45895/3 "2020-09-01T15:02:04Z")

</div>

I should have said that I know about the “Manifold aware” library [http://github.com/geoopt/geoopt](http://github.com/geoopt/geoopt) which is based on pytorch (which I actively use). I could always use that in python, or call it using PyCall.

Julia has better potential for non-vanilla use cases where there is substantial computation occurring outside of the kernel functions. I’m attempting to evaluate the cost of using Julia for this work, having a good prior sense of the benefit.

---

<div class="post-metadata">

**Author:** ![tbreloff](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tbreloff/32/68_2.png) [@tbreloff](https://discourse.julialang.org/u/tbreloff)\
**Post date:** [September 2, 2020, 7:53pm UTC](https://discourse.julialang.org/t/hyperbolic-deep-learning/45895/4 "2020-09-02T19:53:15Z")

</div>

I just discovered the [JuliaManifolds](http://github.com/JuliaManifolds) organization which seems to be what I was looking for. 🎉

---

<div class="post-metadata">

**Author:** ![msjgriffiths](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/msjgriffiths/32/29474_2.png) [@msjgriffiths](https://discourse.julialang.org/u/msjgriffiths)\
**Post date:** [September 25, 2021, 12:26am UTC](https://discourse.julialang.org/t/hyperbolic-deep-learning/45895/5 "2021-09-25T00:26:31Z")

</div>

@tbreloff Did you ever get a hyperbolic deep learning model trained? I wanted to prototype something and wasn’t sure if I needed to fall back to PyTorch.