# How do Julia packages, e.g. Flux and Knet correspond to Python ecosystem

**URL:** <https://discourse.julialang.org/t/how-do-julia-packages-e-g-flux-and-knet-correspond-to-python-ecosystem/55147>\
**Category:** Machine Learning\
**Created:** [February 12, 2021, 1:05pm UTC](https://discourse.julialang.org/t/how-do-julia-packages-e-g-flux-and-knet-correspond-to-python-ecosystem/55147 "2021-02-12T13:05:46Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Palli](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/palli/32/3380_2.png) [@Palli](https://discourse.julialang.org/u/Palli)\
**Post date:** [February 12, 2021, 1:05pm UTC](https://discourse.julialang.org/t/how-do-julia-packages-e-g-flux-and-knet-correspond-to-python-ecosystem/55147/1 "2021-02-12T13:05:46Z")

</div>

I’m not so much asking if they are better, just some mapping, and trying to get an overview of the mainstream and where there might be big holes in the Julia ecosystem.

E.g. Pytorch Lightning corresponds to Keras, and to what in Julia? See e.g.: [Converting From Keras To PyTorch Lightning | by William Falcon | Towards Data Science](https://towardsdatascience.com/converting-from-keras-to-pytorch-lightning-be40326d7b7d)

They are higher-level interfaces to Pytorch and TensorFlow, those are the most mainstream low-level packages right? There’s also MXNet, and Julia already officially part of, but has MXNet fallen out of favor (not only for Julia)?

Just as Torch was written in Lua and migrated to Python, it could happen again to Julia, or has already happened in the form of Flux (also a replacement for TensorFlow)? Where does Knet fit in?

I’m mostly thinking of neural networks, feel free to add more mappings for machine learning. I.e. MLJ.jl would correspond to SciKitlearn? And it can also have it as a backend.

For some applications, e.g. GPT-3, you would find such in a model-zoo at e.g. Flux (if available), or in other more likely places? And models improving on GPT-3 like [Google Brain’s Switch Transformer Language Model Packs 1.6-Trillion Parameters | Synced](https://syncedreview.com/2021/01/14/google-brains-switch-transformer-language-model-packs-1-6-trillion-parameters/)

For multi-GPU, what’s the go to library now, Horovod or Deepspeed or its fork: [https://github.com/EleutherAI/DeeperSpeed](https://github.com/EleutherAI/DeeperSpeed) ? And what’s the equivalent in Julia if any, or could you use those?

[https://github.com/FluxML/FastAI.jl](https://github.com/FluxML/FastAI.jl) corresponds well to fast.ai.

> **[Deep Diamond - Deep Learning in Clojure is Fast, Simpler than Keras](https://dragan.rocks/articles/20/Deep-Diamond-Deep-Learning-in-Clojure-is-Fast-and-Simpler-than-Keras)**
>
> Deep Diamond preview release is in Clojars, and is already quite useful! And fast! In accordance with my philosophy,

---

<div class="post-metadata">

**Author:** ![ToucheSir](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/touchesir/32/14411_2.png) [@ToucheSir](https://discourse.julialang.org/u/ToucheSir)\
**Post date:** [February 12, 2021, 8:09pm UTC](https://discourse.julialang.org/t/how-do-julia-packages-e-g-flux-and-knet-correspond-to-python-ecosystem/55147/2 "2021-02-12T20:09:40Z")

</div>

There is no one location for all of this info, but [https://fluxml.ai/ecosystem.html](https://fluxml.ai/ecosystem.html) is the best place to start. We also have quite a few issues, pointers and discussions around ecosystem parity and what should map where at [https://github.com/FluxML/ML-Coordination-Tracker](https://github.com/FluxML/ML-Coordination-Tracker). This is where the FastAI.jl development planning started, for example. If you either follow the meeting minutes or the Zulip link, you’ll also see that we’ve had plenty of discussions around how to implement multi-GPU and distributed training. More hands are always welcome!