# Flux for deep learning in particle physics

**URL:** <https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258>\
**Category:** Machine Learning\
**Created:** [August 11, 2018, 5:50pm UTC](https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258 "2018-08-11T17:50:44Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![johnh](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/johnh/32/3615_2.png) [@johnh](https://discourse.julialang.org/u/johnh)\
**Post date:** [August 11, 2018, 5:50pm UTC](https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258/1 "2018-08-11T17:50:44Z")

</div>

There is a CodaLab code competition for applying deep learning to particle physics  
[https://competitions.codalab.org/competitions/19818#learn\_the\_details](https://competitions.codalab.org/competitions/19818#learn_the_details)

As I have a background in the field (see me? See a CERN PhD which used FORTRAN?) I am toying with the idea of using this as a Flux learning project.  
The question I have is - where should I install and run Flux?  
Is Flux on Juliabox? I dont mind paying for a GPU instance if that is what is needed.  
Or should I start with an AWS or Google instance?

Second stupid question - it is ridiculously easy to copy a dataset into Juliabox? I guess it must be or it would be essentially useless!

---

<div class="post-metadata">

**Author:** ![pkofod](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/pkofod/32/2179_2.png) [@pkofod](https://discourse.julialang.org/u/pkofod)\
**Post date:** [August 11, 2018, 6:12pm UTC](https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258/2 "2018-08-11T18:12:25Z")

</div>

How Big is the dataset?

---

<div class="post-metadata">

**Author:** ![jekbradbury](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/jekbradbury/32/953_2.png) [@jekbradbury](https://discourse.julialang.org/u/jekbradbury)\
**Post date:** [August 11, 2018, 11:02pm UTC](https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258/3 "2018-08-11T23:02:31Z")

</div>

I’d personally suggest an AWS or Google cloud instance. For now AWS has slightly easier access to GPUs (Google requires manually requesting GPU quota first) while Google has a slightly easier user interface (the Cloud Shell is an amazing idea), slightly cheaper GPU pricing, and a nice free trial deal.

---

<div class="post-metadata">

**Author:** ![mcreel](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mcreel/32/30088_2.png) [@mcreel](https://discourse.julialang.org/u/mcreel)\
**Post date:** [August 11, 2018, 11:09pm UTC](https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258/4 "2018-08-11T23:09:46Z")

</div>

I have used Mocha and MXNet on EC2 GPU instances, it was pretty straightforward. I suppose with Flux, it would be similarly easy.

---

<div class="post-metadata">

**Author:** ![johnh](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/johnh/32/3615_2.png) [@johnh](https://discourse.julialang.org/u/johnh)\
**Post date:** [August 12, 2018, 7:25am UTC](https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258/5 "2018-08-12T07:25:12Z")

</div>

Thankyou all. Regarding the dataset the training dataset is an HDF5 file with 6K events.  
Each event is a 192x192 array. I Cannot actually find the file on GitHub to report the size!

---

<div class="post-metadata">

**Author:** ![pkofod](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/pkofod/32/2179_2.png) [@pkofod](https://discourse.julialang.org/u/pkofod)\
**Post date:** [August 12, 2018, 7:47am UTC](https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258/6 "2018-08-12T07:47:53Z")

</div>

So something like 1,8 gigabytes? I’m not sure that’ll fit on your juliabox account. It may be possible to allocate more disk space by request though, if you use it it to make a cool Flux example 🙂

---

<div class="post-metadata">

**Author:** ![sdanisch](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/sdanisch/32/1406_2.png) [@sdanisch](https://discourse.julialang.org/u/sdanisch)\
**Post date:** [August 16, 2018, 4:25pm UTC](https://discourse.julialang.org/t/flux-for-deep-learning-in-particle-physics/13258/7 "2018-08-16T16:25:15Z")

</div>

Just click on remix here:

> **[Flux + GPU Remix](https://nextjournal.com/sdanisch/flux-gpu-remix)**

And you get a complete IJulia like environment with a tesla k80, Flux + CuArrays readily installed 😉

Have fun playing around with it! Signup code: juliacon

Flux + CuArrays is not 100% stable right now, but I will try to keep it up to date whenever there is an improvement.

Best,  
Simon