# Training Deep Neural Network using Data Parallel?

**URL:** <https://discourse.julialang.org/t/training-deep-neural-network-using-data-parallel/75079>\
**Category:** Machine Learning\
**Tags:** parallel, flux\
**Created:** [January 23, 2022, 6:44pm UTC](https://discourse.julialang.org/t/training-deep-neural-network-using-data-parallel/75079 "2022-01-23T18:44:45Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![albheim](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/albheim/32/34660_2.png) [@albheim](https://discourse.julialang.org/u/albheim)\
**Post date:** [January 24, 2022, 12:00pm UTC](https://discourse.julialang.org/t/training-deep-neural-network-using-data-parallel/75079/2 "2022-01-24T12:00:20Z")

</div>

Don’t know about anything exactly like the PyTorch example, but you can probably put something together.

This thread could maybe be of interest

> [@Multiple GPUs with Julia](https://discourse.julialang.org/t/multiple-gpus-with-julia/11248):
>
> Has anyone every used multiple GPUs with Flux? If so, did you have to modify your code to run on multiple GPUs?

where the [cuda docs](https://cuda.juliagpu.org/stable/usage/multigpu/) are mentioned, where you can find a little about some basic data handling over gpus.

---

_[View the full topic](https://discourse.julialang.org/t/training-deep-neural-network-using-data-parallel/75079)._