# Distributed, AllReduce, and Distributed Training

**URL:** <https://discourse.julialang.org/t/distributed-allreduce-and-distributed-training/56110>\
**Category:** Julia at Scale\
**Tags:** parallel, distributed, machine-learning\
**Created:** [February 26, 2021, 6:36pm UTC](https://discourse.julialang.org/t/distributed-allreduce-and-distributed-training/56110 "2021-02-26T18:36:03Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![matthiasbe](https://avatars.discourse-cdn.com/v4/letter/m/5fc32e/32.png) [@matthiasbe](https://discourse.julialang.org/u/matthiasbe)\
**Post date:** [March 18, 2021, 9:56am UTC](https://discourse.julialang.org/t/distributed-allreduce-and-distributed-training/56110/2 "2021-03-18T09:56:51Z")

</div>

I’m currently trying to implement an equivalent to the MPI\_Reduce operation in Julia. You may want to check out this similar thread. [How to sum the chunks of a distributed array using a binary reduction tree?](https://discourse.julialang.org/t/how-to-sum-the-chunks-of-a-distributed-array-using-a-binary-reduction-tree/57288).

I’m not sure either if I used the correct section to post it…

---

_[View the full topic](https://discourse.julialang.org/t/distributed-allreduce-and-distributed-training/56110)._