Horovod and Flux / Julia

Domains Machine Learning
#1

Hi all,

I wonder if anyone was trying to use horovod with Flux (or Julia in general).

Thanks for a answer.
Best wishes,
Tomas

3 Likes
#2

I had a look through and Horovod is a C++ library under the hood, no? Unless somebody has wrapped it with a C API, I imagine the only straightforward way to use it would be via PyCall (if indeed that jives with all the Distributed machinery). AFAICT the only collective communication library that does expose a C interface would be NCCL. It would be nice to have something like this though, Iā€™d rather not bother with getting CUDA-aware MPI working on my local machines.

#3

Thanks,

wrapping c++ in c seems to be doable, pycall sshould be easy.

1 Like