Hi all,
I wonder if anyone was trying to use horovod with Flux (or Julia in general).
Thanks for a answer.
Best wishes,
Tomas
Hi all,
I wonder if anyone was trying to use horovod with Flux (or Julia in general).
Thanks for a answer.
Best wishes,
Tomas
I had a look through and Horovod is a C++ library under the hood, no? Unless somebody has wrapped it with a C API, I imagine the only straightforward way to use it would be via PyCall (if indeed that jives with all the Distributed
machinery). AFAICT the only collective communication library that does expose a C interface would be NCCL. It would be nice to have something like this though, Iād rather not bother with getting CUDA-aware MPI working on my local machines.
Thanks,
wrapping c++ in c seems to be doable, pycall sshould be easy.