Do you expose torch.distributed or similar?

[joelberkeley]

Hi, I'm looking for a distributed ML package in Rust. Does this expose torch.distributed or similar? I can't see it in the code. Is there even such a thing in the C++ API?

[LaurentMazare]

There is no specific distributed wrappers in this crate, as far as I understand torch.distributed is mostly made of python code that uses NCCL to manipulate distributed tensors.

[joelberkeley]

OK thanks. I'll have a look at these rust bindings for NCCL. You don't happen to know if someone's already tried using them with this lib?

[LaurentMazare]

I haven't heard of anything yet, if you find one I would certainly be interested in knowing about it.