What does the nki.language.all_reduce function do?

[shimbay]

There is a function all_reduce in nki document, but i donot understand the usage of this function.

Is it used for chip2chip communication or core2core communication?

[VishaalChandrasekar0203]

The 'nki.language.all_reduce' function enables communication between cores within a single Neuron chip. It performs a reduction operation (like, sum, max) across these cores, then shares the result with all participants ( Not chip2chip).
Think of it as internal coordination for parallel processing on one chip.

Hope this helps @shimbay @aws-satyajith

[shimbay]

The 'nki.language.all_reduce' function enables communication between cores within a single Neuron chip. It performs a reduction operation (like, sum, max) across these cores, then shares the result with all participants ( Not chip2chip). Think of it as internal coordination for parallel processing on one chip.

Hope this helps @shimbay @aws-satyajith

Thanks for your reply!!!

Now i understand this api is for core2core communication, but there is another problem, I did not see any hardware link between cores in the architecture description. So is this api implemented by swapping data via HBM? or if there is a hardware link, what is the bandwidth?