Collective Communication Operations#
Collective communication operations accessible via the ccl attribute on the Iris instance (e.g. ctx.ccl.all_reduce(...)).
all_to_all#
all_gather#
all_reduce_preamble#
Note
all_reduce_preamble is currently only available when using the Triton backend.
all_reduce#
Note
all_reduce is currently only available when using the Triton backend.