oneflow.comm.gather

oneflow.comm.gather(tensor, gather_list=None, dst=0)

Gathers a list of tensors in a single process.

Parameters

• tensor (Tensor) – Input tensor.

• gather_list (list[Tensor], optional) – List of appropriately-sized tensors to use for gathered data (default is None, must be specified on the destination rank)

• dst (int, optional) – Destination rank (default is 0)