oneflow.distribute

oneflow.distribute.assert_is_valid_distribute(distribute: oneflow_api.distribute.Distribute) → None
oneflow.distribute.auto() → oneflow_api.distribute.AutoDistribute

Generate a broadcast scheme.

Returns

Auto distribute scheme object, often required by with_distribute method of Blob or oneflow.get_variable.

Return type

AutoDistribute

oneflow.distribute.broadcast() → oneflow_api.distribute.BroadcastDistribute

Generate a broadcast scheme.

Returns

Broadcast scheme object, often required by with_distribute method of Blob or oneflow.get_variable.

Return type

BroadcastDistribute

Example::

segment_ids = segment_ids.with_distribute(flow.distribute.broadcast())

oneflow.distribute.split(axis: int) → oneflow_api.distribute.SplitDistribute

Generate a split scheme in which op will be splitted at axis.

Parameters

axis (int) – At axis the op will be splitted.

Returns

Split scheme object, often required by with_distribute method of Blob or oneflow.get_variable.

Return type

SplitDistribute

Example::

weight = weight.with_distribute(distribute.split(1))