oneflow.env

Environment

oneflow.env.get_world_size()

Returns the number of processes in the current process group.

Returns

The world size of the process group.

oneflow.env.get_rank()

Returns the rank of current process group. Rank is globally unique, range of which is [0, world_size).

Returns

The rank of the process group.

oneflow.env.get_local_rank()

Returns the local rank of current machine. Local rank is not globally unique. It is only unique per process on a machine.

Returns

The the local rank of process on current machine.

oneflow.env.get_node_size()

Returns the number of machines in the current process group.

Returns

The the number of machines in the process group.

oneflow.env.is_multi_client()

Returns whether it is currently in multi client mode.

Returns

True if currently in multi client mode, otherwise returns Flase.