oneflow.one_embedding.make_persistent_table_reader

oneflow.one_embedding.make_persistent_table_reader(paths, snapshot_name, key_type, value_type, storage_dim, physical_block_size=512)

Creates a reader for reading persistent table.

Parameters

• paths (list) – paths of tables to read

• snapshot_name (str) – name of the snapshot to read

• key_type (flow.dtype) – the data type of key

• value_type (flow.dtype) – the data type of value

• storage_dim (int) – number of elements in each value

• physical_block_size (int, optional) – physical_block_size should be sector size. Defaults to 512