oneflow.one_embedding.make_persistent_table_reader(paths, snapshot_name, key_type, value_type, storage_dim, physical_block_size=4096)

Creates a reader for reading persistent table.

  • paths (list) – paths of tables to read

  • snapshot_name (str) – name of the snapshot to read

  • key_type (flow.dtype) – the data type of key

  • value_type (flow.dtype) – the data type of value

  • storage_dim (int) – number of elements in each value

  • physical_block_size (int, optional) – physical_block_size should be sector size. Defaults to 4096