oneflow.one_embedding.make_persistent_table_writer

oneflow.one_embedding.make_persistent_table_writer(paths, snapshot_name, key_type, value_type, storage_dim, physical_block_size=4096)

Creates a writer for writing persistent table.

Parameters
  • paths (list) – paths of tables to write

  • snapshot_name (str) – name of the snapshot to write

  • key_type (flow.dtype) – the data type of key

  • value_type (flow.dtype) – the data type of value

  • storage_dim (int) – number of elements in each value

  • physical_block_size (int, optional) – physical_block_size should be sector size. Defaults to 4096