# BEIR v1.0.0 contriever-msmarco

This index was generated on 20230124 using Tevatron with following command: 

```
python -m tevatron.driver.encode \
--output_dir=temp \
--model_name_or_path facebook/contriever-msmarco \
--fp16 \
--tokenizer_name bert-base-uncased \
--per_device_eval_batch_size 156 \
--p_max_len 512 \
--dataset_name Tevatron/beir-corpus:$subdataset \
--encoded_save_path beir_embeddings/corpus_emb.$subdataset.pkl
```

where the `subdataset` is one of the BEIR dataset, e.g. `scifact`.

The Embedding is then converted to Pyserini index format.