Adopt MTEB dataset naming scheme
#1
by
tomaarsen
HF staff
- opened
Hello!
Pull Request overview
- Update the metadata to the MTEB-accepted format
- Add
ai-forever/ruRoberta-largeas the base model
Details
I noticed that this model does not yet show up on MTEB. After a bit of investigations, it seems that it's because the dataset names in the metadata don't correspond exactly with the dataset names from MTEB: https://huggingface.co/spaces/mteb/leaderboard/blob/main/config.yaml#L377-L398
This PR addresses that. I tested it locally with a private clone of this model README. You should rank #3 overall. Congratulations!
- Tom Aarsen
ai-forever
changed pull request status to
merged
I've refreshed MTEB for you, you're on there now.
- Tom Aarsen