Spaces:

mteb

/

leaderboard

like 4.13k

Running on CPU Upgrade

I think rather than removing Silvan from the credits, you should add yourself alongside him. Their work looks like: https://github.com/ClimSocAna/tecb-de

sorry it was by mistake!

thanks for informing me it was a copy paste overwrite

@KennethEnevoldsen so I have this PR here and have evaluated multiple german and multilingual models, like multilingual e5, gbert, xlm roberta, ...
I am currently trying to format those results but it does not seem to work straight away with "mteb_meta.py" - any idea? I just get a blank metadata file:

tags:

• mteb
  model-index:
• name: gbert-large
  results:

it gives this for every dataset:
WARNING:mteb.evaluation.MTEB:Passing task names as strings is deprecated and will be removed in the next release. Please use tasks = mteb.get_tasks(tasks=[...]) method to get tasks instead.
INFO:main:Skipping AmazonCounterfactualClassification as split test not present.
WARNING:mteb.evaluation.MTEB:Passing task names as strings is deprecated and will be removed in the next release. Please use tasks = mteb.get_tasks(tasks=[...]) method to get tasks instead.
INFO:main:Skipping AmazonReviewsClassification as split test not present.