Open LLaMA models are missing now?

#86
by DhanOS - opened

Hi!
What happened to the Open LLaMA models on the leaderboard? I wanted to see how the 13B version performs (after they finished training it) and none of these models can be found on the leaderboard anymore.

Open LLM Leaderboard org

Hi! The authors asked us to remove their models from the leaderboard because there was a problem with the tokenizer used. They are being re-run as we speak, and results will be back up soon!

clefourrier changed discussion status to closed

Thank you for the answer! I have one more question then - is this about the fast tokenizer that they mentioned on the model page?

DhanOS changed discussion status to open
Open LLM Leaderboard org

It's about the disrepancy between the fast and slow tokenizers :)

Ok, thank you! :)

Daniel

DhanOS changed discussion status to closed

Sign up or log in to comment