leaderboard-pr-bot
commited on
Commit
•
543bab0
1
Parent(s):
b35e0cd
Adding Evaluation Results
Browse filesThis is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr
The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.
If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions
README.md
CHANGED
@@ -271,3 +271,17 @@ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-le
|
|
271 |
|Winogrande (5-shot) |79.95|
|
272 |
|GSM8k (5-shot) |44.81|
|
273 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
271 |
|Winogrande (5-shot) |79.95|
|
272 |
|GSM8k (5-shot) |44.81|
|
273 |
|
274 |
+
|
275 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
276 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_PulsarAI__Einstein-v3-7B)
|
277 |
+
|
278 |
+
| Metric |Value|
|
279 |
+
|---------------------------------|----:|
|
280 |
+
|Avg. |64.09|
|
281 |
+
|AI2 Reasoning Challenge (25-Shot)|62.29|
|
282 |
+
|HellaSwag (10-Shot) |83.01|
|
283 |
+
|MMLU (5-Shot) |63.32|
|
284 |
+
|TruthfulQA (0-shot) |51.18|
|
285 |
+
|Winogrande (5-shot) |79.95|
|
286 |
+
|GSM8k (5-shot) |44.81|
|
287 |
+
|