leaderboard-pr-bot commited on
Commit
facdadc
1 Parent(s): 1dce7b0

Adding Evaluation Results

Browse files

This is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr

The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.

If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions

Files changed (1) hide show
  1. README.md +18 -5
README.md CHANGED
@@ -1,12 +1,12 @@
1
  ---
 
 
 
 
2
  base_model: abhinand/dr-llama-te-instruct-v0
3
  model-index:
4
  - name: telugu-llama-instruct-v0.1
5
  results: []
6
- license: llama2
7
- language:
8
- - en
9
- - te
10
  ---
11
 
12
  # Telugu LLaMA 7B Instruct v0.1
@@ -171,4 +171,17 @@ If you use this model or any of the the Tamil-Llama related work in your researc
171
  }
172
  ```
173
 
174
- We hope this model serves as a valuable tool in your NLP toolkit and look forward to seeing the advancements it will enable in the understanding and generation of the Tamil language.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - te
5
+ license: llama2
6
  base_model: abhinand/dr-llama-te-instruct-v0
7
  model-index:
8
  - name: telugu-llama-instruct-v0.1
9
  results: []
 
 
 
 
10
  ---
11
 
12
  # Telugu LLaMA 7B Instruct v0.1
 
171
  }
172
  ```
173
 
174
+ We hope this model serves as a valuable tool in your NLP toolkit and look forward to seeing the advancements it will enable in the understanding and generation of the Tamil language.
175
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
176
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_abhinand__telugu-llama-7b-instruct-v0.1)
177
+
178
+ | Metric |Value|
179
+ |---------------------------------|----:|
180
+ |Avg. |39.77|
181
+ |AI2 Reasoning Challenge (25-Shot)|37.12|
182
+ |HellaSwag (10-Shot) |67.92|
183
+ |MMLU (5-Shot) |23.12|
184
+ |TruthfulQA (0-shot) |49.05|
185
+ |Winogrande (5-shot) |61.40|
186
+ |GSM8k (5-shot) | 0.00|
187
+