upstage
/

Llama-2-70b-instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Limerobot commited on Jul 30, 2023

Commit

8469429

•

1 Parent(s): 4aa3328

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -56,7 +56,7 @@ We used the [lm-evaluation-harness repository](https://github.com/EleutherAI/lm-
 | Model                                         | Average | ARC   | HellaSwag | MMLU  | TruthfulQA |
 |-----------------------------------------------|---------|-------|-----------|-------|------------|
 | Llama-2-70b-instruct-v2 (Ours, Local Reproduction) | 72.7 | 71.6 | 87.7 | 69.7 | 61.6 |
-| Llama-2-70b-instruct-1024 (***Ours***, ***Local Reproduction***) | **72.0** | **70.7** | **87.4** | **69.3** | **60.7** |
 | llama-65b-instruct (Ours, Local Reproduction) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 |
 | Llama-2-70b-hf | 67.3 | 67.3 | 87.3 | 69.8 | 44.9 |
 | llama-30b-instruct-2048 (Ours, Open LLM Leaderboard) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 |

 | Model                                         | Average | ARC   | HellaSwag | MMLU  | TruthfulQA |
 |-----------------------------------------------|---------|-------|-----------|-------|------------|
 | Llama-2-70b-instruct-v2 (Ours, Local Reproduction) | 72.7 | 71.6 | 87.7 | 69.7 | 61.6 |
+| ***Llama-2-70b-instruct-1024*** (***Ours***, ***Local Reproduction***) | **72.0** | **70.7** | **87.4** | **69.3** | **60.7** |
 | llama-65b-instruct (Ours, Local Reproduction) | 69.4 | 67.6 | 86.5 | 64.9 | 58.8 |
 | Llama-2-70b-hf | 67.3 | 67.3 | 87.3 | 69.8 | 44.9 |
 | llama-30b-instruct-2048 (Ours, Open LLM Leaderboard) | 67.0 | 64.9 | 84.9 | 61.9 | 56.3 |