metadata
license: apache-2.0
Base Model - SOLAR-10.7B
This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.
Please check specific details in the GitHub Repository.
GitHub Repository: https://github.com/gauss5930/iDUS
🏆 HuggingFace Open LLM Leaderboard
| Model | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K | Average |
|---|---|---|---|---|---|---|---|
| Llama2_init_Mistral | 60.07 | 83.3 | 64.09 | 42.15 | 78.37 | 37.91 | 60.98 |