Edit model card

Base Model - SOLAR-10.7B

This model is the base model implementation of SOLAR-10.7B. The architecture of base model is Llama2 architecture and initialized with weights of Mistral.

Please check specific details in the GitHub Repository.

GitHub Repository: https://github.com/gauss5930/iDUS

πŸ† HuggingFace Open LLM Leaderboard

Model ARC HellaSwag MMLU TruthfulQA Winogrande GSM8K Average
Llama2_init_Mistral 60.07 83.3 64.09 42.15 78.37 37.91 60.98
Downloads last month
677
Safetensors
Model size
7.24B params
Tensor type
FP16
Β·
Inference Examples
Inference API (serverless) is not available, repository is disabled.

Spaces using Cartinoe5930/Llama2_init_Mistral 3

Collection including Cartinoe5930/Llama2_init_Mistral