qualcomm
/

Baichuan2-7B

@@ -15,11 +15,13 @@ tags:
 # Baichuan2-7B: Optimized for Mobile Deployment
 ## State-of-the-art large language model useful on a variety of language understanding and generation tasks
 Baichuan2-7B is a family of LLMs. It achieves the state-of-the-art performance of its size on standard Chinese and English authoritative benchmarks (C-EVAL/MMLU). 4-bit weights and 16-bit activations making it suitable for on-device deployment. For Prompt and output length specified below, the time to first token is Baichuan2-PromptProcessor-Quantized's latency and average time per addition token is Baichuan2-TokenGenerator-Quantized's latency.
-This is based on the implementation of Baichuan2-7B found
-[here]({source_repo}). More details on model performance
-accross various devices, can be found [here](https://aihub.qualcomm.com/models/baichuan2_7b_quantized).
 ### Model Details

 # Baichuan2-7B: Optimized for Mobile Deployment
 ## State-of-the-art large language model useful on a variety of language understanding and generation tasks
 Baichuan2-7B is a family of LLMs. It achieves the state-of-the-art performance of its size on standard Chinese and English authoritative benchmarks (C-EVAL/MMLU). 4-bit weights and 16-bit activations making it suitable for on-device deployment. For Prompt and output length specified below, the time to first token is Baichuan2-PromptProcessor-Quantized's latency and average time per addition token is Baichuan2-TokenGenerator-Quantized's latency.
+This model is an implementation of Posenet-Mobilenet found [here](https://github.com/baichuan-inc/Baichuan-7B/).
+More details on model performance accross various devices, can be found [here](https://aihub.qualcomm.com/models/baichuan2_7b_quantized).
 ### Model Details