File size: 1,541 Bytes
a6bbba1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 |
---
license: other
language:
- en
base_model:
- Qwen/Qwen2.5-72B-Instruct
- anthracite-org/magnum-v1-72b
---
# Magnum-v1-72b-Qwen2.5
A merge of the OG [QwenV2](https://huggingface.co/Qwen/Qwen2-72B-Instruct)-based [anthracite-org/magnum-v1-72b](https://huggingface.co/anthracite-org/magnum-v1-72b) with the new [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct)
## Model Details
- **Base Model**: [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct)
- **Influence Model**: [anthracite-org/magnum-v1-72b](https://huggingface.co/anthracite-org/magnum-v1-72b)
- **Method**: LoRA extraction from Magnum-v1 and then applied to Qwen2.5-Instruct
## Process
1. A LoRA was extracted from [anthracite-org/magnum-v1-72b](https://huggingface.co/anthracite-org/magnum-v1-72b) and [Qwen/Qwen2-72B-Instruct](https://huggingface.co/Qwen/Qwen2-72B-Instruct)
2. This LoRA was then applied to [Qwen/Qwen2.5-72B-Instruct](https://huggingface.co/Qwen/Qwen2.5-72B-Instruct).
3. The resulting model was merged to create this standalone version.
## Prompt Template
```py
"""<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant
"""
```
## Results
It seems to have worked in my testing. Just as "creative" as the OG magnum-v1, and seems to have retained the improvements of Qwen2.5
(eg. it can zero-shot code a snake game in python and is aware of world events which happened after QwenV2 released) |