| library_name: transformers | |
| base_model: | |
| - Qwen/Qwen2.5-7B-Instruct | |
| license: apache-2.0 | |
| [](https://hf.co/QuantFactory) | |
| # QuantFactory/Replete-LLM-V2.5-Qwen-7b-GGUF | |
| This is quantized version of [Replete-AI/Replete-LLM-V2.5-Qwen-7b](https://huggingface.co/Replete-AI/Replete-LLM-V2.5-Qwen-7b) created using llama.cpp | |
| # Original Model Card | |
| # Replete-LLM-V2.5-Qwen-7b | |
|  | |
| Replete-LLM-V2.5-Qwen-7b is a continues finetuned version of Qwen2.5-7B. I noticed recently that the Qwen team did not learn from my methods of continuous finetuning, the great benefits, and no downsides of it. So I took it upon myself to merge the instruct model with the base model myself using the *Ties* merge method | |
| This version of the model shows higher performance than the original instruct and base models. | |
| Quants: | |
| GGUF: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-7b-GGUF | |
| Benchmarks: (Coming soon) | |