Qwen1.5 GGUF - a lmstudio-ai Collection

lmstudio-ai 's Collections

MetaAI's CodeLlama - Coding Assistant LLM

Vision Models (GGUF)

Coding

Tools Use (RAG, Function Calling)

Qwen1.5 GGUF

updated Feb 5

GGUF quants for the new Qwen1.5 model (https://qwenlm.github.io/blog/qwen1.5/)

Qwen/Qwen1.5-0.5B-Chat-GGUF

Text Generation • Updated Apr 9 • 4.71k • 26

Note With 0.5B parameters, this model runs extremely fast 🏎️💨
Qwen/Qwen1.5-1.8B-Chat-GGUF

Text Generation • Updated Apr 9 • 889 • 17

Note A good choice for machines with modest resources
Qwen/Qwen1.5-4B-Chat-GGUF

Text Generation • Updated Apr 9 • 519 • 12

Note A good choice for machines with modest resources
Qwen/Qwen1.5-7B-Chat-GGUF

Text Generation • Updated Apr 9 • 3.98k • 65

Note Same as the version featured on LM Studio's home page
Qwen/Qwen1.5-72B-Chat-GGUF

Text Generation • Updated Apr 9 • 155 • 62

Note 72B variant. Suitable for machines with ample resources