LlamaEdge compatible quants for Qwen2.5-Coder models.
-
second-state/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation • Updated • 404 -
second-state/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation • Updated • 321 -
second-state/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation • Updated • 481 -
second-state/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation • Updated • 550