Request gguf
#1
by
ayishfeng
- opened
Hey, can you convert Qwen2-VL-7B-Instruct-GPTQ to gguf(q8,q6,q4)
It works here, but I didn't succeed https://huggingface.co/spaces/ggml-org/gguf-my-repo
there is no lama.cpp support for Qwen2-VL....maybe soon there is a issue open on github