Hugging Face's logo

TheBloke
/
KAI-7B-Instruct-GPTQ

Text Generation
Transformers
Safetensors
mistral
finetuned
Instruct
code
conversational
text-generation-inference
4-bit precision
gptq
Model card Files Community
1

Can you please help me quantize vivo-ai/BlueLM-7B-Chat to int8?

#1
by dafen - opened
Discussion
dafen

vivo-ai/BlueLM-7B-Chat
https://huggingface.co/vivo-ai/BlueLM-7B-Chat

Sign up or log in to comment