GPTQ 4-bit no actor version for compatibility that works in textgen-webui
Generated by using scripts from https://gitee.com/yhyu13/llama_-tools
Original weight : https://huggingface.co/VMware/open-llama-7b-open-instruct
- Downloads last month
- 4
Inference API (serverless) is not available, repository is disabled.