AutoGPTQ model loader crashes in text-gen-webui
#19
by
KitsuCha
- opened
Please make sure you're using the latest version of text-generation-webui
Click the Model tab.
Under Download custom model or LoRA, enter TheBloke/WizardCoder-15B-1.0-GPTQ.
Click Download.
The model will start downloading. Once it's finished it will say "Done"
In the top left, click the refresh icon next to Model.
In the Model dropdown, choose the model you just downloaded: WizardCoder-15B-1.0-GPTQ
The model will automatically load, and is now ready for use! <---β NO IT DOES NOT, you need to choose model loader and click LOAD
After I choose AutoGPTQ, it just outright crashes and that is it.
Anybody got anything like that?