Commit
•
eefa152
1
Parent(s):
8dcfe14
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,7 @@ CUDA_VISIBLE_DEVICES=0 python llama.py ./models/chavinlo-gpt4-x-alpaca
|
|
| 9 |
|
| 10 |
|
| 11 |
Prev. info
|
|
|
|
| 12 |
GPTQ 4bit quantization of: https://huggingface.co/chavinlo/gpt4-x-alpaca
|
| 13 |
Note: This was quantized with this branch of GPTQ-for-LLaMA: https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/triton
|
| 14 |
Because of this, it appears to be incompatible with Oobabooga at the moment. Stay tuned?
|
|
|
|
| 9 |
|
| 10 |
|
| 11 |
Prev. info
|
| 12 |
+
Quantized on GPTQ-for-LLaMa commit 5955e9c67d9bfe8a8144ffbe853c2769f1e87cdd
|
| 13 |
GPTQ 4bit quantization of: https://huggingface.co/chavinlo/gpt4-x-alpaca
|
| 14 |
Note: This was quantized with this branch of GPTQ-for-LLaMA: https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/triton
|
| 15 |
Because of this, it appears to be incompatible with Oobabooga at the moment. Stay tuned?
|