Update README.md
Browse files
README.md
CHANGED
@@ -58,7 +58,11 @@ The `safetensors` model file was created with the latest GPTQ code, and uses `--
|
|
58 |
|
59 |
If you want to use the `safetensors` file and need to update GPTQ-for-LLaMa, here are the commands I used to clone the Triton branch of GPTQ-for-LLaMa, clone text-generation-webui, and install GPTQ into the UI:
|
60 |
```
|
61 |
-
|
|
|
|
|
|
|
|
|
62 |
git clone https://github.com/oobabooga/text-generation-webui
|
63 |
mkdir -p text-generation-webui/repositories
|
64 |
ln -s GPTQ-for-LLaMa text-generation-webui/repositories/GPTQ-for-LLaMa
|
|
|
58 |
|
59 |
If you want to use the `safetensors` file and need to update GPTQ-for-LLaMa, here are the commands I used to clone the Triton branch of GPTQ-for-LLaMa, clone text-generation-webui, and install GPTQ into the UI:
|
60 |
```
|
61 |
+
# We need to clone GPTQ-for-LLaMa as of April 13th, due to breaking changes in more recent commits
|
62 |
+
git clone -n https://github.com/qwopqwop200/GPTQ-for-LLaMa gptq-safe
|
63 |
+
cd gptq-safe && git checkout 58c8ab4c7aaccc50f507fd08cce941976affe5e0
|
64 |
+
|
65 |
+
# Now clone text-generation-webui, if you don't already have it
|
66 |
git clone https://github.com/oobabooga/text-generation-webui
|
67 |
mkdir -p text-generation-webui/repositories
|
68 |
ln -s GPTQ-for-LLaMa text-generation-webui/repositories/GPTQ-for-LLaMa
|