dtrejopizzo
/

capibara-17b-4bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

dtrejopizzo commited on Apr 20, 2023

Commit

c347ca0

•

1 Parent(s): 3e1bac9

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -1,7 +1,7 @@
 ** Model upgraded and finetuned starting from LlaMa model. I hope everyone creates modes starting from this open-source project**
 GPTQ conversion command (on CUDA branch):
-CUDA_VISIBLE_DEVICES=0 python llama.py ../capibara-17b-8bit c4 --wbits 4 --true-sequential --groupsize 128 --save capibara-17b-8bit-128g.pt
 Added 1 token to the tokenizer model:
 python llama-tools/add_tokens.py capibara-17b/tokenizer.model /content/tokenizer.model llama-tools/test_list.txt

 ** Model upgraded and finetuned starting from LlaMa model. I hope everyone creates modes starting from this open-source project**
 GPTQ conversion command (on CUDA branch):
+CUDA_VISIBLE_DEVICES=0 python llama.py ../capibara-17b-4bit c4 --wbits 4 --true-sequential --groupsize 128 --save capibara-17b-4bit-128g.pt
 Added 1 token to the tokenizer model:
 python llama-tools/add_tokens.py capibara-17b/tokenizer.model /content/tokenizer.model llama-tools/test_list.txt