TheBloke commited on
Commit
a87f40d
1 Parent(s): 3afc956

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -307,6 +307,11 @@ And thank you again to a16z for their generous grant.
307
 
308
  <p><h1> speechless-tora-code-7b-v1.0 </h1></p>
309
 
 
 
 
 
 
310
  Use the following dataset to fine-tune llm_agents/tora-code-7b-v1.0 in order to improve the model's reasoning and planning abilities.
311
 
312
  Total 201,981 samples.
 
307
 
308
  <p><h1> speechless-tora-code-7b-v1.0 </h1></p>
309
 
310
+ * [AWQ model(s) for GPU inference.](https://huggingface.co/TheBloke/speechless-tora-code-7B-v1.0-AWQ)
311
+ * [GPTQ models for GPU inference, with multiple quantisation parameter options.](https://huggingface.co/TheBloke/speechless-tora-code-7B-v1.0-GPTQ)
312
+ * [2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference](https://huggingface.co/TheBloke/speechless-tora-code-7B-v1.0-GGUF)
313
+
314
+
315
  Use the following dataset to fine-tune llm_agents/tora-code-7b-v1.0 in order to improve the model's reasoning and planning abilities.
316
 
317
  Total 201,981 samples.