suayptalha
/

Komodo-Llama-3.2-3B-v2

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

suayptalha commited on 1 day ago

Commit

898f8f8

•

1 Parent(s): 66e0aeb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -117,7 +117,7 @@ model-index:
 This version of Komodo is a Llama-3.2-3B-Instruct finetuned model on jeggers/competition_math dataset to increase math performance of the base model.
-This model is 4bit-quantizated. You should import it 8bit if you want to use 3B parameters!
 Make sure you installed 'bitsandbytes' library before import.
 Finetune system prompt:

 This version of Komodo is a Llama-3.2-3B-Instruct finetuned model on jeggers/competition_math dataset to increase math performance of the base model.
+This model is 4bit-quantized. You should import it 8bit if you want to use 3B parameters!
 Make sure you installed 'bitsandbytes' library before import.
 Finetune system prompt: