rubra-ai
/

Meta-Llama-3-70B-Instruct-AWQ

Text Generation

function-calling

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

sanjay920 commited on Jul 4

Commit

40fb23a

•

1 Parent(s): 2aa006f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -64,7 +64,7 @@ Original model: [rubra-ai/Meta-Llama-3-70B-Instruct](https://huggingface.co/rubr
 AWQ quant config:
 ```
-quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
 ```
 ## Model description

 AWQ quant config:
 ```
+{ "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }
 ```
 ## Model description