shuyuej
/

Meta-Llama-3-70B-Instruct-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shuyuej commited on Jul 25

Commit

2ef5d6a

•

1 Parent(s): fa3e4f4

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -1,5 +1,5 @@
 {
-  "_name_or_path": "meta-llama/Meta-Llama-3-70B-Instruct",
   "architectures": [
     "LlamaForCausalLM"
   ],

 {
+  "_name_or_path": "shuyuej/Meta-Llama-3-70B-Instruct-GPTQ",
   "architectures": [
     "LlamaForCausalLM"
   ],