LnL-AI
/

TinyLlama-1.1B-intermediate-step-1341k-3T-autoround-lm_head-symFalse

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qubitium commited on Jul 24

Commit

04fa8e9

•

1 Parent(s): 88c66d0

Update config.json

Files changed (1) hide show

config.json +2 -2

config.json CHANGED Viewed

@@ -29,8 +29,8 @@
       "iters": 400,
       "lr": 0.0025,
       "minmax_lr": 0.0025,
-      "packer": "gptqmodel:0.9.0",
-      "quantizer": "intel/auto-round:0.1",
       "scale_dtype": "torch.float16",
       "use_quant_input": false
     },

       "iters": 400,
       "lr": 0.0025,
       "minmax_lr": 0.0025,
+      "quantizer": "gptqmodel:0.9.0",
+      "auto_round": "0.1",
       "scale_dtype": "torch.float16",
       "use_quant_input": false
     },