mlx-community
/

zephyr-7b-beta-4bit

Text Generation

Model card Files Files and versions Community

alvarobartt HF staff commited on Dec 27, 2023

Commit

fc53c2e

•

1 Parent(s): 127516c

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -8,7 +8,7 @@
     "norm_eps": 1e-05,
     "vocab_size": 32000,
     "sliding_window": 4096,
-    "quantization_config": {
         "group_size": 64,
         "bits": 4
     },

     "norm_eps": 1e-05,
     "vocab_size": 32000,
     "sliding_window": 4096,
+    "quantization": {
         "group_size": 64,
         "bits": 4
     },