allenai
/

OLMo-7B-Twin-2T

Text Generation

Model card Files Files and versions Community

shanearora commited on Jun 25

Commit

6579759

•

1 Parent(s): 6bd9544

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -26,7 +26,7 @@
   "max_sequence_length": 2048,
   "mlp_hidden_size": 22016,
   "mlp_ratio": 4,
-  "model_type": "olmo",
   "multi_query_attention": false,
   "n_heads": 32,
   "n_layers": 32,

   "max_sequence_length": 2048,
   "mlp_hidden_size": 22016,
   "mlp_ratio": 4,
+  "model_type": "hf_olmo",
   "multi_query_attention": false,
   "n_heads": 32,
   "n_layers": 32,