liminerity
/

m7-64-bitnet-alpaca-3

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

gate369 commited on Jun 17

Commit

2c9e6a5

•

1 Parent(s): ec729c7

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -14,7 +14,7 @@
   "max_position_embeddings": 2048,
   "model_type": "mistral",
   "num_attention_heads": 8,
-  "num_hidden_layers": 36,
   "num_key_value_heads": 8,
   "pad_token_id": 0,
   "rms_norm_eps": 1e-05,

   "max_position_embeddings": 2048,
   "model_type": "mistral",
   "num_attention_heads": 8,
+  "num_hidden_layers": 6,
   "num_key_value_heads": 8,
   "pad_token_id": 0,
   "rms_norm_eps": 1e-05,