ibrahim1al's picture
Create config.json
ab1842b verified
raw
history blame contribute delete
246 Bytes
{
"model_type": "qwen2",
"hidden_size": 2048,
"num_attention_heads": 16,
"num_hidden_layers": 24,
"vocab_size": 51200,
"max_position_embeddings": 2048,
"bos_token_id": 1,
"eos_token_id": 2,
"pad_token_id": 0
}