Neuracraft / tokenizer_config.json
Erfan11's picture
Update tokenizer_config.json
5490a28 verified
raw
history blame contribute delete
78 Bytes
{
"model_max_length": 512,
"padding": "max_length",
"truncation": true
}