Daedalus_1 / tokenizer_confkg.json
Or4cl3-1's picture
Update tokenizer_confkg.json
282db10 verified
{
"model_type": "blenderbot",
"vocab_size": 50257,
"bos_token_id": 0,
"eos_token_id": 2,
"unk_token_id": 1,
"pad_token_id": 3,
"mask_token_id": 50256
}