Armin Mehrabian
tokenizer confige and special tokens updated.
8b99bac
raw
history blame contribute delete
75 Bytes
{
"</s>": 2,
"<mask>": 50264,
"<pad>": 1,
"<s>": 0,
"<unk>": 3
}