menhior's picture
Upload tokenizer
c916f69
raw
history blame contribute delete
60 Bytes
{
"</s>": 38,
"<s>": 37,
"[PAD]": 36,
"[UNK]": 35
}