vit-rugpt3-medium-pushkin / added_tokens.json
AnyaSchen's picture
Upload tokenizer
8be1cfc
raw
history blame
83 Bytes
{
"<bos>": 50258,
"<eos>": 50259,
"<sep>": 50260,
"<|endoftext|>": 50257
}