vit-rugpt3-medium-esenin / added_tokens.json
AnyaSchen's picture
Upload tokenizer
f1ed397
raw
history blame
83 Bytes
{
"<bos>": 50258,
"<eos>": 50259,
"<sep>": 50260,
"<|endoftext|>": 50257
}