vit-rugpt3-large-poetry-ft / added_tokens.json
AnyaSchen's picture
Upload tokenizer
d69636a
raw
history blame contribute delete
83 Bytes
{
"<bos>": 50258,
"<eos>": 50259,
"<sep>": 50260,
"<|endoftext|>": 50257
}