kogpt2-chat / added_tokens.json
yoonhero's picture
add tokenizer
d718a1d
raw
history blame contribute delete
29 Bytes
{
"<|endoftext|>": 51200
}