turn-detector / added_tokens.json
jeradf's picture
Upload tokenizer
2c53b1e verified
raw
history blame contribute delete
50 Bytes
{
"<|assistant|>": 49153,
"<|user|>": 49152
}