ddo-src / special_tokens_map.json
michelleyunun's picture
Upload tokenizer
ca25ed2
raw
history blame
51 Bytes
{
"eos_token": "<end>",
"pad_token": "<pad>"
}