lez-src / special_tokens_map.json
michelleyunun's picture
Upload tokenizer
cf4487d
{
"eos_token": "<end>",
"pad_token": "<pad>"
}