dclm-7b-it / tokenizer_config.json
EtashGuha's picture
Update tokenizer_config.json
027e430 verified
raw
history blame contribute delete
492 Bytes
{"chat_template": "Below is an instruction that describes a task.\n\nWrite a response that appropriately completes the request.\n\n### Instruction:\n{% if messages|length > 0 and messages[-1]['role'] == 'user' %}{{ messages[-1]['content'] }}{% else %}{{ raise_exception('Last message must be from user') }}{% endif %}\n\n### Response:", "unk_token": "<|endoftext|>", "bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "add_prefix_space": false, "tokenizer_class": "GPTNeoXTokenizer"}