add chat template to tokenizer_config.json
#111
by
epignatelli
- opened
The current tokeniser uses the default (inappropriate) chat template.
This PR adds the correct chate template following https://github.com/chujiezheng/chat_templates.
You can find the easy-to-read version of the template at: https://github.com/chujiezheng/chat_templates/blob/main/chat_templates/falcon.jinja
Thanks a lot π€
nilabhra
changed pull request status to
merged