Does this model support fill-in-the-middle?
#5
by
sam-kap
- opened
Like the title says, it would be nice to use this as a local alternative to copilot.
In special_tokens_map.json, It does have <fim_prefix> stuffs. It seems supports fim？🤔
That's a good point, it looks like these are the fim tokens: https://huggingface.co./replit/replit-code-v1_5-3b/blob/main/special_tokens_map.json#L3-L7
It would be nice to have some documentation around it
This particular version of the model has not been trained for FIM.
The tokenizer vocabulary has the tokens for it for forward compatibility reasons. :)
madhavatreplit
changed discussion status to
closed