max context length 256 or 512 ?
#9
by
OrianeN
- opened
Thank you for sharing this model which looks promising for my application !
Could you please confirm whether the max context length is 256 or 512 ?
- in the
README.md
I found "Piiranha is a fine-tuned version of microsoft/mdeberta-v3-base. The context length is 256 Deberta tokens. If your text is longer than that, just split it up." - yet in
config.json
I found"max_position_embeddings": 512
as well as"position_buckets": 256
- and I got nothing when trying to print
tokenizer.model_max_length
in my Python terminal