Max number of tokens

#7
by Totole - opened

Hi!
Thanks a lot for your work :)

Just for confirmation, the max number of input tokens is 512 ?

Mixedbread org

yes, while deberta can take more tokens, it gets painfully slow and we also didn't test it for longer sequences.

aamirshakir changed discussion status to closed

Sign up or log in to comment