Tokenizer causing OOM

#1
by sunjungyum - opened

Hi, I'm working on a project that uses BioVil. I am getting an OOM error on Cuda that I've narrowed down to the pre-trained BioVil tokenizer. When this is imported I get the OOM error whereas when I use another tokenizer I do not. Has anyone run into this issue?

Sign up or log in to comment