Tokenizer causing OOM
#1
by
sunjungyum
- opened
Hi, I'm working on a project that uses BioVil. I am getting an OOM error on Cuda that I've narrowed down to the pre-trained BioVil tokenizer. When this is imported I get the OOM error whereas when I use another tokenizer I do not. Has anyone run into this issue?