PretrainedTokenizerFast has no attribute 'legacy'

#43
by tian9 - opened

Hello, I want to change the LLAVA's base model from llama2 to llama3 and I encountered this problem during fine-tuning the pretrained model:
72457c4a5fee3a7b013993a42ecb79fc.png
Should I recognize this as a version dismatch ? I have searched the doc in transformers for the 'legacy', but gain nothing. How can I resolve this problem?
I have tried to delete this 'if not tokenizer.legacy', but run .sh comes with a tokenizer mismatch.

image.png

tian9 changed discussion status to closed

@tian9 were you able to resolve this issue?

Have you solved the problem yet?

@Varleria @ritwickchaudhryamazon It's because my model dir name is incorrect, thus i came in a incorrect if-else branch.

Sign up or log in to comment