Missing `tokenizer.model`

#6
by abetlen - opened

Hi there, thank you for the amazing work on this model release. I was just curious because looking at the file manifest it seems to be missing the sentencepiece tokenizer model found in the other models in this 3.5 release. Is this vision-instruct model using the same one as mini-instruct?

Microsoft org

hi @abetlen , thanks for your interest. tokenizer.model is not needed for loading and using the model as tokenizer configs are provided.

abetlen changed discussion status to closed

Sign up or log in to comment