How to use instructblip with new LLMs
#9
by
louis030195
- opened
Curious what should i do to upgrade this to new models like mistral etc.? Thanks 🙏
Hi
@louis030195
Thanks for the issue, I am not sure this would be possible to support out of the box as each instructblip checkpoints have modules that have been specifically fine-tuned for some specific LLMs (vicuna, etc.), therefore unless the salesforce team releases new Instructblip checkpoints with the newest LLMs I think there is nothing much we can do.
ybelkada
changed discussion status to
closed