LLaVA_int4 / README.md
emon-j's picture
Create README.md
3f2f86f
|
raw
history blame
No virus
550 Bytes

LLaVA Compress model weights to int4 using NNCF

LLaVA (Large Language and Vision Assistant) is large multimodal model that aims to develop a general-purpose visual assistant that can follow both language and image instructions to complete various real-world tasks.

LLaVA connects pre-trained CLIP ViT-L/14 visual encoder and large language model like Vicuna, LLaMa v2 or MPT, using a simple projection matrix. vlp_matrix.png