Error Loading Model

#8
by danielelongo - opened

Hello, when i try ./llama-server -m ./models/llava-v1.6-mistral-7b.Q5_K_S.gguf, i get:
llama_model_load: error loading model: tensor 'blk.3.ffn_gate.weight' data is not within the file bounds, model is corrupted or incomplete.
Am I doing something wrong?

danielelongo changed discussion status to closed
Owner

llama-server does not support multimodal

Sign up or log in to comment