Modelfile of Llama-3.2-11B-Vision-Instruct
#2
pinned
by
hoseaho
- opened
Hallo, thanks for your work on the GGUF of the Llama-3.2-11B-Vision-Instruct. I want to use Ollama to load the model for testing. Do you have the template for the Modelfile?
FROM ./Llama-3.2-11B-Vision-Instruct.Q4_K_M.gguf
FROM ./Llama-3.2-11B-Vision-Instruct-mmproj.f16.gguf
TEMPLATE """{{- range $i, $_ := .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|>
{{ .Content }}<|eot_id|>
{{- end }}<|start_header_id|>assistant<|end_header_id|>
"""
PARAMETER temperature 0
PARAMETER top_p 0.9
leafspark
pinned discussion
Hello, I'm interested in testing this model out. But I'm using LM Studio and it keeps through the following error.
llama.cpp error: 'error loading model architecture: unknown model architecture: 'mllama''
Is there something I'm missing or needing to edit to get lm studio to recognize this? Sorry for the N00b question.
does the GGUF version of this run on LM Studio? getting same error message