unsloth
/

Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

Training with images

#6 opened about 18 hours ago by

AttributeError: Model MllamaForConditionalGeneration does not support BitsAndBytes quantization yet.

#5 opened 10 days ago by

How much vram needed?

#4 opened 27 days ago by

How load this model?

#3 opened about 1 month ago by

Can you post the script that was used to quantize this model please?

#2 opened about 2 months ago by

ctranslate2-4you