Hugging Face's logo

ibm-research
/
granite-vision-3.2-2b-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co./docs/hub/model-cards#model-card-metadata)

This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.

Please reference the base model's model card here: https://huggingface.co./ibm-granite/granite-vision-3.2-2b

Downloads last month
106
GGUF
Model size
2.53B params
Architecture
granite

4-bit

5-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including ibm-research/granite-vision-3.2-2b-GGUF