houghtob123
/

Falcon3-MoE-2x7B-Instruct-Q4_0

Inference Endpoints

Model card Files Files and versions Community

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co./docs/hub/model-cards#model-card-metadata)

A Q4_0 quant using the newest Llama.cpp (1/9/2025).

base_model: - ehristoforu/Falcon3-MoE-2x7B-Insruct

Downloads last month: 55

GGUF

Model size

13.4B params

Architecture

llama

4-bit

Inference API

Unable to determine this model's library. Check the docs .