YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co./docs/hub/model-cards#model-card-metadata)

IMPORTANT!!!!!

This gguf model is outputting in latin. probably because quantization it self is wrong. I will later quantize it with Apples mlx framework the model will then be in .safetensors format.

Downloads last month
123
GGUF
Model size
3.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.