Quantized versions of MobileLLaMA-1.4B-Chat.

- Q4_K: [download link](https://huggingface.co./azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q4_K.gguf?download=true)
- Q5_K: [download link](https://huggingface.co./azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q5_K.gguf?download=true)
- Q6_K: [download link](https://huggingface.co./azarovalex/MobileLLaMA-1.4B-Chat-GGUF/resolve/main/MobileLLaMA-1.4B-Chat-Q6_K.gguf?download=true)

Original model: https://huggingface.co./mtgv/MobileLLaMA-1.4B-Chat