GGUF quants available
#1
by
mradermacher
- opened
Judging from the daybreak-mixtral model card, this must be quite the perverted model with lots of secret sauce :)
In any case, I made static and imatrix quants of this model, in hope of this being useful:
https://huggingface.co./mradermacher/daybreak-miqu-1-70b-v1.0-hf-GGUF
https://huggingface.co./mradermacher/daybreak-miqu-1-70b-v1.0-hf-i1-GGUF
Cheers!
Thanks!
Edit: Wow, that's very nice. I added links to those in the model card(s).
Cool! If you think it helps, I am open to quantize other models, btw.
mradermacher
changed discussion status to
closed
Could someone upload to ollama?