Wow thanks

#1
by Yuma42 - opened

Thank you for the iquants of my models. But I would like to point you to my best models, the ones which you quantized are more experimental and I expect them to perform worse.

This one should be my best model:
https://huggingface.co./Yuma42/KangalKhan-RawRuby-7B

And these two might also be interesting:
https://huggingface.co./Yuma42/KangalKhan-RawEmerald-7B
https://huggingface.co./Yuma42/KangalKhan-Ruby-7B-Fixed

If you would quant them, I could link them to your quants, I just made Q4S quants for them.

(just to clarify i made static i-quants of them, not imatrix i-quants, btw. I can also make imatrix ones, but I usually only do so when explicitly requested)

Anyway, sure, I'll be happy to add those. They should be available within a few hours. Don't hesitate to tell me about any future models you would like quants for.

mradermacher changed discussion status to closed

Sign up or log in to comment