Update for 1.64

#1
by Bit101 - opened

Could you update the quants for this model to work with kcpp v1.64 like you have for some of your other L3 quants? This has been my favorite model so far so I'd like to see how an updated version would perform.

I'll try to get to this, got a few things to do first.

In the meantime, this is the successor of Average Normie:

https://huggingface.co./Lewdiculous/SOVL_Llama3_8B-GGUF-IQ-Imatrix

I believe you can have a similar or better experience, if you face issues let me know.

I've tried SOVL and wasn't a fan of how it inserted asterisks in formats that didn't use them. I'm re-downloading it along with some other fixed quants to see if 1.64 has changed that.

I see, um, SOVL was an experiment to force asterisks, yeah... Well then. I'll do this one too then since it's unique in that aspect.

@Bit101 Re-uploaded.

Lewdiculous changed discussion status to closed

Sign up or log in to comment