Broken "K" Quants

#1
by mishima - opened

Hi, thanks a lot for this model, you're a legend ;) Just curious if this model is also affected by broken "K" quants? or only original mixtral finetunes?

They are all affected as much as I know, but this change in the near future.
Will probably need to requant all my shit haha

They are all affected as much as I know, but this change in the near future.
Will probably need to requant all my shit haha

Got it, waiting for updated ones :)

Sign up or log in to comment