Hessian is not invertible
#1
by
denru
- opened
Have you ever encountered this error while quantizing this model? I tried to quantize the 3.0bpw and 2.5bpw ones (for speculative decoding), but kept getting this error.
Would you mind creating these two quants? Thanks!
I have encountered it in the past but not here, it's odd you're getting it... I can probably make those yeah