Hugging Face's logo

zetasepic
/
Qwen2.5-32B-Instruct-abliterated-pass2-gguf

GGUF
Inference Endpoints
Model card Files Community
1

Q4_K_M?

#1
by eepos - opened
Discussion
eepos

Could you make a Q4_K_M for us 24GB havers? <3

xhyi

Also, please an IQ4_XS?

zetasepic
 Owner

Q4_K_M and IQ4_XS quant files have been uploaded.

Sign up or log in to comment