Hugging Face's logo

matatonic
/
Qwen2.5-72B-Instruct-abliterated-v2-6.5bpw-h8-exl2

Text Generation
Transformers
Safetensors
English
qwen2
chat
conversational
text-generation-inference
Inference Endpoints
exl2
Model card Files Community
1
New discussion

Can you produce a 4.5bpw quantized model of this model?

2
#1 opened about 17 hours ago by
xldistance