Can you or someone please quantize a Qwen2.5-32B-AGI-Q8_K-GGUF

#1
by CR2022 - opened

Can you or someone please quantize a Qwen2.5-32B-AGI-Q8?
Or provide me with the commands so I can do it I have the hardware for it.
(128GB RAM), 16GB VRAM.
Thank you in advance.

Sign up or log in to comment