Made directly from https://huggingface.co./Qwen/Qwen1.5-32B-Chat
I converted original model to f32 first.
3-bit
4-bit
5-bit
6-bit