qwp4w3hyb
/

Qwen1.5-32B-Chat-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

Qwen1.5-32B-Chat-iMat-GGUF

1 contributor

History: 15 commits

qwp4w3hyb's picture

Add ./qwen1.5-32b-chat-imat-Q5_K_M.gguf

f661384 unverified 7 months ago

.gitattributes

2.41 kB

Add ./qwen1.5-32b-chat-imat-Q5_K_M.gguf 7 months ago
README.md

868 Bytes

Improve README.md 7 months ago
imat-f16-gmerged.dat
14.9 MB
LFS

Add imat-f16-gmerged.dat 7 months ago
qwen1.5-32b-chat-imat-IQ1_S.gguf
7.22 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ1_S.gguf 7 months ago
qwen1.5-32b-chat-imat-IQ2_M.gguf
11.2 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ2_M.gguf 7 months ago
qwen1.5-32b-chat-imat-IQ2_S.gguf
10.3 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ2_S.gguf 7 months ago
qwen1.5-32b-chat-imat-IQ2_XS.gguf
9.89 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ2_XS.gguf 7 months ago
qwen1.5-32b-chat-imat-IQ3_M.gguf
14.7 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ3_M.gguf 7 months ago
qwen1.5-32b-chat-imat-IQ3_S.gguf
14.3 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ3_S.gguf 7 months ago
qwen1.5-32b-chat-imat-IQ3_XS.gguf
13.6 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ3_XS.gguf 7 months ago
qwen1.5-32b-chat-imat-IQ4_NL.gguf
18.5 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ4_NL.gguf 7 months ago
qwen1.5-32b-chat-imat-IQ4_XS.gguf
17.6 GB
LFS

Add ./qwen1.5-32b-chat-imat-IQ4_XS.gguf 7 months ago
qwen1.5-32b-chat-imat-Q4_K_M.gguf
19.7 GB
LFS

Add ./qwen1.5-32b-chat-imat-Q4_K_M.gguf 7 months ago
qwen1.5-32b-chat-imat-Q4_K_S.gguf
18.6 GB
LFS

Add ./qwen1.5-32b-chat-imat-Q4_K_S.gguf 7 months ago
qwen1.5-32b-chat-imat-Q5_K_M.gguf
23.1 GB
LFS

Add ./qwen1.5-32b-chat-imat-Q5_K_M.gguf 7 months ago