mradermacher
/

Qwen1.5-MoE-A2.7B-20-experts-SFT-trained-GGUF

Inference Endpoints

Model card Files Files and versions Community

Qwen1.5-MoE-A2.7B-20-experts-SFT-trained-GGUF

1 contributor

History: 16 commits

mradermacher's picture

auto-patch README.md

26f2ba1 verified 2 months ago

.gitattributes

2.67 kB

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.IQ4_XS.gguf
3.37 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q2_K.gguf
2.51 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q3_K_L.gguf
3.28 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q3_K_M.gguf
3.14 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q3_K_S.gguf
2.9 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q4_0_4_4.gguf
3.47 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q4_K_M.gguf
3.95 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q4_K_S.gguf
3.66 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q5_K_M.gguf
4.51 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q5_K_S.gguf
4.27 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q6_K.gguf
5.27 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.Q8_0.gguf
6.39 GB
LFS

uploaded from db1 2 months ago
Qwen1.5-MoE-A2.7B-20-experts-SFT-trained.f16.gguf
12 GB
LFS

uploaded from db1 2 months ago
README.md

4.2 kB

auto-patch README.md 2 months ago