1 contributor

History: 42 commits

eaddario

Experimental quantize+prune Q3_K_L

fe6391a verified 9 days ago

imatrix
Generate Small imatrix about 1 month ago
logits
Rename to F16 about 1 month ago
scores
Generate perplexity and kld scores about 1 month ago
.gitattributes

1.65 kB

Update lfs attributes and ignores about 1 month ago
.gitignore

6.78 kB

Update lfs attributes and ignores about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-F16.gguf

15.2 GB
LFS

Rename to F16 about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_M.gguf

3.25 GB
LFS

Experimental quantize+prune IQ3_M 9 days ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_S.gguf

3.18 GB
LFS

Experimental quantize+prune IQ3_S 9 days ago
DeepSeek-R1-Distill-Qwen-7B-IQ4_NL.gguf

4.1 GB
LFS

Experimental quantize+prune IQ4_NL 9 days ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_L.gguf

3.76 GB
LFS

Experimental quantize+prune Q3_K_L 9 days ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_M.gguf

3.81 GB
LFS

Generate Q3_K_M quant about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_S.gguf

3.49 GB
LFS

Generate Q3_K_S quant about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_M.gguf

4.68 GB
LFS

Generate Q4_K_M quant about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_S.gguf

4.46 GB
LFS

Generate Q4_K_S quant about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_M.gguf

5.44 GB
LFS

Generate Q5_K_M quant about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_S.gguf

5.32 GB
LFS

Generate Q5_K_S quant about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-Q6_K.gguf

6.25 GB
LFS

Generate Q6_K quant about 1 month ago
DeepSeek-R1-Distill-Qwen-7B-Q8_0.gguf

8.1 GB
LFS

Generate Q8_0 quant about 1 month ago
README.md

9.64 kB

Update README.md 21 days ago