GGUF model commit (made with llama.cpp commit df9d129)

1303dc3 11 months ago

.gitattributes

2.16 kB

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
README.md

22.6 kB

Upload README.md 11 months ago
config.json

26 Bytes

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q2_K.gguf

2.62 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q3_K_L.gguf

3.24 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q3_K_M.gguf

2.99 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q3_K_S.gguf

2.71 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q4_0.gguf

3.48 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q4_K_M.gguf

3.67 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q4_K_S.gguf

3.5 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q5_0.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q5_K_M.gguf

4.3 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q5_K_S.gguf

4.2 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q6_K.gguf

4.97 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago
yi-6b.Q8_0.gguf

6.44 GB
LFS

GGUF model commit (made with llama.cpp commit a75fa57) 11 months ago