afrideva
/

Yi-1.5-6B-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

1 contributor

History: 9 commits

afrideva's picture

Upload yi-1.5-6b.Q8_0.gguf with huggingface_hub

bc11751 verified 6 months ago

.gitattributes

1.92 kB

Upload yi-1.5-6b.Q8_0.gguf with huggingface_hub 6 months ago
README.md

4.64 kB

Upload README.md with huggingface_hub 6 months ago
yi-1.5-6b.Q2_K.gguf

2.34 GB
LFS

Upload yi-1.5-6b.Q2_K.gguf with huggingface_hub 6 months ago
yi-1.5-6b.Q3_K_M.gguf

2.99 GB
LFS

Upload yi-1.5-6b.Q3_K_M.gguf with huggingface_hub 6 months ago
yi-1.5-6b.Q4_K_M.gguf

3.67 GB
LFS

Upload yi-1.5-6b.Q4_K_M.gguf with huggingface_hub 6 months ago
yi-1.5-6b.Q5_K_M.gguf

4.3 GB
LFS

Upload yi-1.5-6b.Q5_K_M.gguf with huggingface_hub 6 months ago
yi-1.5-6b.Q6_K.gguf

4.97 GB
LFS

Upload yi-1.5-6b.Q6_K.gguf with huggingface_hub 6 months ago
yi-1.5-6b.Q8_0.gguf

6.44 GB
LFS

Upload yi-1.5-6b.Q8_0.gguf with huggingface_hub 6 months ago
yi-1.5-6b.fp16.gguf

12.1 GB
LFS

Upload yi-1.5-6b.fp16.gguf with huggingface_hub 6 months ago