TheBloke
/

koala-7B-GGML

Model card Files Files and versions Community

1 contributor

History: 18 commits

TheBloke's picture

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48

3bef463 over 1 year ago

.gitattributes

1.48 kB

initial commit over 1 year ago
README.md

4.44 kB

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
koala-7B.ggml.q4_0.bin

4.21 GB
LFS

Upload folder using huggingface_hub over 1 year ago
koala-7B.ggml.q5_0.bin

4.63 GB
LFS

Upload folder using huggingface_hub over 1 year ago
koala-7B.ggml.q5_1.bin

5.06 GB
LFS

Upload folder using huggingface_hub over 1 year ago
koala-7B.ggml.q8_0.bin

7.58 GB
LFS

Upload folder using huggingface_hub over 1 year ago
koala-7B.ggmlv3.q4_0.bin

3.79 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
koala-7B.ggmlv3.q4_1.bin

4.21 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
koala-7B.ggmlv3.q5_0.bin

4.63 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago
koala-7B.ggmlv3.q8_0.bin

7.16 GB
LFS

New GGMLv3 format for breaking llama.cpp change May 19th commit 2d5db48 over 1 year ago