venketh
/

gpt4-x-vicuna-13b-gguf-imatrix

Model card Files Files and versions Community

gpt4-x-vicuna-13b-gguf-imatrix

2 contributors

History: 25 commits

venketh's picture

Import legacy Q4_1 quantization (created w/ imatrix)

ab1ab49 8 months ago

.gitattributes

1.57 kB

Import importance matrix and source data 9 months ago
README.md

160 Bytes

Import importance matrix and source data 9 months ago
gpt4-x-vicuna-13B.gguf.IQ4_NL.bin

7.37 GB
LFS

Import IQ4_NL (4.5 bpw) quantization 8 months ago
gpt4-x-vicuna-13B.gguf.IQ4_XS.bin

6.96 GB
LFS

Swap Q3_K_L for new IQ4_XS quantization 9 months ago
gpt4-x-vicuna-13B.gguf.Q4_0.bin

7.39 GB
LFS

Import Q4_0 (legacy) quantization 9 months ago
gpt4-x-vicuna-13B.gguf.Q4_1.bin

8.17 GB
LFS

Import legacy Q4_1 quantization (created w/ imatrix) 8 months ago
gpt4-x-vicuna-13B.gguf.q4_K_M.bin

7.87 GB
LFS

Update Q4_K_M quantization to imatrix version 9 months ago
gpt4-x-vicuna-13B.gguf.q4_K_S.bin

7.42 GB
LFS

Update Q4_K_S quantization to imatrix version 9 months ago
gpt4-x-vicuna-13B.gguf.q5_K_M.bin

9.23 GB
LFS

Import updated Q5_K_M quantization 9 months ago
gpt4-x-vicuna-13B.gguf.q5_K_S.bin

8.97 GB
LFS

Import updated Q5_K_S quantization 9 months ago
gpt4-x-vicuna-13B.gguf.q6_K.bin

10.7 GB
LFS

Update Q6_K quantization to imatrix version (take 2) 9 months ago
group_10_merged.txt

162 kB

Import importance matrix and source data 9 months ago
imatrix.dat

7.14 MB
LFS

Import importance matrix and source data 9 months ago