Reiterate3680
/

mini-magnum-12b-v1.1-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

mini-magnum-12b-v1.1-GGUF

1 contributor

History: 14 commits

Reiterate3680's picture

Upload mini-magnum-12b-v1.1-Q6_K_L-imat.gguf

1be03f5 verified 4 months ago

.gitattributes

2.52 kB

Upload 2 files 4 months ago
README.md

380 Bytes

Update README.md 4 months ago
imatrix.dat

7.05 MB
LFS

Upload 2 files 4 months ago
mini-magnum-12b-v1.1-IQ2_M-imat.gguf

4.44 GB
LFS

Upload 3 files 4 months ago
mini-magnum-12b-v1.1-IQ3_M-imat.gguf

5.72 GB
LFS

Upload 3 files 4 months ago
mini-magnum-12b-v1.1-IQ4_XS-imat.gguf

6.74 GB
LFS

Upload 3 files 4 months ago
mini-magnum-12b-v1.1-Q2_K_S-imat.gguf

4.49 GB
LFS

Rename mini-magnum-12b-v1.1-Q2_K_L-imat.gguf to mini-magnum-12b-v1.1-Q2_K_S-imat.gguf 4 months ago
mini-magnum-12b-v1.1-Q3_K_L-imat.gguf

6.56 GB
LFS

Upload 3 files 4 months ago
mini-magnum-12b-v1.1-Q4_K_L-imat.gguf

7.98 GB
LFS

Upload 2 files 4 months ago
mini-magnum-12b-v1.1-Q4_K_M-imat.gguf

7.48 GB
LFS

Rename mini-magnum-12b-v1.1-Q4_K_L-imat.gguf to mini-magnum-12b-v1.1-Q4_K_M-imat.gguf 4 months ago
mini-magnum-12b-v1.1-Q5_K_M-imat.gguf

8.73 GB
LFS

Rename mini-magnum-12b-v1.1-Q5_K_L-imat.gguf to mini-magnum-12b-v1.1-Q5_K_M-imat.gguf 4 months ago
mini-magnum-12b-v1.1-Q6_K-imat.gguf

10.1 GB
LFS

Rename mini-magnum-12b-v1.1-Q6_K_L-imat.gguf to mini-magnum-12b-v1.1-Q6_K-imat.gguf 4 months ago
mini-magnum-12b-v1.1-Q6_K_L-imat.gguf

10.4 GB
LFS

Upload mini-magnum-12b-v1.1-Q6_K_L-imat.gguf 4 months ago
mini-magnum-12b-v1.1-Q8_0-imat.gguf

13 GB
LFS

Upload mini-magnum-12b-v1.1-Q8_0-imat.gguf 4 months ago