InferenceIllusionist
/

Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-GGUF

1 contributor

History: 8 commits

InferenceIllusionist's picture

InferenceIllusionist

Upload 2 files

6216e53 verified 7 months ago

.gitattributes

2.45 kB

Upload 2 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_M.gguf

21.4 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_S.gguf

20.4 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_XS.gguf

19.4 GB
LFS

Upload 2 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_XXS.gguf

18.2 GB
LFS

Upload 2 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ4_XS.gguf

25.1 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_M.gguf

28.4 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_S.gguf

26.7 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_M.gguf

33.2 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_M.gguf 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_S.gguf

32.2 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_S.gguf 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q6_K.gguf

38.4 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q6_K.gguf 7 months ago
README.md

1.12 kB

Update README.md 7 months ago