InferenceIllusionist
/

Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-GGUF

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-GGUF

1 contributor

History: 7 commits

InferenceIllusionist's picture

InferenceIllusionist

Upload 5 files

8a464b7 verified 7 months ago

.gitattributes

2.26 kB

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_M.gguf

21.4 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_S.gguf

20.4 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ4_XS.gguf

25.1 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_M.gguf

28.4 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_S.gguf

26.7 GB
LFS

Upload 5 files 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_M.gguf

33.2 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_M.gguf 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_S.gguf

32.2 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_S.gguf 7 months ago
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q6_K.gguf

38.4 GB
LFS

Upload Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q6_K.gguf 7 months ago
README.md

1.12 kB

Update README.md 7 months ago