Hugging Face's logo

InferenceIllusionist
/
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-GGUF

GGUF
Merge
iMat
Inference Endpoints
conversational
Model card Files Community
InferenceIllusionist commited on
Commit
8a464b7
•
1 Parent(s): 3a454f5

Upload 5 files

Browse files
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_M.gguf +3 -0
  3. Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_S.gguf +3 -0
  4. Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ4_XS.gguf +3 -0
  5. Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_M.gguf +3 -0
  6. Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -36,3 +36,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
36
  Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
37
  Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
  Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
36
  Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
37
  Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
  Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:93616cffa6aead15ef55043ed08b58f633672a5f3ebc9dc03e1d7ae0eacdd106
3
+ size 21430765312
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8c5f17be566b906b63fd5cb17d5467bc4f00ad623455940f22788329a993000
3
+ size 20432520960
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dcea0e094f8542f04fd1fd1adba94d2603588c3c907dbb65305365697e36ca3
3
+ size 25080538880
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec15e20ed0b362ba80b1d1f14a46262331a0ea708f9ae8a6ed0ce6d13cdf4d3c
3
+ size 28448466688
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss-iMat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d2d500da9a72b05d2601be26c010489edcee1ddbbe27249456b1961ef017d4a
3
+ size 26745579264