Hugging Face's logo

Lewdiculous
/
Neural-SOVLish-Devil-8B-L3-GGUF-IQ-Imatrix

GGUF
Inference Endpoints
imatrix
Model card Files Community
1
Lewdiculous commited on
Commit
f682d00
·
verified ·
1 Parent(s): 1006e2a

Upload quants.

Browse files
Files changed (14) hide show
  1. .gitattributes +12 -0
  2. Neural-SOVLish-Devil-8B-L3-IQ3_M-imat.gguf +3 -0
  3. Neural-SOVLish-Devil-8B-L3-IQ3_S-imat.gguf +3 -0
  4. Neural-SOVLish-Devil-8B-L3-IQ3_XXS-imat.gguf +3 -0
  5. Neural-SOVLish-Devil-8B-L3-IQ4_NL-imat.gguf +3 -0
  6. Neural-SOVLish-Devil-8B-L3-IQ4_XS-imat.gguf +3 -0
  7. Neural-SOVLish-Devil-8B-L3-Q4_K_M-imat.gguf +3 -0
  8. Neural-SOVLish-Devil-8B-L3-Q4_K_S-imat.gguf +3 -0
  9. Neural-SOVLish-Devil-8B-L3-Q5_K_M-imat.gguf +3 -0
  10. Neural-SOVLish-Devil-8B-L3-Q5_K_S-imat.gguf +3 -0
  11. Neural-SOVLish-Devil-8B-L3-Q6_K-imat.gguf +3 -0
  12. Neural-SOVLish-Devil-8B-L3-Q8_0-imat.gguf +3 -0
  13. imatrix-with-rp-ex.txt +0 -0
  14. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Neural-SOVLish-Devil-8B-L3-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Neural-SOVLish-Devil-8B-L3-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Neural-SOVLish-Devil-8B-L3-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Neural-SOVLish-Devil-8B-L3-IQ4_NL-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Neural-SOVLish-Devil-8B-L3-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Neural-SOVLish-Devil-8B-L3-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Neural-SOVLish-Devil-8B-L3-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Neural-SOVLish-Devil-8B-L3-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Neural-SOVLish-Devil-8B-L3-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Neural-SOVLish-Devil-8B-L3-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Neural-SOVLish-Devil-8B-L3-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
Neural-SOVLish-Devil-8B-L3-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24172271fbe4935a148698a174b19c8cd607a0bc0303479cd732e14104519c99
3
+ size 3784822976
Neural-SOVLish-Devil-8B-L3-IQ3_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4484a648e2f229cdcdd8d5f8562c5d04cbf78846cc29e176fc1a4d6ce8bbbb6
3
+ size 3682324672
Neural-SOVLish-Devil-8B-L3-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5782dbfec82e76127c251c66f9d856f9b88d646278e17367f5c18873d3874562
3
+ size 3274911936
Neural-SOVLish-Devil-8B-L3-IQ4_NL-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03523798a207355b34d0577f7fc8354f9097247da10412c3ade259f660c6055e
3
+ size 4677988544
Neural-SOVLish-Devil-8B-L3-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a60414beb5101f129e9cdfd048f9fb7ae7905bbab02e3b0fe659405cd19627fe
3
+ size 4447662272
Neural-SOVLish-Devil-8B-L3-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9b93f786a9f66c6d60851312934a700bb05262d59967ba66982703c2175fcb8
3
+ size 4920733888
Neural-SOVLish-Devil-8B-L3-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1427d050d3dfad1a67dac145e77e335f8c7f9982060e0b7338951cc8291af777
3
+ size 4692668608
Neural-SOVLish-Devil-8B-L3-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d989ecb3a8f80cb6c047dead1f00cd261e587f27c29d0fd4f9d855dda0e08edf
3
+ size 5732987072
Neural-SOVLish-Devil-8B-L3-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01b494e02bd98fbf130ff25fc49e68c2b74b286b8cf412bd798c52f1c5dc4b96
3
+ size 5599293632
Neural-SOVLish-Devil-8B-L3-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:523359ee1e96b8d48c5ddcc975ea193a8e575761c837403ee7357dc277d81feb
3
+ size 6596006080
Neural-SOVLish-Devil-8B-L3-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c276f33fa0cfdb6c05d76cb408755ca5c923a484ee261cde7fbfd0b292741ab
3
+ size 8540770496
imatrix-with-rp-ex.txt ADDED
The diff for this file is too large to render. See raw diff
 
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0177f8a8f67bb40febf074bfc591c9b06d6dc49704cdf587aba16e1cda17d93f
3
+ size 4988193