Hugging Face's logo

Lewdiculous
/
Qwen2-7B-Instruct-abliterated-GGUF-IQ-Imatrix-Request

GGUF
imatrix
conversational
Model card Files Community
1
Lewdiculous commited on
Commit
3f275c0
•
1 Parent(s): 10baad6

add quants

Browse files
Files changed (9) hide show
  1. .gitattributes +8 -0
  2. Qwen2-7B-Instruct-abliterated-IQ3_XXS-imat.gguf +3 -0
  3. Qwen2-7B-Instruct-abliterated-IQ4_XS-imat.gguf +3 -0
  4. Qwen2-7B-Instruct-abliterated-Q4_K_M-imat.gguf +3 -0
  5. Qwen2-7B-Instruct-abliterated-Q4_K_S-imat.gguf +3 -0
  6. Qwen2-7B-Instruct-abliterated-Q5_K_M-imat.gguf +3 -0
  7. Qwen2-7B-Instruct-abliterated-Q5_K_S-imat.gguf +3 -0
  8. Qwen2-7B-Instruct-abliterated-Q6_K-imat.gguf +3 -0
  9. Qwen2-7B-Instruct-abliterated-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,11 @@ Qwen2-7B-Instruct-abliterated-BF16.gguf filter=lfs diff=lfs merge=lfs -text
38
  Qwen2-7B-Instruct-abliterated-F16.gguf filter=lfs diff=lfs merge=lfs -text
39
  Qwen2-7B-Instruct-abliterated-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  Qwen2-7B-Instruct-abliterated-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
38
  Qwen2-7B-Instruct-abliterated-F16.gguf filter=lfs diff=lfs merge=lfs -text
39
  Qwen2-7B-Instruct-abliterated-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  Qwen2-7B-Instruct-abliterated-IQ3_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen2-7B-Instruct-abliterated-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen2-7B-Instruct-abliterated-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen2-7B-Instruct-abliterated-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen2-7B-Instruct-abliterated-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen2-7B-Instruct-abliterated-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen2-7B-Instruct-abliterated-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen2-7B-Instruct-abliterated-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Qwen2-7B-Instruct-abliterated-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-7B-Instruct-abliterated-IQ3_XXS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edd94c4137a31e21a61dff0ae6212c61d8c6bb73c70d6d0ad989f93123029816
3
+ size 3114512224
Qwen2-7B-Instruct-abliterated-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ffb1b67a9c8c224de72a20c8aaa55d91203899ce454b5ae22a4ddddb916fe822
3
+ size 4218470240
Qwen2-7B-Instruct-abliterated-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:971fd8134a5a0d8b94d8d1659038ce9e86bae10881ce7502a885fb3bfaf00db7
3
+ size 4683071328
Qwen2-7B-Instruct-abliterated-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13ae0ca4fabf018c9debacdd1e2e7db09cf340a7df2e59e0335ca68a8eabe730
3
+ size 4457766752
Qwen2-7B-Instruct-abliterated-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ec7c803276618e4311c94baabf68c1c29d05fe81f6270e536d7e959231fccd4
3
+ size 5444829024
Qwen2-7B-Instruct-abliterated-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe5c3b3e1581eb4405b1f76ef7624a7f3c4e2a9f17b5ea18ff249f6f9729da86
3
+ size 5315174240
Qwen2-7B-Instruct-abliterated-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5eea55f1ae91c3c7489a0b94ea5371d06c0d081d053ba4833bf15763de794f5b
3
+ size 6254196576
Qwen2-7B-Instruct-abliterated-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ff63a5819409181cbd0de0cf4dc144e4f6c747c513797fb5d9356bdfc418eea
3
+ size 8098522976