Hugging Face's logo

Lewdiculous
/
InfinityNexus_9B-GGUF-IQ-Imatrix

Transformers
GGUF
English
quantized
roleplay
imatrix
mistral
Merge
Model card Files Community
Lewdiculous commited on
Commit
2c054c1
•
1 Parent(s): d039995

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. InfinityNexus_9B-IQ4_XS-imat.gguf +3 -0
  3. InfinityNexus_9B-Q4_K_M-imat.gguf +3 -0
  4. InfinityNexus_9B-Q4_K_S-imat.gguf +3 -0
.gitattributes CHANGED
@@ -35,3 +35,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  InfinityNexus_9B-F16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
  InfinityNexus_9B-F16.gguf filter=lfs diff=lfs merge=lfs -text
38
+ InfinityNexus_9B-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
+ InfinityNexus_9B-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
+ InfinityNexus_9B-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
InfinityNexus_9B-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26a214fea541ef99db892094d1282957630a61d022ace5f5535de16922ae87e9
3
+ size 4840138688
InfinityNexus_9B-Q4_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e78f7357503b4b0e3e0244141d05fe807fbe9f3172b5a665af1817670fec7c23
3
+ size 5415053248
InfinityNexus_9B-Q4_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fcee84647021fa5e0c9c36f3eb021f356747e5ae1e75bc5792f343b74b1d5f5
3
+ size 5129447360