Hugging Face's logo

trollek
/
NinjaMouse-2.4B-32L-danube

Text Generation
Transformers
Safetensors
GGUF
English
mistral
code
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
1
trollek commited on
Commit
f65d89d
·
verified ·
1 Parent(s): 1a01208

Quantised versions

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. NinjaMouse-2.4b-q4_K_S.gguf +3 -0
  3. NinjaMouse-2.4b-q5_K_S.gguf +3 -0
  4. NinjaMouse-2.4b-q6_K.gguf +3 -0
  5. NinjaMouse-2.4b-q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ NinjaMouse-2.4b-q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
37
+ NinjaMouse-2.4b-q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ NinjaMouse-2.4b-q6_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ NinjaMouse-2.4b-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
NinjaMouse-2.4b-q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4213ba591b363a6303c172d518dd1da8eaec60604287113d2f88d7d4ee5ff61
3
+ size 1374780640
NinjaMouse-2.4b-q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b935e8535f2e7310259e501d0abf7a3ddce3bae6b7ed5acfbc1e040b4b57140
3
+ size 1653226720
NinjaMouse-2.4b-q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:feecf32e6f64be979da6cfbd1691f3d568bc6f9af5b32b6963d27eff9f547629
3
+ size 1959346400
NinjaMouse-2.4b-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e954a9b1d43c828dcffa349b1357fbe52aa33e2201acb457f67218ba27391d4c
3
+ size 2537404640