Hugging Face's logo

MaziyarPanahi
/
calme-2.2-qwen2-72b-GGUF

Text Generation
GGUF
qwen
qwen-2
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
imatrix
Model card Files Community
8

[WIP] Upload folder using huggingface_hub (multi-commit fe899af0c28a490ee2a17c2ed125673df3ef1716ff4cc195947fe3d7c12a1410)

#3
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+24
-0
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. calme-2.2-qwen2-72b.Q2_K.gguf +3 -0
  3. calme-2.2-qwen2-72b.Q3_K_L.gguf +3 -0
  4. calme-2.2-qwen2-72b.Q3_K_M.gguf +3 -0
  5. calme-2.2-qwen2-72b.Q3_K_S.gguf +3 -0
  6. calme-2.2-qwen2-72b.Q4_K_M.gguf +3 -0
  7. calme-2.2-qwen2-72b.Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,9 @@ calme-2.2-qwen2-72b.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
38
  calme-2.2-qwen2-72b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
  calme-2.2-qwen2-72b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
  calme-2.2-qwen2-72b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
38
  calme-2.2-qwen2-72b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
  calme-2.2-qwen2-72b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
  calme-2.2-qwen2-72b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ calme-2.2-qwen2-72b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ calme-2.2-qwen2-72b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
43
+ calme-2.2-qwen2-72b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ calme-2.2-qwen2-72b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ calme-2.2-qwen2-72b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ calme-2.2-qwen2-72b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
calme-2.2-qwen2-72b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91a17ec46a42439a427dab818892fba8372b54ed00d39b4a87d503fc1cf0aa68
3
+ size 29811760480
calme-2.2-qwen2-72b.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84a510e8bb9c1e5ac98971e8e35b1915215542de70c9bd3b049192e2d9fcba9b
3
+ size 39505223008
calme-2.2-qwen2-72b.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d78bb4667cda1d007b0a428f8df929efbfc791d1e9eb8c16bca0e31a56d81db
3
+ size 37698723168
calme-2.2-qwen2-72b.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc61e225849c0f7dcba65208baa5cab0c842b0026f7a64af0362d03508be4d9d
3
+ size 34487786848
calme-2.2-qwen2-72b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95b9613df0abe6c1b6b7b017d7cc8bcf19b46c29f92a503dcc6da1704b12b402
3
+ size 47415713120
calme-2.2-qwen2-72b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:069e67633ae99882193df4570ab1f51d0a0680401a6778755ab0ef93359e79bd
3
+ size 43889220960