Hugging Face's logo

MaziyarPanahi
/
calme-2.2-qwen2-72b-GGUF

Text Generation
GGUF
qwen
qwen-2
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
imatrix
conversational
Model card Files Community
8
MaziyarPanahi commited on
Commit
71c73b1
•
1 Parent(s): 881760b

[WIP] Upload folder using huggingface_hub (multi-commit fe899af0c28a490ee2a17c2ed125673df3ef1716ff4cc195947fe3d7c12a1410) (#3)

Browse files

- ad279f549a6132cbb936c309ed9af98fdae0579beb01481974275dcf546d06b9 (0a2b808aaa32dbb64c7bf81e048d605a965bde2d)
- 60100571d3f68862208a104d0cede674284b857853a30a566c9336686140d0f5 (240a4adbfd660496f04d4793bcfb322c3c349a5e)
- 5e5eca8d64f998119d1b39be2cb1c415cf8728dc4b4114bef65c750998cbfeed (f6176d3fb81e39990c7750febf1f38b788460e94)
- 9a8e817d918e7ba8cc8b10273829c1a1431fc5a95b929dfd50ba929430286775 (c734d28a257552668aead095e3a785b9e366740d)
- d3fdeab74a9ff7bea7e00840af43680bb5f501ed08a2aaa7c0c656304e194bf9 (0b56bc8b6a799c106751a2bac3e571346bea3d18)
- 7a8279a18d0a18674de1ce6a406486c612029a7dd044b67d0343367009cbddab (5768b036c612e1e39e60229471d1d78d82849197)

Files changed (7) hide show
  1. .gitattributes +6 -0
  2. calme-2.2-qwen2-72b.Q2_K.gguf +3 -0
  3. calme-2.2-qwen2-72b.Q3_K_L.gguf +3 -0
  4. calme-2.2-qwen2-72b.Q3_K_M.gguf +3 -0
  5. calme-2.2-qwen2-72b.Q3_K_S.gguf +3 -0
  6. calme-2.2-qwen2-72b.Q4_K_M.gguf +3 -0
  7. calme-2.2-qwen2-72b.Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,9 @@ calme-2.2-qwen2-72b.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
38
  calme-2.2-qwen2-72b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
  calme-2.2-qwen2-72b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
  calme-2.2-qwen2-72b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
38
  calme-2.2-qwen2-72b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
  calme-2.2-qwen2-72b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
  calme-2.2-qwen2-72b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ calme-2.2-qwen2-72b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ calme-2.2-qwen2-72b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
43
+ calme-2.2-qwen2-72b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ calme-2.2-qwen2-72b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ calme-2.2-qwen2-72b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ calme-2.2-qwen2-72b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
calme-2.2-qwen2-72b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91a17ec46a42439a427dab818892fba8372b54ed00d39b4a87d503fc1cf0aa68
3
+ size 29811760480
calme-2.2-qwen2-72b.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84a510e8bb9c1e5ac98971e8e35b1915215542de70c9bd3b049192e2d9fcba9b
3
+ size 39505223008
calme-2.2-qwen2-72b.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d78bb4667cda1d007b0a428f8df929efbfc791d1e9eb8c16bca0e31a56d81db
3
+ size 37698723168
calme-2.2-qwen2-72b.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc61e225849c0f7dcba65208baa5cab0c842b0026f7a64af0362d03508be4d9d
3
+ size 34487786848
calme-2.2-qwen2-72b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95b9613df0abe6c1b6b7b017d7cc8bcf19b46c29f92a503dcc6da1704b12b402
3
+ size 47415713120
calme-2.2-qwen2-72b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:069e67633ae99882193df4570ab1f51d0a0680401a6778755ab0ef93359e79bd
3
+ size 43889220960