Hugging Face's logo

MaziyarPanahi
/
gemma-7b-it-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
conversational
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
2
MaziyarPanahi commited on
Commit
370a47b
·
verified ·
1 Parent(s): 92d19e7

Upload folder using huggingface_hub

Browse files
Files changed (12) hide show
  1. .gitattributes +11 -0
  2. gemma-7b-it.Q2_K.gguf +3 -0
  3. gemma-7b-it.Q3_K_L.gguf +3 -0
  4. gemma-7b-it.Q3_K_M.gguf +3 -0
  5. gemma-7b-it.Q3_K_S.gguf +3 -0
  6. gemma-7b-it.Q4_K_M.gguf +3 -0
  7. gemma-7b-it.Q4_K_S.gguf +3 -0
  8. gemma-7b-it.Q5_K_M.gguf +3 -0
  9. gemma-7b-it.Q5_K_S.gguf +3 -0
  10. gemma-7b-it.Q6_K.gguf +3 -0
  11. gemma-7b-it.Q8_0.gguf +3 -0
  12. gemma-7b-it.fp16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gemma-7b-it.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ gemma-7b-it.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ gemma-7b-it.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ gemma-7b-it.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ gemma-7b-it.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ gemma-7b-it.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ gemma-7b-it.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ gemma-7b-it.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ gemma-7b-it.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ gemma-7b-it.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
+ gemma-7b-it.fp16.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-it.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:42da10502fd6ed21f1f12ea89f5ba3af09595cf064280ae7a7c7a20612331446
3
+ size 3094507680
gemma-7b-it.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24d502df64ae27dc02e44567463184d9a00e433c02c73867dbe653d4dc3ed346
3
+ size 4402039968
gemma-7b-it.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:339f8d1ad6dcea6308310d401cb39b42ce781acd8b31fc65a9d49ee74aae1af1
3
+ size 4062301344
gemma-7b-it.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ccb60c83b6aa7065233dd06f2466461317866de507435c9c4a565607edb8978
3
+ size 3675376800
gemma-7b-it.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd87fc03fe3d651ac419ae35f4a0e6d861167db156572b6c4b90fb81822a3547
3
+ size 5127231648
gemma-7b-it.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2b485d0a4e68fcb01a6265b5d1373bcb08f8cc9f27b177add95134bf05fab87
3
+ size 4843919520
gemma-7b-it.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:601ea5510042eb36434b85c024f8182350ed9b96b2efeee0157c8035a9042b79
3
+ size 6040328352
gemma-7b-it.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22d126be2d6a308c9c95dbcc667db20c55ee12cff9eb56529ad680dac94d12bd
3
+ size 5876553888
gemma-7b-it.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06c44fb30feac4c7d681baf4c68e9d2df45fe624ce22f3a9bad45a8de711dd32
3
+ size 7010493600
gemma-7b-it.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6daf2627518df1d55e8d8c8ca874909cb4f69f4ab863bffc7a0bb7636509bbb6
3
+ size 9078266016
gemma-7b-it.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82ed67cc4c2d9384a67cedd8b07950b71fa06e4a2e0c6ae9cabfad094d67e234
3
+ size 34158344288