Hugging Face's logo

featherless-ai-quants
/
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
m8than commited on
Commit
0a2d574
·
verified ·
1 Parent(s): 9e469da

Upload folder using huggingface_hub

Browse files
Files changed (14) hide show
  1. .gitattributes +12 -0
  2. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-IQ4_XS.gguf +3 -0
  3. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q2_K.gguf +3 -0
  4. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_L.gguf +3 -0
  5. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_M.gguf +3 -0
  6. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_S.gguf +3 -0
  7. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_M.gguf +3 -0
  8. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_S.gguf +3 -0
  9. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_M.gguf +3 -0
  10. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_S.gguf +3 -0
  11. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q6_K.gguf +3 -0
  12. DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q8_0.gguf +3 -0
  13. README.md +47 -0
  14. featherless-quants.png +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ featherless-quants.png filter=lfs diff=lfs merge=lfs -text
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b85b9e2146e1e24de57cf2db852bace57ae847f6ec24fc72260fba25c606daa7
3
+ size 4484362656
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccbfc8ba2e0ae9a17dde3fa0c3c31cdf0ac21aa7a56b0c88ca8c2e74400abc0d
3
+ size 3179131296
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a37a2590211db4407afbfdde542206e0315be2ef73625bd8e6d98d0e92fc68f6
3
+ size 4321956256
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6a83fb1688a0010ed42e0d6f4b5a68d42b1d31da03d96a93dd6a8c6f5c2c3216
3
+ size 4018917792
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9bc86be17aba3b3d95a3fb82e15dcd7e812c5d22eada04b195308173ffd0b862
3
+ size 3664499104
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36f12d40f0dc406eb4f93b7b63e03768970c5126f5d388a68a27cb6ff9c95d7e
3
+ size 4920734112
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:011b369e338952c7339e8cfead5333316e0a65adaefd7c86c1a043d422366522
3
+ size 4692668832
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6975ea79553282e78248873a7d34510fd061fb2a6856bcf7bcac98b2992ba106
3
+ size 5732987296
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a1df8d84eec81b733f81613ea7043452356f838350fa22683f17ec49018cd5e
3
+ size 5599293856
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91387a78425a4cb16ad5dc0f9d1195552cef27035e3c88ac74399d640f7642f5
3
+ size 6596006304
DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5eafe105e159cde464a478d4c82dd7f1f24b9d9abcb41a37137bd0fbbbe73d1
3
+ size 8540770720
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: DiscoResearch/Llama3_DiscoLM_German_8b_v0.1_experimental
3
+ pipeline_tag: text-generation
4
+ quantized_by: featherless-ai-quants
5
+ ---
6
+
7
+ # DiscoResearch/Llama3_DiscoLM_German_8b_v0.1_experimental GGUF Quantizations 🚀
8
+
9
+ ![Featherless AI Quants](./featherless-quants.png)
10
+
11
+ *Optimized GGUF quantization files for enhanced model performance*
12
+
13
+ > Powered by [Featherless AI](https://featherless.ai) - run any model you'd like for a simple small fee.
14
+ ---
15
+
16
+ ## Available Quantizations 📊
17
+
18
+ | Quantization Type | File | Size |
19
+ |-------------------|------|------|
20
+ | Q8_0 | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q8_0.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q8_0.gguf) | 8145.11 MB |
21
+ | Q4_K_S | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_S.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_S.gguf) | 4475.28 MB |
22
+ | Q2_K | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q2_K.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q2_K.gguf) | 3031.86 MB |
23
+ | Q6_K | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q6_K.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q6_K.gguf) | 6290.44 MB |
24
+ | Q3_K_M | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_M.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_M.gguf) | 3832.74 MB |
25
+ | Q3_K_S | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_S.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_S.gguf) | 3494.74 MB |
26
+ | Q3_K_L | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_L.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q3_K_L.gguf) | 4121.74 MB |
27
+ | Q4_K_M | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_M.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q4_K_M.gguf) | 4692.78 MB |
28
+ | Q5_K_S | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_S.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_S.gguf) | 5339.90 MB |
29
+ | Q5_K_M | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_M.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-Q5_K_M.gguf) | 5467.40 MB |
30
+ | IQ4_XS | [DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-IQ4_XS.gguf](https://huggingface.co/featherless-ai-quants/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-GGUF/blob/main/DiscoResearch-Llama3_DiscoLM_German_8b_v0.1_experimental-IQ4_XS.gguf) | 4276.62 MB |
31
+
32
+
33
+ ---
34
+
35
+ ## ⚡ Powered by [Featherless AI](https://featherless.ai)
36
+
37
+ ### Key Features
38
+
39
+ - 🔥 **Instant Hosting** - Deploy any Llama model on HuggingFace instantly
40
+ - 🛠️ **Zero Infrastructure** - No server setup or maintenance required
41
+ - 📚 **Vast Compatibility** - Support for 2400+ models and counting
42
+ - 💎 **Affordable Pricing** - Starting at just $10/month
43
+
44
+ ---
45
+
46
+ **Links:**
47
+ [Get Started](https://featherless.ai) | [Documentation](https://featherless.ai/docs) | [Models](https://featherless.ai/models)
featherless-quants.png ADDED

Git LFS Details

  • SHA256: 2e1b4d66c8306c7b0614089381fdf86ea4efb02dffb78d22767a084cb8b88d6b
  • Pointer size: 132 Bytes
  • Size of remote file: 1.61 MB