Update README.md
Browse files
README.md
CHANGED
@@ -5,9 +5,9 @@ language:
|
|
5 |
license: mit
|
6 |
tags:
|
7 |
- HelpingAI
|
8 |
-
- GGUF
|
9 |
- lite
|
10 |
- code
|
|
|
11 |
---
|
12 |
|
13 |
#### Description
|
@@ -48,5 +48,4 @@ The differentiator between GGJT and GGUF lies in the deliberate adoption of a ke
|
|
48 |
| q5_k_m | 5-bit integers | Optimized model size and accuracy with mixed precision and structured pruning | Reduced accuracy |
|
49 |
| q5_k_s | 5-bit integers | Improved model efficiency with structured pruning | Reduced accuracy |
|
50 |
| q6_k | 6-bit integers | Balance between model size reduction and accuracy preservation | Moderate impact on accuracy |
|
51 |
-
| q8_0 | 8-bit integers | Significant model size reduction | Minimal impact on accuracy |
|
52 |
-
|
|
|
5 |
license: mit
|
6 |
tags:
|
7 |
- HelpingAI
|
|
|
8 |
- lite
|
9 |
- code
|
10 |
+
pipeline_tag: text-generation
|
11 |
---
|
12 |
|
13 |
#### Description
|
|
|
48 |
| q5_k_m | 5-bit integers | Optimized model size and accuracy with mixed precision and structured pruning | Reduced accuracy |
|
49 |
| q5_k_s | 5-bit integers | Improved model efficiency with structured pruning | Reduced accuracy |
|
50 |
| q6_k | 6-bit integers | Balance between model size reduction and accuracy preservation | Moderate impact on accuracy |
|
51 |
+
| q8_0 | 8-bit integers | Significant model size reduction | Minimal impact on accuracy |
|
|