Update README.md
Browse files
README.md
CHANGED
@@ -29,7 +29,7 @@ From [Low-bit Quantized Open LLM Leaderboard](https://huggingface.co/spaces/Inte
|
|
29 |
| Type | Model | Average β¬οΈ | ARC-c | ARC-e | Boolq | HellaSwag | Lambada | MMLU | Openbookqa | Piqa | Truthfulqa | Winogrande | #Params (B) | #Size (G) |
|
30 |
|------|-------------------------------------------|------------|-------|-------|-------|-----------|---------|-------|------------|-------|------------|------------|-------------|-----------|
|
31 |
| π | Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc | 68.49 | 60.49 | 82.66 | 88.29 | 68.29 | 73.36 | 62.43 | 35.6 | 80.74 | 56.06 | 76.95 | 10.57 | 5.98 |
|
32 |
-
| π | **cstr/Spaetzle-v60-7b-int4-inc
|
33 |
| π· | TheBloke/SOLAR-10.7B-Instruct-v1.0-GGUF | 66.6 | 60.41 | 83.38 | 88.29 | 67.73 | 52.42 | 62.04 | 37.2 | 82.32 | 56.3 | 75.93 | 10.73 | 6.07 |
|
34 |
| π· | **cstr/Spaetzle-v60-7b-Q4_0-GGUF** | **66.44** | **61.35** | **85.19** | **87.98** | **66.54** | **52.78** | **62.05** | **40.6** | **81.72** | **47** | **79.16** | **7.24** | **4.11** |
|
35 |
| π | Intel/Mistral-7B-Instruct-v0.2-int4-inc | 65.73 | 55.38 | 81.44 | 85.26 | 65.67 | 70.89 | 58.66 | 34.2 | 80.74 | 51.16 | 73.95 | 7.04 | 4.16 |
|
|
|
29 |
| Type | Model | Average β¬οΈ | ARC-c | ARC-e | Boolq | HellaSwag | Lambada | MMLU | Openbookqa | Piqa | Truthfulqa | Winogrande | #Params (B) | #Size (G) |
|
30 |
|------|-------------------------------------------|------------|-------|-------|-------|-----------|---------|-------|------------|-------|------------|------------|-------------|-----------|
|
31 |
| π | Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc | 68.49 | 60.49 | 82.66 | 88.29 | 68.29 | 73.36 | 62.43 | 35.6 | 80.74 | 56.06 | 76.95 | 10.57 | 5.98 |
|
32 |
+
| π | **cstr/Spaetzle-v60-7b-int4-inc** | **68.01** | **62.12** | **85.27** | **87.34** | **66.43** | **70.58** | **61.39** | **37** | **82.26** | **50.18** | **77.51** | **7.04** | **4.16** |
|
33 |
| π· | TheBloke/SOLAR-10.7B-Instruct-v1.0-GGUF | 66.6 | 60.41 | 83.38 | 88.29 | 67.73 | 52.42 | 62.04 | 37.2 | 82.32 | 56.3 | 75.93 | 10.73 | 6.07 |
|
34 |
| π· | **cstr/Spaetzle-v60-7b-Q4_0-GGUF** | **66.44** | **61.35** | **85.19** | **87.98** | **66.54** | **52.78** | **62.05** | **40.6** | **81.72** | **47** | **79.16** | **7.24** | **4.11** |
|
35 |
| π | Intel/Mistral-7B-Instruct-v0.2-int4-inc | 65.73 | 55.38 | 81.44 | 85.26 | 65.67 | 70.89 | 58.66 | 34.2 | 80.74 | 51.16 | 73.95 | 7.04 | 4.16 |
|