Update README.md
Browse files
README.md
CHANGED
@@ -16,8 +16,9 @@ zero-shot evaluations performed on current sota small models; mmlu is still the
|
|
16 |
|
17 |
| Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
|
18 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
19 |
-
| 0.5b |
|
20 |
-
| 0.5b | arco
|
|
|
21 |
| 1.7b | smollm |27.65|**46.26**|65.74|76.06|60.93| 55.33|
|
22 |
| 1.8B | niro-preview |41.75|40.96|**72.07**|**77.97**|**65.51**|**59.65**|
|
23 |
-
| 1.5b |
|
|
|
16 |
|
17 |
| Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
|
18 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
19 |
+
| 0.5b | qwen 2.5 |47.29|31.83|52.17|70.29|57.06|51.72|
|
20 |
+
| 0.5b | arco |26.17|37.29|62.88|74.37|62.27|52.60|
|
21 |
+
| 0.5b | arco (exp) |25.51|38.82|63.02|74.70|61.25|52.66|
|
22 |
| 1.7b | smollm |27.65|**46.26**|65.74|76.06|60.93| 55.33|
|
23 |
| 1.8B | niro-preview |41.75|40.96|**72.07**|**77.97**|**65.51**|**59.65**|
|
24 |
+
| 1.5b | qwen 2.5 |**58.68**|44.71|67.62|75.73|62.67|**61.88**|
|