Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,7 @@ Post-merging was used just like with palmer models (merge, finetune later).
|
|
| 15 |
|
| 16 |
zero-shot evaluations performed on current sota ~0.5b models.
|
| 17 |
|
| 18 |
-
| Parameters | Model | MMLU | ARC
|
| 19 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
| 20 |
| 0.5b | arco |26.17|37.29|62.88|74.37|62.27|52.60|
|
| 21 |
| 1.8B | wizard |40.79|40.87|71.85|**78.02**|64.33| 59.17|
|
|
|
|
| 15 |
|
| 16 |
zero-shot evaluations performed on current sota ~0.5b models.
|
| 17 |
|
| 18 |
+
| Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
|
| 19 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
| 20 |
| 0.5b | arco |26.17|37.29|62.88|74.37|62.27|52.60|
|
| 21 |
| 1.8B | wizard |40.79|40.87|71.85|**78.02**|64.33| 59.17|
|