Update README.md
Browse files
README.md
CHANGED
@@ -136,19 +136,15 @@ The additional layers are designed to increase the model's capacity without brea
|
|
136 |
|
137 |
## 🏆 Evaluation
|
138 |
|
139 |
-
|
140 |
-
|
141 |
-
|
142 |
-
|
143 |
-
|
|
144 |
-
|
145 |
-
|
|
146 |
-
|
|
147 |
-
|
|
148 |
-
|MATH Lvl 5 (4-Shot)| 3.47|0|
|
149 |
-
|GPQA (0-shot) | 8.61|11.74|
|
150 |
-
|MuSR (0-shot) |10.19|13.5|
|
151 |
-
|MMLU-PRO (5-shot) |41.49|51.85|
|
152 |
|
153 |
## 🧩 Configuration
|
154 |
|
|
|
136 |
|
137 |
## 🏆 Evaluation
|
138 |
|
139 |
+
| Metric |**BigQwen2.5-Echo-47B-Instruct**|BigQwen2.5-52B-Instruct|Qwen2.5-32B-Instruct|
|
140 |
+
|-------------------|----:|----:|----:|
|
141 |
+
|Avg. |30.31|37.42|36.17|
|
142 |
+
|IFEval (0-Shot) |73.57|79.29|83.46|
|
143 |
+
|BBH (3-Shot) |44.52|59.81|56.49|
|
144 |
+
|MATH Lvl 5 (4-Shot)| 3.47|17.82|0|
|
145 |
+
|GPQA (0-shot) | 8.61| 6.94|11.74|
|
146 |
+
|MuSR (0-shot) |10.19|10.45|13.5|
|
147 |
+
|MMLU-PRO (5-shot) |41.49|50.22|51.85|
|
|
|
|
|
|
|
|
|
148 |
|
149 |
## 🧩 Configuration
|
150 |
|