mlabonne commited on
Commit
001581d
1 Parent(s): e0f63c2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -13
README.md CHANGED
@@ -136,19 +136,15 @@ The additional layers are designed to increase the model's capacity without brea
136
 
137
  ## 🏆 Evaluation
138
 
139
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_mlabonne__BigQwen2.5-Echo-47B-Instruct).
140
-
141
- TBD: add mlabonne/BigQwen2.5-52B-Instruct's results.
142
-
143
- | Metric |**BigQwen2.5-Echo-47B-Instruct**|Qwen2.5-32B-Instruct|
144
- |-------------------|----:|----:|
145
- |Avg. |30.31|36.17|
146
- |IFEval (0-Shot) |73.57|83.46|
147
- |BBH (3-Shot) |44.52|56.49|
148
- |MATH Lvl 5 (4-Shot)| 3.47|0|
149
- |GPQA (0-shot) | 8.61|11.74|
150
- |MuSR (0-shot) |10.19|13.5|
151
- |MMLU-PRO (5-shot) |41.49|51.85|
152
 
153
  ## 🧩 Configuration
154
 
 
136
 
137
  ## 🏆 Evaluation
138
 
139
+ | Metric |**BigQwen2.5-Echo-47B-Instruct**|BigQwen2.5-52B-Instruct|Qwen2.5-32B-Instruct|
140
+ |-------------------|----:|----:|----:|
141
+ |Avg. |30.31|37.42|36.17|
142
+ |IFEval (0-Shot) |73.57|79.29|83.46|
143
+ |BBH (3-Shot) |44.52|59.81|56.49|
144
+ |MATH Lvl 5 (4-Shot)| 3.47|17.82|0|
145
+ |GPQA (0-shot) | 8.61| 6.94|11.74|
146
+ |MuSR (0-shot) |10.19|10.45|13.5|
147
+ |MMLU-PRO (5-shot) |41.49|50.22|51.85|
 
 
 
 
148
 
149
  ## 🧩 Configuration
150