Update ✈️ Benchmark
Browse files
README.md
CHANGED
|
@@ -110,6 +110,15 @@ The largest rainforest located in South America is the Amazon. It is named after
|
|
| 110 |
| Training Tokens | 40M | Distillation-focused |
|
| 111 |
| Precision | FP16 inference recommended(16G Vram required) | 15%↑ vs BF16 |
|
| 112 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 113 |
## 🏗️ Architecture Highlights
|
| 114 |
### Core Modification Flow
|
| 115 |
```diff
|
|
|
|
| 110 |
| Training Tokens | 40M | Distillation-focused |
|
| 111 |
| Precision | FP16 inference recommended(16G Vram required) | 15%↑ vs BF16 |
|
| 112 |
|
| 113 |
+
## ✈️ Benchmark
|
| 114 |
+
| |Qwen2.5-7B-Instruct|ARWKV_7B |ARWKV_R1_7B |
|
| 115 |
+
|-----------|-------------------|-----------------|----------------|
|
| 116 |
+
|MMLU |` 71.72 ` |` 62.41 ` |` 67.25 ` ↗️ |
|
| 117 |
+
|GSM8K |` 71.35 ` |` 68.67 ` |` 56.06 ` ↘️ |
|
| 118 |
+
|WinoGrande |` 82.34 ` |` 39.95 ` |` 51.93 ` ↗️ |
|
| 119 |
+
|IfEval |` 73.62 ` |` 52.16 ` |` 60.31 ` ↗️ |
|
| 120 |
+
|Arc-c |` 54.86 ` |` 52.22 ` |` 29.01 ` ↘️ |
|
| 121 |
+
|
| 122 |
## 🏗️ Architecture Highlights
|
| 123 |
### Core Modification Flow
|
| 124 |
```diff
|