appvoid commited on
Commit
59a6f63
·
verified ·
1 Parent(s): 96aa8c7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -16,8 +16,9 @@ zero-shot evaluations performed on current sota small models; mmlu is still the
16
 
17
  | Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
18
  | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
19
- | 0.5b | qwen2.5 |47.29|31.83|52.17|70.29|57.06|51.72|
20
- | 0.5b | arco |26.17|37.29|62.88|74.37|62.27|52.60|
 
21
  | 1.7b | smollm |27.65|**46.26**|65.74|76.06|60.93| 55.33|
22
  | 1.8B | niro-preview |41.75|40.96|**72.07**|**77.97**|**65.51**|**59.65**|
23
- | 1.5b | qwen2.5 |**58.68**|44.71|67.62|75.73|62.67|**61.88**|
 
16
 
17
  | Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
18
  | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
19
+ | 0.5b | qwen 2.5 |47.29|31.83|52.17|70.29|57.06|51.72|
20
+ | 0.5b | arco |26.17|37.29|62.88|74.37|62.27|52.60|
21
+ | 0.5b | arco (exp) |25.51|38.82|63.02|74.70|61.25|52.66|
22
  | 1.7b | smollm |27.65|**46.26**|65.74|76.06|60.93| 55.33|
23
  | 1.8B | niro-preview |41.75|40.96|**72.07**|**77.97**|**65.51**|**59.65**|
24
+ | 1.5b | qwen 2.5 |**58.68**|44.71|67.62|75.73|62.67|**61.88**|