Commit
•
a4d378f
1
Parent(s):
6d90905
Update README.md
Browse files
README.md
CHANGED
|
@@ -59,12 +59,13 @@ text = """\
|
|
| 59 |
|
| 60 |
### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
| 61 |
|
| 62 |
-
| Task |
|
| 63 |
-
| :--------------- |
|
| 64 |
-
| kobest_boolq |
|
| 65 |
-
| kobest_copa |
|
| 66 |
-
| kobest_hellaswag |
|
| 67 |
-
| kobest_sentineg |
|
|
|
|
| 68 |
|
| 69 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
| 70 |
|
|
|
|
| 59 |
|
| 60 |
### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
| 61 |
|
| 62 |
+
| Task | 0-shot | 5-shot | 10-shot | 50-shot |
|
| 63 |
+
| :--------------- | -------------: | -------------: | -------------: | -----------: |
|
| 64 |
+
| kobest_boolq | 0.334282 | 0.516446 | 0.500478 | 0.498941 |
|
| 65 |
+
| kobest_copa | 0.515061 | 0.504321 | 0.492927 | 0.50809 |
|
| 66 |
+
| kobest_hellaswag | 0.36253 | 0.357733 | 0.355873 | 0.376502 |
|
| 67 |
+
| kobest_sentineg | 0.481146 | 0.657411 | 0.687417 | 0.635703 |
|
| 68 |
+
| **Average** | **0.42325475** | **0.50897775** | **0.50917375** | **0.504809** |
|
| 69 |
|
| 70 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
| 71 |
|