Commit
•
c2d9432
1
Parent(s):
196a63b
Update README.md
Browse files
README.md
CHANGED
|
@@ -50,12 +50,13 @@ text = """\
|
|
| 50 |
|
| 51 |
### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
| 52 |
|
| 53 |
-
| Task |
|
| 54 |
-
| :--------------- |
|
| 55 |
-
| kobest_boolq |
|
| 56 |
-
| kobest_copa |
|
| 57 |
-
| kobest_hellaswag |
|
| 58 |
-
| kobest_sentineg |
|
|
|
|
| 59 |
|
| 60 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
| 61 |
|
|
|
|
| 50 |
|
| 51 |
### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
| 52 |
|
| 53 |
+
| Task | 0-shot | 5-shot | 10-shot | 50-shot |
|
| 54 |
+
| :--------------- | -------------: | -------------: | -------------: | ------------: |
|
| 55 |
+
| kobest_boolq | 0.334282 | 0.334282 | 0.334282 | 0.769923 |
|
| 56 |
+
| kobest_copa | 0.480501 | 0.475746 | 0.46338 | 0.475528 |
|
| 57 |
+
| kobest_hellaswag | 0.225818 | 0.240596 | 0.234316 | 0.449779 |
|
| 58 |
+
| kobest_sentineg | 0.33165 | 0.386189 | 0.366913 | 0.360296 |
|
| 59 |
+
| **Average** | **0.34306275** | **0.35920325** | **0.34972275** | **0.5138815** |
|
| 60 |
|
| 61 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
| 62 |
|