CarrotAI commited on
Commit
a7541f5
ยท
verified ยท
1 Parent(s): 82ceff6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -24
README.md CHANGED
@@ -15,30 +15,29 @@ axolotl๋ฅผ ์ด์šฉํ•˜์—ฌ ๊ณต๊ฐœ/์ž์ฒด์ ์œผ๋กœ ์ƒ์„ฑ๋œ ํ•œ๊ตญ์–ด, ์˜์–ด ๋ฐ
15
  ### Model Description
16
 
17
  ### Socre
18
- ```
19
- // llm_kr_eval
20
- "scores": {
21
- "AVG_llm_kr_eval": "0.4282",
22
- "EL": "0.1264",
23
- "FA": "0.2184",
24
- "NLI": "0.5767",
25
- "QA": "0.5100",
26
- "RC": "0.7096",
27
- "klue_ner_set_f1": "0.1429",
28
- "klue_re_exact_match": "0.1100",
29
- "kmmlu_preview_exact_match": "0.4400",
30
- "kobest_copa_exact_match": "0.8100",
31
- "kobest_hs_exact_match": "0.3800",
32
- "kobest_sn_exact_match": "0.9000",
33
- "kobest_wic_exact_match": "0.5800",
34
- "korea_cg_bleu": "0.2184",
35
- "kornli_exact_match": "0.5400",
36
- "korsts_pearson": "0.6225",
37
- "korsts_spearman": "0.6064"
38
- }
39
- ```
40
-
41
- ### LogicKor
42
  | ์นดํ…Œ๊ณ ๋ฆฌ | ์‹ฑ๊ธ€ ์ ์ˆ˜ ํ‰๊ท  | ๋ฉ€ํ‹ฐ ์ ์ˆ˜ ํ‰๊ท  |
43
  | --- | --- | --- |
44
  | ์ˆ˜ํ•™(Math) | 4.43 | 3.71 |
 
15
  ### Model Description
16
 
17
  ### Socre
18
+
19
+ #### llm_kr_eval
20
+ | ํ‰๊ฐ€ ์ง€ํ‘œ | ์ ์ˆ˜ |
21
+ | --- | --- |
22
+ | AVG_llm_ok_eval | 0.4282 |
23
+ | EL (Easy Language) | 0.1264 |
24
+ | FA (False Alarm) | 0.2184 |
25
+ | NLI (Natural Language Understanding) | 0.5767 |
26
+ | QA (Question Answering) | 0.5100 |
27
+ | RC (Reconstruction) | 0.7096 |
28
+ | klue_ner_set_f1 (Klue Named Entity Recognition F1 Score) | 0.1429 |
29
+ | klue_re_exact_match (Klue Reference Exact Match) | 0.1100 |
30
+ | kmmlu_preview_exact_match (Kmmlu Preview Exact Match) | 0.4400 |
31
+ | kobest_copa_exact_match (Kobest COPA Exact Match) | 0.8100 |
32
+ | kobest_hs_exact_match (Kobest HS Exact Match) | 0.3800 |
33
+ | kobest_sn_exact_match (Kobest SN Exact Match) | 0.9000 |
34
+ | kobest_wic_exact_match (Kobest WIC Exact Match) | 0.5800 |
35
+ | korea_cg_bleu (Korean CG BLEU) | 0.2184 |
36
+ | kornli_exact_match (KornLI Exact Match) | 0.5400 |
37
+ | korsts_pearson (KorSTS Pearson Correlation Coefficient) | 0.6225 |
38
+ | korsts_spearman (KorSTS Spearman Rank Correlation Coefficient) | 0.6064 |
39
+
40
+ #### LogicKor
 
41
  | ์นดํ…Œ๊ณ ๋ฆฌ | ์‹ฑ๊ธ€ ์ ์ˆ˜ ํ‰๊ท  | ๋ฉ€ํ‹ฐ ์ ์ˆ˜ ํ‰๊ท  |
42
  | --- | --- | --- |
43
  | ์ˆ˜ํ•™(Math) | 4.43 | 3.71 |