Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,17 @@ language:
|
|
7 |
pipeline_tag: text-generation
|
8 |
---
|
9 |
# Model Card for Model ID
|
10 |
-
base_model : [Ko-Llama3-Luxia-8B](https://huggingface.co/saltlux/Ko-Llama3-Luxia-8B)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
pipeline_tag: text-generation
|
8 |
---
|
9 |
# Model Card for Model ID
|
10 |
+
base_model : [Ko-Llama3-Luxia-8B](https://huggingface.co/saltlux/Ko-Llama3-Luxia-8B)
|
11 |
+
|
12 |
+
# Model Evaluation
|
13 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
14 |
+
|-----------------|-------|------|-----:|-----------|---|-----:|---|------|
|
15 |
+
|kobest_boolq | 1|none | 0|acc |↑ |0.5278|± |0.0133|
|
16 |
+
| | |none | 0|f1 |↑ |0.3954|± |N/A |
|
17 |
+
|kobest_copa | 1|none | 0|acc |↑ |0.7380|± |0.0139|
|
18 |
+
| | |none | 0|f1 |↑ |0.7372|± |N/A |
|
19 |
+
|kobest_hellaswag | 1|none | 0|acc |↑ |0.4800|± |0.0224|
|
20 |
+
| | |none | 0|acc_norm |↑ |0.6180|± |0.0218|
|
21 |
+
| | |none | 0|f1 |↑ |0.4774|± |N/A |
|
22 |
+
|kobest_sentineg | 1|none | 0|acc |↑ |0.5390|± |0.0250|
|
23 |
+
| | |none | 0|f1 |↑ |0.5037|± |N/A |
|