Update README.md
Browse files
README.md
CHANGED
|
@@ -8,4 +8,17 @@ pipeline_tag: text-generation
|
|
| 8 |
---
|
| 9 |
# Model Card for Model ID
|
| 10 |
|
| 11 |
-
base_model : [Ko-Llama3-Luxia-8B](https://huggingface.co/saltlux/Ko-Llama3-Luxia-8B)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
---
|
| 9 |
# Model Card for Model ID
|
| 10 |
|
| 11 |
+
base_model : [Ko-Llama3-Luxia-8B](https://huggingface.co/saltlux/Ko-Llama3-Luxia-8B)
|
| 12 |
+
|
| 13 |
+
# Evaluation kobest
|
| 14 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 15 |
+
|----------------|------:|------|-----:|--------|---|-----:|---|------|
|
| 16 |
+
|kobest_boolq | 1|none | 0|acc |↑ |0.6425|± |0.0128|
|
| 17 |
+
| | |none | 0|f1 |↑ |0.6054|± |N/A |
|
| 18 |
+
|kobest_copa | 1|none | 0|acc |↑ |0.7340|± |0.0140|
|
| 19 |
+
| | |none | 0|f1 |↑ |0.7333|± |N/A |
|
| 20 |
+
|kobest_hellaswag| 1|none | 0|acc |↑ |0.4760|± |0.0224|
|
| 21 |
+
| | |none | 0|acc_norm|↑ |0.6120|± |0.0218|
|
| 22 |
+
| | |none | 0|f1 |↑ |0.4745|± |N/A |
|
| 23 |
+
|kobest_sentineg | 1|none | 0|acc |↑ |0.5894|± |0.0247|
|
| 24 |
+
| | |none | 0|f1 |↑ |0.5682|± |N/A |
|