davidkim205
commited on
Commit
•
4b8d2c4
1
Parent(s):
3a73f4d
Update README.md
Browse files
README.md
CHANGED
@@ -23,8 +23,8 @@ Through this, users are expected to be able to freely conduct research and devel
|
|
23 |
* **Model Developers** : davidkim(changyeon kim)
|
24 |
* **Repository** : https://github.com/davidkim205/nox(will be updated soon.)
|
25 |
* **base mode** : Edentns/DataVortexS-10.7B-dpo-v1.11
|
26 |
-
* **sft dataset** :
|
27 |
-
* **dpo dataset** :
|
28 |
* **evalution** : [kollm_evalution](https://github.com/davidkim205/kollm_evaluation)
|
29 |
* **evalution dataset** : [open-ko-llm-leaderboard datasets](https://huggingface.co/collections/davidkim205/open-ko-llm-leaderboard-datasets-65eea9e87fc3ae80787ee15a)
|
30 |
|
@@ -37,4 +37,6 @@ Through this, users are expected to be able to freely conduct research and devel
|
|
37 |
|
38 |
|
39 |
### [kollm_evalution](https://github.com/davidkim205/kollm_evalution)
|
40 |
-
|
|
|
|
|
|
23 |
* **Model Developers** : davidkim(changyeon kim)
|
24 |
* **Repository** : https://github.com/davidkim205/nox(will be updated soon.)
|
25 |
* **base mode** : Edentns/DataVortexS-10.7B-dpo-v1.11
|
26 |
+
* **sft dataset** : [davidkim205/kollm-converations](https://huggingface.co/datasets/davidkim205/kollm-converations)
|
27 |
+
* **dpo dataset** : [davidkim205/kollm-comparision](https://huggingface.co/datasets/davidkim205/kollm-comparision)
|
28 |
* **evalution** : [kollm_evalution](https://github.com/davidkim205/kollm_evaluation)
|
29 |
* **evalution dataset** : [open-ko-llm-leaderboard datasets](https://huggingface.co/collections/davidkim205/open-ko-llm-leaderboard-datasets-65eea9e87fc3ae80787ee15a)
|
30 |
|
|
|
37 |
|
38 |
|
39 |
### [kollm_evalution](https://github.com/davidkim205/kollm_evalution)
|
40 |
+
| model | Average | Ko-TruthfulQA_mc1 | Ko-MMLU | Ko-HellaSwag | Ko-CommonGen V2 | Ko-ARC-Easy | kobest | kobest_boolq | kobest_copa | kobest_hellaswag | kobest_sentineg | kobest_wic |
|
41 |
+
| ----------------------------------- | ----------- | ----------------- | ------- | ------------ | --------------- | ----------- | ------ | ------------ | ----------- | ---------------- | --------------- | ---------- |
|
42 |
+
| davidkim205/nox-solar-10.7b-v4 | 69.48 | 63.16 | 48.59 | 85.93 | 87.21 | 71.16 | 60.8 | 55.91 | 77.5 | 57 | 89.67 | 48.81 |
|