Hugging Face's logo

Edentns
/
DataVortexS-10.7B-v0.4

Text Generation
Transformers
Safetensors
Korean
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
JeongwonChoi commited on
Commit
b460c0e
•
1 Parent(s): 650f1ae

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -10
README.md CHANGED
@@ -69,20 +69,24 @@ text = """\
69
 
70
  ## **Model Benchmark**
71
 
 
 
 
 
 
 
 
 
 
 
 
72
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
73
 
74
  On Benchmarking ...
75
 
76
- | Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
77
- | ---------------------------- | ------- | ------ | ------------ | ------- | ------------- | --------------- |
78
- | DataVortexM-7B-Instruct-v0.1 | 39.81 | 34.13 | 42.35 | 38.73 | 45.46 | 38.37 |
79
- | DataVortexS-10.7B-v0.1 | 0 | 0 | 0 | 0 | 0 | 0 |
80
- | DataVortexS-10.7B-v0.2 | 43.6 | 38.74 | 50.74 | 38.98 | 44.7 | 44.86 |
81
- | DataVortexS-10.7B-v0.3 | 0 | 0 | 0 | 0 | 0 | 0 |
82
- | **DataVortexS-10.7B-v0.4** | **0** | **0** | **0** | **0** | **0** | **0** |
83
- | DataVortexS-10.7B-v1.0 | 0 | 0 | 0 | 0 | 0 | 0 |
84
- | DataVortexTL-1.1B-v0.1 | 0 | 0 | 0 | 0 | 0 | 0 |
85
- | DataVortexS-10.7B-dpo-v0.1 | 0 | 0 | 0 | 0 | 0 | 0 |
86
 
87
  ## **Implementation Code**
88
 
 
69
 
70
  ## **Model Benchmark**
71
 
72
+ ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
73
+
74
+ On Benchmarking ...
75
+
76
+ | Task | 0-shot | 5-shot | 10-shot | 50-shot |
77
+ | :--------------- | -----: | -----: | ------: | ------: |
78
+ | kobest_boolq | 0.0 | 0.0 | 0.0 | 0.0 |
79
+ | kobest_copa | 0.0 | 0.0 | 0.0 | 0.0 |
80
+ | kobest_hellaswag | 0.0 | 0.0 | 0.0 | 0.0 |
81
+ | kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
82
+
83
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
84
 
85
  On Benchmarking ...
86
 
87
+ | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
88
+ | ------: | -----: | -----------: | ------: | ------------: | --------------: |
89
+ | 0 | 0 | 0 | 0 | 0 | 0 |
 
 
 
 
 
 
 
90
 
91
  ## **Implementation Code**
92