Hugging Face's logo

Edentns
/
DataVortexTL-1.1B-v0.1

Text Generation
Transformers
Safetensors
Korean
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
JeongwonChoi commited on
Commit
d6984dd
•
1 Parent(s): 0d1dea2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -10
README.md CHANGED
@@ -57,20 +57,24 @@ text = """\
57
 
58
  ## **Model Benchmark**
59
 
 
 
 
 
 
 
 
 
 
 
 
60
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
61
 
62
  On Benchmarking ...
63
 
64
- | Model | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
65
- | ---------------------------- | ------- | ------ | ------------ | ------- | ------------- | --------------- |
66
- | DataVortexM-7B-Instruct-v0.1 | 39.81 | 34.13 | 42.35 | 38.73 | 45.46 | 38.37 |
67
- | DataVortexS-10.7B-v0.1 | 0 | 0 | 0 | 0 | 0 | 0 |
68
- | DataVortexS-10.7B-v0.2 | 43.6 | 38.74 | 50.74 | 38.98 | 44.7 | 44.86 |
69
- | DataVortexS-10.7B-v0.3 | 0 | 0 | 0 | 0 | 0 | 0 |
70
- | DataVortexS-10.7B-v0.4 | 0 | 0 | 0 | 0 | 0 | 0 |
71
- | DataVortexS-10.7B-v1.0 | 0 | 0 | 0 | 0 | 0 | 0 |
72
- | **DataVortexTL-1.1B-v0.1** | **0** | **0** | **0** | **0** | **0** | **0** |
73
- | DataVortexS-10.7B-dpo-v0.1 | 0 | 0 | 0 | 0 | 0 | 0 |
74
 
75
  ## **Implementation Code**
76
 
 
57
 
58
  ## **Model Benchmark**
59
 
60
+ ### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
61
+
62
+ On Benchmarking ...
63
+
64
+ | Task | 0-shot | 5-shot | 10-shot | 50-shot |
65
+ | :--------------- | -----: | -----: | ------: | ------: |
66
+ | kobest_boolq | 0.0 | 0.0 | 0.0 | 0.0 |
67
+ | kobest_copa | 0.0 | 0.0 | 0.0 | 0.0 |
68
+ | kobest_hellaswag | 0.0 | 0.0 | 0.0 | 0.0 |
69
+ | kobest_sentineg | 0.0 | 0.0 | 0.0 | 0.0 |
70
+
71
  ### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
72
 
73
  On Benchmarking ...
74
 
75
+ | Average | Ko-ARC | Ko-HellaSwag | Ko-MMLU | Ko-TruthfulQA | Ko-CommonGen V2 |
76
+ | ------: | -----: | -----------: | ------: | ------------: | --------------: |
77
+ | 0 | 0 | 0 | 0 | 0 | 0 |
 
 
 
 
 
 
 
78
 
79
  ## **Implementation Code**
80