kyujinpy commited on
Commit
d164f9f
1 Parent(s): 2f497ce

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -33,11 +33,11 @@ license: cc-by-nc-sa-4.0
33
 
34
  ---
35
  # Model comparisons2
36
- > AI-Harness evaluation; [link]()
37
 
38
  | Model | Copa | Copa | HellaSwag | HellaSwag | BoolQ | BoolQ | Sentineg | Sentineg |
39
- | | 0-shot | 5-shot | 0-shot | 5-shot | 0-shot | 5-shot | 0-shot | 5-shot |
40
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
 
41
  | **⭐My custom LLM 13B⭐** | NaN | 0.8269 | NaN | 0.5660 | NaN | 0.5060 | NaN | 0.9723 |
42
  | [beomi/llama-2-koen-13b](https://huggingface.co/beomi/llama-2-koen-13b) | 0.7768 | 0.8128 | 0.4999 | 0.5127| 0.3988 | 0.7038 | 0.5870 | 0.9748 |
43
 
 
33
 
34
  ---
35
  # Model comparisons2
36
+ > AI-Harness evaluation; [link](https://github.com/Beomi/ko-lm-evaluation-harness)
37
 
38
  | Model | Copa | Copa | HellaSwag | HellaSwag | BoolQ | BoolQ | Sentineg | Sentineg |
 
39
  | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
40
+ | NaN | 0-shot | 5-shot | 0-shot | 5-shot | 0-shot | 5-shot | 0-shot | 5-shot |
41
  | **⭐My custom LLM 13B⭐** | NaN | 0.8269 | NaN | 0.5660 | NaN | 0.5060 | NaN | 0.9723 |
42
  | [beomi/llama-2-koen-13b](https://huggingface.co/beomi/llama-2-koen-13b) | 0.7768 | 0.8128 | 0.4999 | 0.5127| 0.3988 | 0.7038 | 0.5870 | 0.9748 |
43