asahi417 commited on
Commit
f61e2fd
1 Parent(s): 071d2e2

model update

Browse files
Files changed (1) hide show
  1. README.md +23 -23
README.md CHANGED
@@ -46,38 +46,38 @@ model-index:
46
  - name: MoverScore (Question Generation)
47
  type: moverscore_question_generation
48
  value: 82.49
49
- - name: BLEU4 (Question & Answer Generation (with Gold Answer))
50
- type: bleu4_question_answer_generation_with_gold_answer
51
  value: 10.86
52
- - name: ROUGE-L (Question & Answer Generation (with Gold Answer))
53
- type: rouge_l_question_answer_generation_with_gold_answer
54
  value: 46.66
55
- - name: METEOR (Question & Answer Generation (with Gold Answer))
56
- type: meteor_question_answer_generation_with_gold_answer
57
  value: 36.66
58
- - name: BERTScore (Question & Answer Generation (with Gold Answer))
59
- type: bertscore_question_answer_generation_with_gold_answer
60
  value: 87.21
61
- - name: MoverScore (Question & Answer Generation (with Gold Answer))
62
- type: moverscore_question_answer_generation_with_gold_answer
63
  value: 84.46
64
- - name: QAAlignedF1Score-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
65
- type: qa_aligned_f1_score_bertscore_question_answer_generation_with_gold_answer_gold_answer
66
  value: 87.52
67
- - name: QAAlignedRecall-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
68
- type: qa_aligned_recall_bertscore_question_answer_generation_with_gold_answer_gold_answer
69
  value: 87.49
70
- - name: QAAlignedPrecision-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
71
- type: qa_aligned_precision_bertscore_question_answer_generation_with_gold_answer_gold_answer
72
  value: 87.57
73
- - name: QAAlignedF1Score-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
74
- type: qa_aligned_f1_score_moverscore_question_answer_generation_with_gold_answer_gold_answer
75
  value: 85.15
76
- - name: QAAlignedRecall-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
77
- type: qa_aligned_recall_moverscore_question_answer_generation_with_gold_answer_gold_answer
78
  value: 85.09
79
- - name: QAAlignedPrecision-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
80
- type: qa_aligned_precision_moverscore_question_answer_generation_with_gold_answer_gold_answer
81
  value: 85.23
82
  ---
83
 
@@ -132,7 +132,7 @@ output = pipe("1990년 영화 《 <hl> 남부군 <hl> 》에서 단역으로 영
132
  | ROUGE_L | 25.64 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
133
 
134
 
135
- - ***Metric (Question & Answer Generation, Reference Answer)***: Each question is generated from *the gold answer*. [raw metric file](https://huggingface.co/lmqg/mt5-small-koquad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_koquad.default.json)
136
 
137
  | | Score | Type | Dataset |
138
  |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|
 
46
  - name: MoverScore (Question Generation)
47
  type: moverscore_question_generation
48
  value: 82.49
49
+ - name: BLEU4 (Question & Answer Generation)
50
+ type: bleu4_question_answer_generation
51
  value: 10.86
52
+ - name: ROUGE-L (Question & Answer Generation)
53
+ type: rouge_l_question_answer_generation
54
  value: 46.66
55
+ - name: METEOR (Question & Answer Generation)
56
+ type: meteor_question_answer_generation
57
  value: 36.66
58
+ - name: BERTScore (Question & Answer Generation)
59
+ type: bertscore_question_answer_generation
60
  value: 87.21
61
+ - name: MoverScore (Question & Answer Generation)
62
+ type: moverscore_question_answer_generation
63
  value: 84.46
64
+ - name: QAAlignedF1Score-BERTScore (Question & Answer Generation) [Gold Answer]
65
+ type: qa_aligned_f1_score_bertscore_question_answer_generation_gold_answer
66
  value: 87.52
67
+ - name: QAAlignedRecall-BERTScore (Question & Answer Generation) [Gold Answer]
68
+ type: qa_aligned_recall_bertscore_question_answer_generation_gold_answer
69
  value: 87.49
70
+ - name: QAAlignedPrecision-BERTScore (Question & Answer Generation) [Gold Answer]
71
+ type: qa_aligned_precision_bertscore_question_answer_generation_gold_answer
72
  value: 87.57
73
+ - name: QAAlignedF1Score-MoverScore (Question & Answer Generation) [Gold Answer]
74
+ type: qa_aligned_f1_score_moverscore_question_answer_generation_gold_answer
75
  value: 85.15
76
+ - name: QAAlignedRecall-MoverScore (Question & Answer Generation) [Gold Answer]
77
+ type: qa_aligned_recall_moverscore_question_answer_generation_gold_answer
78
  value: 85.09
79
+ - name: QAAlignedPrecision-MoverScore (Question & Answer Generation) [Gold Answer]
80
+ type: qa_aligned_precision_moverscore_question_answer_generation_gold_answer
81
  value: 85.23
82
  ---
83
 
 
132
  | ROUGE_L | 25.64 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
133
 
134
 
135
+ - ***Metric (Question & Answer Generation)***: QAG metrics are computed with *the gold answer* and generated question on it for this model, as the model cannot provide an answer. [raw metric file](https://huggingface.co/lmqg/mt5-small-koquad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_koquad.default.json)
136
 
137
  | | Score | Type | Dataset |
138
  |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|