model update
Browse files
README.md
CHANGED
@@ -46,6 +46,24 @@ model-index:
|
|
46 |
- name: MoverScore (Question Generation)
|
47 |
type: moverscore_question_generation
|
48 |
value: 83.36
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
49 |
---
|
50 |
|
51 |
# Model Card of `lmqg/mt5-base-koquad-qg`
|
@@ -99,6 +117,18 @@ output = pipe("1990년 영화 《 <hl> 남부군 <hl> 》에서 단역으로 영
|
|
99 |
| ROUGE_L | 28.57 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
|
100 |
|
101 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
102 |
|
103 |
## Training hyperparameters
|
104 |
|
|
|
46 |
- name: MoverScore (Question Generation)
|
47 |
type: moverscore_question_generation
|
48 |
value: 83.36
|
49 |
+
- name: QAAlignedF1Score-BERTScore (Question & Answer Generation) [Gold Answer]
|
50 |
+
type: qa_aligned_f1_score_bertscore_question_answer_generation_gold_answer
|
51 |
+
value: 88.8
|
52 |
+
- name: QAAlignedRecall-BERTScore (Question & Answer Generation) [Gold Answer]
|
53 |
+
type: qa_aligned_recall_bertscore_question_answer_generation_gold_answer
|
54 |
+
value: 88.76
|
55 |
+
- name: QAAlignedPrecision-BERTScore (Question & Answer Generation) [Gold Answer]
|
56 |
+
type: qa_aligned_precision_bertscore_question_answer_generation_gold_answer
|
57 |
+
value: 88.84
|
58 |
+
- name: QAAlignedF1Score-MoverScore (Question & Answer Generation) [Gold Answer]
|
59 |
+
type: qa_aligned_f1_score_moverscore_question_answer_generation_gold_answer
|
60 |
+
value: 85.93
|
61 |
+
- name: QAAlignedRecall-MoverScore (Question & Answer Generation) [Gold Answer]
|
62 |
+
type: qa_aligned_recall_moverscore_question_answer_generation_gold_answer
|
63 |
+
value: 85.87
|
64 |
+
- name: QAAlignedPrecision-MoverScore (Question & Answer Generation) [Gold Answer]
|
65 |
+
type: qa_aligned_precision_moverscore_question_answer_generation_gold_answer
|
66 |
+
value: 86.01
|
67 |
---
|
68 |
|
69 |
# Model Card of `lmqg/mt5-base-koquad-qg`
|
|
|
117 |
| ROUGE_L | 28.57 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
|
118 |
|
119 |
|
120 |
+
- ***Metric (Question & Answer Generation)***: QAG metrics are computed with *the gold answer* and generated question on it for this model, as the model cannot provide an answer. [raw metric file](https://huggingface.co/lmqg/mt5-base-koquad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_koquad.default.json)
|
121 |
+
|
122 |
+
| | Score | Type | Dataset |
|
123 |
+
|:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|
|
124 |
+
| QAAlignedF1Score (BERTScore) | 88.8 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
|
125 |
+
| QAAlignedF1Score (MoverScore) | 85.93 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
|
126 |
+
| QAAlignedPrecision (BERTScore) | 88.84 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
|
127 |
+
| QAAlignedPrecision (MoverScore) | 86.01 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
|
128 |
+
| QAAlignedRecall (BERTScore) | 88.76 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
|
129 |
+
| QAAlignedRecall (MoverScore) | 85.87 | default | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) |
|
130 |
+
|
131 |
+
|
132 |
|
133 |
## Training hyperparameters
|
134 |
|