solemn-leader
commited on
Commit
•
e7c205f
1
Parent(s):
cc2664b
Update README.md
Browse files
README.md
CHANGED
@@ -16,9 +16,9 @@ This generation model is based on [sberbank-ai/rugpt3medium_based_on_gpt2](https
|
|
16 |
The model was trained with context size 3
|
17 |
|
18 |
|
19 |
-
On a validation set we calculated metrics introduced in [this paper](https://arxiv.org/pdf/2001.09977.pdf):
|
20 |
-
- Sensibleness:
|
21 |
-
- Specificity:
|
22 |
- SSA which is the average of two metrics above (Sensibleness Specificity Average)
|
23 |
|
24 |
| | sensibleness | specificity | SSA |
|
|
|
16 |
The model was trained with context size 3
|
17 |
|
18 |
|
19 |
+
On a private validation set we calculated metrics introduced in [this paper](https://arxiv.org/pdf/2001.09977.pdf):
|
20 |
+
- Sensibleness: Crowdsourcers were asked whether model's response makes sense given the context
|
21 |
+
- Specificity: Crowdsourcers were asked whether model's response is specific for given context, in other words we don't want our model to give general and boring responses
|
22 |
- SSA which is the average of two metrics above (Sensibleness Specificity Average)
|
23 |
|
24 |
| | sensibleness | specificity | SSA |
|