hippopotam
commited on
Commit
•
5be9300
1
Parent(s):
559f237
update model card README.md
Browse files
README.md
ADDED
@@ -0,0 +1,337 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
tags:
|
4 |
+
- generated_from_trainer
|
5 |
+
datasets:
|
6 |
+
- common_voice_13_0
|
7 |
+
metrics:
|
8 |
+
- wer
|
9 |
+
model-index:
|
10 |
+
- name: wav2vec2-common_voice13
|
11 |
+
results:
|
12 |
+
- task:
|
13 |
+
name: Automatic Speech Recognition
|
14 |
+
type: automatic-speech-recognition
|
15 |
+
dataset:
|
16 |
+
name: common_voice_13_0
|
17 |
+
type: common_voice_13_0
|
18 |
+
config: tr
|
19 |
+
split: test
|
20 |
+
args: tr
|
21 |
+
metrics:
|
22 |
+
- name: Wer
|
23 |
+
type: wer
|
24 |
+
value: 0.2934764687562973
|
25 |
+
---
|
26 |
+
|
27 |
+
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
28 |
+
should probably proofread and complete it, then remove this comment. -->
|
29 |
+
|
30 |
+
# wav2vec2-common_voice13
|
31 |
+
|
32 |
+
This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on the common_voice_13_0 dataset.
|
33 |
+
It achieves the following results on the evaluation set:
|
34 |
+
- Loss: 0.3366
|
35 |
+
- Wer: 0.2935
|
36 |
+
|
37 |
+
## Model description
|
38 |
+
|
39 |
+
More information needed
|
40 |
+
|
41 |
+
## Intended uses & limitations
|
42 |
+
|
43 |
+
More information needed
|
44 |
+
|
45 |
+
## Training and evaluation data
|
46 |
+
|
47 |
+
More information needed
|
48 |
+
|
49 |
+
## Training procedure
|
50 |
+
|
51 |
+
### Training hyperparameters
|
52 |
+
|
53 |
+
The following hyperparameters were used during training:
|
54 |
+
- learning_rate: 0.0003
|
55 |
+
- train_batch_size: 32
|
56 |
+
- eval_batch_size: 16
|
57 |
+
- seed: 42
|
58 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
59 |
+
- lr_scheduler_type: linear
|
60 |
+
- lr_scheduler_warmup_steps: 500
|
61 |
+
- num_epochs: 20.0
|
62 |
+
- mixed_precision_training: Native AMP
|
63 |
+
|
64 |
+
### Training results
|
65 |
+
|
66 |
+
| Training Loss | Epoch | Step | Validation Loss | Wer |
|
67 |
+
|:-------------:|:-----:|:-----:|:---------------:|:------:|
|
68 |
+
| 4.0301 | 0.08 | 100 | 4.0286 | 1.0 |
|
69 |
+
| 3.1668 | 0.15 | 200 | 3.2323 | 1.0 |
|
70 |
+
| 2.3413 | 0.23 | 300 | 2.1300 | 0.9986 |
|
71 |
+
| 1.4546 | 0.31 | 400 | 0.8731 | 0.7629 |
|
72 |
+
| 1.4595 | 0.38 | 500 | 0.7366 | 0.7386 |
|
73 |
+
| 1.1903 | 0.46 | 600 | 0.6131 | 0.6645 |
|
74 |
+
| 1.1586 | 0.53 | 700 | 0.5491 | 0.6195 |
|
75 |
+
| 0.8275 | 0.61 | 800 | 0.5159 | 0.5923 |
|
76 |
+
| 1.0042 | 0.69 | 900 | 0.5153 | 0.6040 |
|
77 |
+
| 0.9428 | 0.76 | 1000 | 0.4629 | 0.5602 |
|
78 |
+
| 0.7592 | 0.84 | 1100 | 0.4670 | 0.5520 |
|
79 |
+
| 0.8284 | 0.92 | 1200 | 0.4455 | 0.5760 |
|
80 |
+
| 0.7736 | 0.99 | 1300 | 0.4571 | 0.5480 |
|
81 |
+
| 0.4047 | 1.07 | 1400 | 0.3962 | 0.4940 |
|
82 |
+
| 0.3543 | 1.14 | 1500 | 0.4018 | 0.4969 |
|
83 |
+
| 0.3898 | 1.22 | 1600 | 0.3901 | 0.4862 |
|
84 |
+
| 0.3827 | 1.3 | 1700 | 0.3982 | 0.4954 |
|
85 |
+
| 0.3316 | 1.37 | 1800 | 0.4139 | 0.5032 |
|
86 |
+
| 0.3365 | 1.45 | 1900 | 0.3964 | 0.4878 |
|
87 |
+
| 0.251 | 1.53 | 2000 | 0.4028 | 0.4899 |
|
88 |
+
| 0.2419 | 1.6 | 2100 | 0.3991 | 0.5190 |
|
89 |
+
| 0.3094 | 1.68 | 2200 | 0.3700 | 0.4865 |
|
90 |
+
| 0.3459 | 1.75 | 2300 | 0.3652 | 0.4850 |
|
91 |
+
| 0.3085 | 1.83 | 2400 | 0.3806 | 0.4742 |
|
92 |
+
| 0.4463 | 1.91 | 2500 | 0.3804 | 0.4729 |
|
93 |
+
| 0.2359 | 1.98 | 2600 | 0.3696 | 0.4635 |
|
94 |
+
| 0.1502 | 2.06 | 2700 | 0.3764 | 0.4602 |
|
95 |
+
| 0.2819 | 2.14 | 2800 | 0.3740 | 0.4499 |
|
96 |
+
| 0.22 | 2.21 | 2900 | 0.3811 | 0.4597 |
|
97 |
+
| 0.287 | 2.29 | 3000 | 0.3562 | 0.4334 |
|
98 |
+
| 0.2531 | 2.36 | 3100 | 0.3700 | 0.4442 |
|
99 |
+
| 0.3143 | 2.44 | 3200 | 0.3548 | 0.4333 |
|
100 |
+
| 0.203 | 2.52 | 3300 | 0.3659 | 0.4558 |
|
101 |
+
| 0.2609 | 2.59 | 3400 | 0.3557 | 0.4468 |
|
102 |
+
| 0.191 | 2.67 | 3500 | 0.3476 | 0.4281 |
|
103 |
+
| 0.1354 | 2.75 | 3600 | 0.3650 | 0.4354 |
|
104 |
+
| 0.2345 | 2.82 | 3700 | 0.3479 | 0.4385 |
|
105 |
+
| 0.1951 | 2.9 | 3800 | 0.3508 | 0.4489 |
|
106 |
+
| 0.2991 | 2.97 | 3900 | 0.3585 | 0.4356 |
|
107 |
+
| 0.1579 | 3.05 | 4000 | 0.3603 | 0.4326 |
|
108 |
+
| 0.2319 | 3.13 | 4100 | 0.3442 | 0.4201 |
|
109 |
+
| 0.1941 | 3.2 | 4200 | 0.3344 | 0.4116 |
|
110 |
+
| 0.2561 | 3.28 | 4300 | 0.3475 | 0.4200 |
|
111 |
+
| 0.3208 | 3.36 | 4400 | 0.3505 | 0.4089 |
|
112 |
+
| 0.2555 | 3.43 | 4500 | 0.3593 | 0.4271 |
|
113 |
+
| 0.1927 | 3.51 | 4600 | 0.3536 | 0.4299 |
|
114 |
+
| 0.1994 | 3.59 | 4700 | 0.3672 | 0.4400 |
|
115 |
+
| 0.1357 | 3.66 | 4800 | 0.3433 | 0.4223 |
|
116 |
+
| 0.2043 | 3.74 | 4900 | 0.3471 | 0.4226 |
|
117 |
+
| 0.194 | 3.81 | 5000 | 0.3380 | 0.4230 |
|
118 |
+
| 0.1779 | 3.89 | 5100 | 0.3400 | 0.4130 |
|
119 |
+
| 0.1934 | 3.97 | 5200 | 0.3438 | 0.4104 |
|
120 |
+
| 0.1432 | 4.04 | 5300 | 0.3632 | 0.4254 |
|
121 |
+
| 0.1642 | 4.12 | 5400 | 0.3425 | 0.4237 |
|
122 |
+
| 0.2208 | 4.2 | 5500 | 0.3580 | 0.4132 |
|
123 |
+
| 0.1923 | 4.27 | 5600 | 0.3469 | 0.4143 |
|
124 |
+
| 0.2084 | 4.35 | 5700 | 0.3619 | 0.4252 |
|
125 |
+
| 0.2484 | 4.42 | 5800 | 0.3452 | 0.4210 |
|
126 |
+
| 0.1899 | 4.5 | 5900 | 0.3465 | 0.4136 |
|
127 |
+
| 0.1253 | 4.58 | 6000 | 0.3625 | 0.4150 |
|
128 |
+
| 0.1353 | 4.65 | 6100 | 0.3415 | 0.4182 |
|
129 |
+
| 0.2264 | 4.73 | 6200 | 0.3446 | 0.4153 |
|
130 |
+
| 0.2016 | 4.81 | 6300 | 0.3343 | 0.4087 |
|
131 |
+
| 0.1634 | 4.88 | 6400 | 0.3500 | 0.4253 |
|
132 |
+
| 0.2517 | 4.96 | 6500 | 0.3453 | 0.4291 |
|
133 |
+
| 0.1826 | 5.03 | 6600 | 0.3442 | 0.4106 |
|
134 |
+
| 0.174 | 5.11 | 6700 | 0.3478 | 0.3999 |
|
135 |
+
| 0.271 | 5.19 | 6800 | 0.3423 | 0.4023 |
|
136 |
+
| 0.1812 | 5.26 | 6900 | 0.3679 | 0.4200 |
|
137 |
+
| 0.3 | 5.34 | 7000 | 0.3583 | 0.4191 |
|
138 |
+
| 0.2678 | 5.42 | 7100 | 0.3534 | 0.4141 |
|
139 |
+
| 0.236 | 5.49 | 7200 | 0.3361 | 0.4041 |
|
140 |
+
| 0.1558 | 5.57 | 7300 | 0.3495 | 0.4126 |
|
141 |
+
| 0.2603 | 5.64 | 7400 | 0.3359 | 0.3969 |
|
142 |
+
| 0.1285 | 5.72 | 7500 | 0.3296 | 0.3994 |
|
143 |
+
| 0.4608 | 5.8 | 7600 | 0.3453 | 0.3933 |
|
144 |
+
| 0.1516 | 5.87 | 7700 | 0.3509 | 0.4028 |
|
145 |
+
| 0.2655 | 5.95 | 7800 | 0.3607 | 0.4109 |
|
146 |
+
| 0.22 | 6.03 | 7900 | 0.3392 | 0.3850 |
|
147 |
+
| 0.0787 | 6.1 | 8000 | 0.3395 | 0.3842 |
|
148 |
+
| 0.1297 | 6.18 | 8100 | 0.3356 | 0.3822 |
|
149 |
+
| 0.1747 | 6.25 | 8200 | 0.3275 | 0.3874 |
|
150 |
+
| 0.1647 | 6.33 | 8300 | 0.3554 | 0.3941 |
|
151 |
+
| 0.1314 | 6.41 | 8400 | 0.3287 | 0.3826 |
|
152 |
+
| 0.1264 | 6.48 | 8500 | 0.3122 | 0.3876 |
|
153 |
+
| 0.1229 | 6.56 | 8600 | 0.3525 | 0.3994 |
|
154 |
+
| 0.108 | 6.64 | 8700 | 0.3387 | 0.3968 |
|
155 |
+
| 0.185 | 6.71 | 8800 | 0.3333 | 0.3840 |
|
156 |
+
| 0.0924 | 6.79 | 8900 | 0.3366 | 0.3827 |
|
157 |
+
| 0.1226 | 6.86 | 9000 | 0.3243 | 0.3788 |
|
158 |
+
| 0.2005 | 6.94 | 9100 | 0.3324 | 0.3765 |
|
159 |
+
| 0.133 | 7.02 | 9200 | 0.3294 | 0.3688 |
|
160 |
+
| 0.0633 | 7.09 | 9300 | 0.3279 | 0.3738 |
|
161 |
+
| 0.0593 | 7.17 | 9400 | 0.3311 | 0.3639 |
|
162 |
+
| 0.088 | 7.25 | 9500 | 0.3221 | 0.3765 |
|
163 |
+
| 0.1489 | 7.32 | 9600 | 0.3421 | 0.3788 |
|
164 |
+
| 0.1175 | 7.4 | 9700 | 0.3191 | 0.3786 |
|
165 |
+
| 0.0983 | 7.48 | 9800 | 0.3303 | 0.3764 |
|
166 |
+
| 0.1493 | 7.55 | 9900 | 0.3371 | 0.3836 |
|
167 |
+
| 0.1091 | 7.63 | 10000 | 0.3410 | 0.3739 |
|
168 |
+
| 0.1058 | 7.7 | 10100 | 0.3262 | 0.3730 |
|
169 |
+
| 0.0849 | 7.78 | 10200 | 0.3379 | 0.3812 |
|
170 |
+
| 0.1362 | 7.86 | 10300 | 0.3291 | 0.3781 |
|
171 |
+
| 0.1227 | 7.93 | 10400 | 0.3235 | 0.3760 |
|
172 |
+
| 0.1647 | 8.01 | 10500 | 0.3285 | 0.3686 |
|
173 |
+
| 0.1013 | 8.09 | 10600 | 0.3319 | 0.3729 |
|
174 |
+
| 0.1432 | 8.16 | 10700 | 0.3280 | 0.3731 |
|
175 |
+
| 0.1345 | 8.24 | 10800 | 0.3237 | 0.3707 |
|
176 |
+
| 0.0813 | 8.31 | 10900 | 0.3285 | 0.3748 |
|
177 |
+
| 0.1063 | 8.39 | 11000 | 0.3321 | 0.3748 |
|
178 |
+
| 0.1342 | 8.47 | 11100 | 0.3171 | 0.3647 |
|
179 |
+
| 0.1202 | 8.54 | 11200 | 0.3209 | 0.3636 |
|
180 |
+
| 0.0987 | 8.62 | 11300 | 0.3224 | 0.3625 |
|
181 |
+
| 0.1357 | 8.7 | 11400 | 0.3245 | 0.3646 |
|
182 |
+
| 0.1038 | 8.77 | 11500 | 0.3172 | 0.3702 |
|
183 |
+
| 0.0961 | 8.85 | 11600 | 0.3080 | 0.3611 |
|
184 |
+
| 0.1836 | 8.92 | 11700 | 0.3112 | 0.3681 |
|
185 |
+
| 0.0951 | 9.0 | 11800 | 0.3157 | 0.3649 |
|
186 |
+
| 0.1162 | 9.08 | 11900 | 0.3188 | 0.3714 |
|
187 |
+
| 0.1157 | 9.15 | 12000 | 0.3383 | 0.3775 |
|
188 |
+
| 0.1268 | 9.23 | 12100 | 0.3204 | 0.3752 |
|
189 |
+
| 0.1402 | 9.31 | 12200 | 0.3441 | 0.3707 |
|
190 |
+
| 0.1094 | 9.38 | 12300 | 0.3415 | 0.3675 |
|
191 |
+
| 0.1122 | 9.46 | 12400 | 0.3150 | 0.3596 |
|
192 |
+
| 0.0932 | 9.53 | 12500 | 0.3195 | 0.3561 |
|
193 |
+
| 0.1176 | 9.61 | 12600 | 0.3250 | 0.3675 |
|
194 |
+
| 0.1287 | 9.69 | 12700 | 0.3253 | 0.3615 |
|
195 |
+
| 0.0886 | 9.76 | 12800 | 0.3276 | 0.3636 |
|
196 |
+
| 0.1016 | 9.84 | 12900 | 0.3185 | 0.3592 |
|
197 |
+
| 0.0902 | 9.92 | 13000 | 0.3177 | 0.3643 |
|
198 |
+
| 0.1304 | 9.99 | 13100 | 0.3131 | 0.3530 |
|
199 |
+
| 0.099 | 10.07 | 13200 | 0.3094 | 0.3525 |
|
200 |
+
| 0.1142 | 10.14 | 13300 | 0.3298 | 0.3609 |
|
201 |
+
| 0.1836 | 10.22 | 13400 | 0.3213 | 0.3526 |
|
202 |
+
| 0.1533 | 10.3 | 13500 | 0.3163 | 0.3579 |
|
203 |
+
| 0.1436 | 10.37 | 13600 | 0.3352 | 0.3543 |
|
204 |
+
| 0.1215 | 10.45 | 13700 | 0.3355 | 0.3458 |
|
205 |
+
| 0.0971 | 10.53 | 13800 | 0.3232 | 0.3579 |
|
206 |
+
| 0.1215 | 10.6 | 13900 | 0.3168 | 0.3441 |
|
207 |
+
| 0.0906 | 10.68 | 14000 | 0.3266 | 0.3498 |
|
208 |
+
| 0.125 | 10.76 | 14100 | 0.3318 | 0.3414 |
|
209 |
+
| 0.0831 | 10.83 | 14200 | 0.3030 | 0.3480 |
|
210 |
+
| 0.1588 | 10.91 | 14300 | 0.3155 | 0.3455 |
|
211 |
+
| 0.1191 | 10.98 | 14400 | 0.3287 | 0.3487 |
|
212 |
+
| 0.074 | 11.06 | 14500 | 0.3176 | 0.3431 |
|
213 |
+
| 0.1075 | 11.14 | 14600 | 0.3219 | 0.3446 |
|
214 |
+
| 0.0679 | 11.21 | 14700 | 0.3158 | 0.3414 |
|
215 |
+
| 0.0789 | 11.29 | 14800 | 0.3305 | 0.3491 |
|
216 |
+
| 0.1426 | 11.37 | 14900 | 0.3281 | 0.3485 |
|
217 |
+
| 0.1154 | 11.44 | 15000 | 0.3368 | 0.3482 |
|
218 |
+
| 0.1313 | 11.52 | 15100 | 0.3285 | 0.3415 |
|
219 |
+
| 0.0786 | 11.59 | 15200 | 0.3138 | 0.3439 |
|
220 |
+
| 0.0595 | 11.67 | 15300 | 0.3135 | 0.3431 |
|
221 |
+
| 0.0868 | 11.75 | 15400 | 0.3049 | 0.3396 |
|
222 |
+
| 0.0812 | 11.82 | 15500 | 0.3050 | 0.3373 |
|
223 |
+
| 0.1199 | 11.9 | 15600 | 0.3238 | 0.3392 |
|
224 |
+
| 0.1243 | 11.98 | 15700 | 0.3123 | 0.3368 |
|
225 |
+
| 0.0663 | 12.05 | 15800 | 0.3226 | 0.3373 |
|
226 |
+
| 0.0285 | 12.13 | 15900 | 0.3260 | 0.3367 |
|
227 |
+
| 0.0607 | 12.2 | 16000 | 0.3236 | 0.3406 |
|
228 |
+
| 0.064 | 12.28 | 16100 | 0.3297 | 0.3357 |
|
229 |
+
| 0.0554 | 12.36 | 16200 | 0.3357 | 0.3383 |
|
230 |
+
| 0.0561 | 12.43 | 16300 | 0.3211 | 0.3387 |
|
231 |
+
| 0.0785 | 12.51 | 16400 | 0.3140 | 0.3386 |
|
232 |
+
| 0.0539 | 12.59 | 16500 | 0.3130 | 0.3361 |
|
233 |
+
| 0.0873 | 12.66 | 16600 | 0.3244 | 0.3344 |
|
234 |
+
| 0.0774 | 12.74 | 16700 | 0.3128 | 0.3274 |
|
235 |
+
| 0.0853 | 12.81 | 16800 | 0.3185 | 0.3395 |
|
236 |
+
| 0.0701 | 12.89 | 16900 | 0.3244 | 0.3327 |
|
237 |
+
| 0.0486 | 12.97 | 17000 | 0.3100 | 0.3317 |
|
238 |
+
| 0.1087 | 13.04 | 17100 | 0.3351 | 0.3327 |
|
239 |
+
| 0.0716 | 13.12 | 17200 | 0.3474 | 0.3383 |
|
240 |
+
| 0.0653 | 13.2 | 17300 | 0.3361 | 0.3364 |
|
241 |
+
| 0.0936 | 13.27 | 17400 | 0.3423 | 0.3352 |
|
242 |
+
| 0.0761 | 13.35 | 17500 | 0.3261 | 0.3304 |
|
243 |
+
| 0.0723 | 13.42 | 17600 | 0.3298 | 0.3333 |
|
244 |
+
| 0.0756 | 13.5 | 17700 | 0.3282 | 0.3367 |
|
245 |
+
| 0.058 | 13.58 | 17800 | 0.3386 | 0.3303 |
|
246 |
+
| 0.0619 | 13.65 | 17900 | 0.3354 | 0.3306 |
|
247 |
+
| 0.081 | 13.73 | 18000 | 0.3413 | 0.3317 |
|
248 |
+
| 0.0893 | 13.81 | 18100 | 0.3257 | 0.3278 |
|
249 |
+
| 0.0858 | 13.88 | 18200 | 0.3312 | 0.3255 |
|
250 |
+
| 0.0756 | 13.96 | 18300 | 0.3279 | 0.3326 |
|
251 |
+
| 0.0946 | 14.04 | 18400 | 0.3412 | 0.3272 |
|
252 |
+
| 0.1452 | 14.11 | 18500 | 0.3394 | 0.3266 |
|
253 |
+
| 0.0772 | 14.19 | 18600 | 0.3271 | 0.3261 |
|
254 |
+
| 0.0748 | 14.26 | 18700 | 0.3338 | 0.3272 |
|
255 |
+
| 0.0789 | 14.34 | 18800 | 0.3461 | 0.3254 |
|
256 |
+
| 0.0967 | 14.42 | 18900 | 0.3163 | 0.3250 |
|
257 |
+
| 0.0938 | 14.49 | 19000 | 0.3273 | 0.3261 |
|
258 |
+
| 0.1134 | 14.57 | 19100 | 0.3301 | 0.3284 |
|
259 |
+
| 0.1051 | 14.65 | 19200 | 0.3187 | 0.3215 |
|
260 |
+
| 0.0936 | 14.72 | 19300 | 0.3211 | 0.3197 |
|
261 |
+
| 0.0528 | 14.8 | 19400 | 0.3381 | 0.3270 |
|
262 |
+
| 0.1497 | 14.87 | 19500 | 0.3291 | 0.3235 |
|
263 |
+
| 0.1168 | 14.95 | 19600 | 0.3290 | 0.3238 |
|
264 |
+
| 0.028 | 15.03 | 19700 | 0.3333 | 0.3209 |
|
265 |
+
| 0.0773 | 15.1 | 19800 | 0.3359 | 0.3206 |
|
266 |
+
| 0.0972 | 15.18 | 19900 | 0.3262 | 0.3163 |
|
267 |
+
| 0.0391 | 15.26 | 20000 | 0.3335 | 0.3180 |
|
268 |
+
| 0.0571 | 15.33 | 20100 | 0.3445 | 0.3198 |
|
269 |
+
| 0.0365 | 15.41 | 20200 | 0.3318 | 0.3170 |
|
270 |
+
| 0.0535 | 15.48 | 20300 | 0.3257 | 0.3147 |
|
271 |
+
| 0.0739 | 15.56 | 20400 | 0.3359 | 0.3136 |
|
272 |
+
| 0.0753 | 15.64 | 20500 | 0.3216 | 0.3195 |
|
273 |
+
| 0.1507 | 15.71 | 20600 | 0.3326 | 0.3154 |
|
274 |
+
| 0.062 | 15.79 | 20700 | 0.3310 | 0.3164 |
|
275 |
+
| 0.0595 | 15.87 | 20800 | 0.3134 | 0.3162 |
|
276 |
+
| 0.0456 | 15.94 | 20900 | 0.3146 | 0.3127 |
|
277 |
+
| 0.0977 | 16.02 | 21000 | 0.3328 | 0.3117 |
|
278 |
+
| 0.036 | 16.09 | 21100 | 0.3266 | 0.3134 |
|
279 |
+
| 0.0308 | 16.17 | 21200 | 0.3306 | 0.3136 |
|
280 |
+
| 0.0612 | 16.25 | 21300 | 0.3207 | 0.3160 |
|
281 |
+
| 0.0269 | 16.32 | 21400 | 0.3429 | 0.3143 |
|
282 |
+
| 0.0897 | 16.4 | 21500 | 0.3355 | 0.3111 |
|
283 |
+
| 0.0458 | 16.48 | 21600 | 0.3238 | 0.3065 |
|
284 |
+
| 0.0155 | 16.55 | 21700 | 0.3167 | 0.3042 |
|
285 |
+
| 0.0519 | 16.63 | 21800 | 0.3296 | 0.3099 |
|
286 |
+
| 0.0807 | 16.7 | 21900 | 0.3250 | 0.3048 |
|
287 |
+
| 0.0406 | 16.78 | 22000 | 0.3283 | 0.3087 |
|
288 |
+
| 0.0773 | 16.86 | 22100 | 0.3217 | 0.3047 |
|
289 |
+
| 0.1027 | 16.93 | 22200 | 0.3279 | 0.3108 |
|
290 |
+
| 0.0315 | 17.01 | 22300 | 0.3173 | 0.3058 |
|
291 |
+
| 0.0457 | 17.09 | 22400 | 0.3387 | 0.3085 |
|
292 |
+
| 0.0516 | 17.16 | 22500 | 0.3309 | 0.3050 |
|
293 |
+
| 0.0413 | 17.24 | 22600 | 0.3363 | 0.3067 |
|
294 |
+
| 0.0601 | 17.32 | 22700 | 0.3325 | 0.3048 |
|
295 |
+
| 0.0435 | 17.39 | 22800 | 0.3298 | 0.3058 |
|
296 |
+
| 0.0571 | 17.47 | 22900 | 0.3244 | 0.3033 |
|
297 |
+
| 0.0656 | 17.54 | 23000 | 0.3350 | 0.3056 |
|
298 |
+
| 0.0485 | 17.62 | 23100 | 0.3406 | 0.3051 |
|
299 |
+
| 0.0619 | 17.7 | 23200 | 0.3268 | 0.3033 |
|
300 |
+
| 0.0495 | 17.77 | 23300 | 0.3268 | 0.3031 |
|
301 |
+
| 0.0416 | 17.85 | 23400 | 0.3268 | 0.3038 |
|
302 |
+
| 0.0646 | 17.93 | 23500 | 0.3314 | 0.3009 |
|
303 |
+
| 0.0294 | 18.0 | 23600 | 0.3251 | 0.3028 |
|
304 |
+
| 0.0372 | 18.08 | 23700 | 0.3364 | 0.2962 |
|
305 |
+
| 0.04 | 18.15 | 23800 | 0.3358 | 0.2967 |
|
306 |
+
| 0.0367 | 18.23 | 23900 | 0.3317 | 0.3031 |
|
307 |
+
| 0.0312 | 18.31 | 24000 | 0.3272 | 0.2998 |
|
308 |
+
| 0.0419 | 18.38 | 24100 | 0.3358 | 0.2996 |
|
309 |
+
| 0.0477 | 18.46 | 24200 | 0.3283 | 0.2996 |
|
310 |
+
| 0.0256 | 18.54 | 24300 | 0.3310 | 0.2995 |
|
311 |
+
| 0.0269 | 18.61 | 24400 | 0.3325 | 0.2997 |
|
312 |
+
| 0.0309 | 18.69 | 24500 | 0.3345 | 0.2974 |
|
313 |
+
| 0.0441 | 18.76 | 24600 | 0.3345 | 0.3003 |
|
314 |
+
| 0.0496 | 18.84 | 24700 | 0.3396 | 0.2985 |
|
315 |
+
| 0.0425 | 18.92 | 24800 | 0.3425 | 0.2965 |
|
316 |
+
| 0.0196 | 18.99 | 24900 | 0.3373 | 0.2964 |
|
317 |
+
| 0.0348 | 19.07 | 25000 | 0.3361 | 0.2955 |
|
318 |
+
| 0.0466 | 19.15 | 25100 | 0.3328 | 0.2959 |
|
319 |
+
| 0.0422 | 19.22 | 25200 | 0.3343 | 0.2964 |
|
320 |
+
| 0.0271 | 19.3 | 25300 | 0.3369 | 0.2945 |
|
321 |
+
| 0.053 | 19.37 | 25400 | 0.3330 | 0.2953 |
|
322 |
+
| 0.0662 | 19.45 | 25500 | 0.3343 | 0.2958 |
|
323 |
+
| 0.0718 | 19.53 | 25600 | 0.3330 | 0.2952 |
|
324 |
+
| 0.0212 | 19.6 | 25700 | 0.3352 | 0.2940 |
|
325 |
+
| 0.0971 | 19.68 | 25800 | 0.3374 | 0.2935 |
|
326 |
+
| 0.0413 | 19.76 | 25900 | 0.3362 | 0.2933 |
|
327 |
+
| 0.0477 | 19.83 | 26000 | 0.3356 | 0.2940 |
|
328 |
+
| 0.1068 | 19.91 | 26100 | 0.3365 | 0.2937 |
|
329 |
+
| 0.108 | 19.98 | 26200 | 0.3366 | 0.2935 |
|
330 |
+
|
331 |
+
|
332 |
+
### Framework versions
|
333 |
+
|
334 |
+
- Transformers 4.29.2
|
335 |
+
- Pytorch 2.0.1
|
336 |
+
- Datasets 2.13.1
|
337 |
+
- Tokenizers 0.13.2
|