File size: 26,760 Bytes
dc152e1
 
 
 
 
 
f235365
dc152e1
 
 
 
 
 
f235365
dc152e1
 
 
f235365
 
 
 
dc152e1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f235365
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
dc152e1
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k11_task3_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k11_task3_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co./aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1.0975
- Qwk: -0.1246
- Mse: 1.0975
- Rmse: 1.0476

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch   | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:-------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0645  | 2    | 3.6127          | 0.0183  | 3.6127 | 1.9007 |
| No log        | 0.1290  | 4    | 2.0410          | 0.0431  | 2.0410 | 1.4286 |
| No log        | 0.1935  | 6    | 1.5048          | -0.0241 | 1.5048 | 1.2267 |
| No log        | 0.2581  | 8    | 1.1919          | 0.0282  | 1.1919 | 1.0917 |
| No log        | 0.3226  | 10   | 0.8281          | -0.2167 | 0.8281 | 0.9100 |
| No log        | 0.3871  | 12   | 0.8849          | -0.0459 | 0.8849 | 0.9407 |
| No log        | 0.4516  | 14   | 1.1748          | -0.0178 | 1.1748 | 1.0839 |
| No log        | 0.5161  | 16   | 1.7601          | -0.0743 | 1.7601 | 1.3267 |
| No log        | 0.5806  | 18   | 1.8014          | -0.0743 | 1.8014 | 1.3422 |
| No log        | 0.6452  | 20   | 1.2788          | -0.0446 | 1.2788 | 1.1308 |
| No log        | 0.7097  | 22   | 0.9766          | 0.0089  | 0.9766 | 0.9883 |
| No log        | 0.7742  | 24   | 0.7768          | -0.0215 | 0.7768 | 0.8813 |
| No log        | 0.8387  | 26   | 1.0236          | 0.0260  | 1.0236 | 1.0117 |
| No log        | 0.9032  | 28   | 1.8304          | -0.0263 | 1.8304 | 1.3529 |
| No log        | 0.9677  | 30   | 1.5121          | -0.0215 | 1.5121 | 1.2297 |
| No log        | 1.0323  | 32   | 0.8341          | 0.1502  | 0.8341 | 0.9133 |
| No log        | 1.0968  | 34   | 0.7456          | 0.0807  | 0.7456 | 0.8635 |
| No log        | 1.1613  | 36   | 0.8103          | 0.0316  | 0.8103 | 0.9002 |
| No log        | 1.2258  | 38   | 1.1054          | 0.0358  | 1.1054 | 1.0514 |
| No log        | 1.2903  | 40   | 1.4066          | 0.0279  | 1.4066 | 1.1860 |
| No log        | 1.3548  | 42   | 1.1434          | 0.0196  | 1.1434 | 1.0693 |
| No log        | 1.4194  | 44   | 0.8618          | -0.1203 | 0.8618 | 0.9283 |
| No log        | 1.4839  | 46   | 0.7913          | -0.0427 | 0.7913 | 0.8896 |
| No log        | 1.5484  | 48   | 0.7787          | 0.0496  | 0.7787 | 0.8824 |
| No log        | 1.6129  | 50   | 0.8869          | -0.1121 | 0.8869 | 0.9418 |
| No log        | 1.6774  | 52   | 1.2379          | -0.0610 | 1.2379 | 1.1126 |
| No log        | 1.7419  | 54   | 1.5237          | 0.0130  | 1.5237 | 1.2344 |
| No log        | 1.8065  | 56   | 1.9291          | 0.0175  | 1.9291 | 1.3889 |
| No log        | 1.8710  | 58   | 1.3203          | -0.0067 | 1.3203 | 1.1490 |
| No log        | 1.9355  | 60   | 0.8098          | -0.1121 | 0.8098 | 0.8999 |
| No log        | 2.0     | 62   | 0.8247          | -0.0385 | 0.8247 | 0.9081 |
| No log        | 2.0645  | 64   | 0.8231          | -0.0237 | 0.8231 | 0.9072 |
| No log        | 2.1290  | 66   | 0.7717          | 0.0732  | 0.7717 | 0.8785 |
| No log        | 2.1935  | 68   | 1.0267          | 0.0107  | 1.0267 | 1.0133 |
| No log        | 2.2581  | 70   | 1.6840          | 0.0901  | 1.6840 | 1.2977 |
| No log        | 2.3226  | 72   | 1.8955          | 0.0619  | 1.8955 | 1.3768 |
| No log        | 2.3871  | 74   | 1.1375          | 0.0336  | 1.1375 | 1.0665 |
| No log        | 2.4516  | 76   | 0.8334          | 0.1724  | 0.8334 | 0.9129 |
| No log        | 2.5161  | 78   | 0.8641          | 0.0770  | 0.8641 | 0.9296 |
| No log        | 2.5806  | 80   | 0.7643          | -0.0473 | 0.7643 | 0.8742 |
| No log        | 2.6452  | 82   | 0.7716          | 0.0956  | 0.7716 | 0.8784 |
| No log        | 2.7097  | 84   | 1.5252          | 0.1432  | 1.5252 | 1.2350 |
| No log        | 2.7742  | 86   | 1.7994          | 0.0168  | 1.7994 | 1.3414 |
| No log        | 2.8387  | 88   | 1.5046          | 0.0130  | 1.5046 | 1.2266 |
| No log        | 2.9032  | 90   | 1.1167          | -0.0291 | 1.1167 | 1.0568 |
| No log        | 2.9677  | 92   | 1.0853          | 0.0045  | 1.0853 | 1.0418 |
| No log        | 3.0323  | 94   | 1.0783          | 0.0045  | 1.0783 | 1.0384 |
| No log        | 3.0968  | 96   | 1.0773          | 0.0065  | 1.0773 | 1.0379 |
| No log        | 3.1613  | 98   | 0.8811          | -0.0076 | 0.8811 | 0.9387 |
| No log        | 3.2258  | 100  | 0.7727          | -0.0108 | 0.7727 | 0.8790 |
| No log        | 3.2903  | 102  | 0.8553          | 0.0134  | 0.8553 | 0.9248 |
| No log        | 3.3548  | 104  | 0.9739          | 0.0605  | 0.9739 | 0.9869 |
| No log        | 3.4194  | 106  | 1.0171          | 0.0249  | 1.0171 | 1.0085 |
| No log        | 3.4839  | 108  | 1.0769          | -0.0066 | 1.0769 | 1.0378 |
| No log        | 3.5484  | 110  | 1.3997          | 0.0279  | 1.3997 | 1.1831 |
| No log        | 3.6129  | 112  | 1.5962          | -0.0330 | 1.5962 | 1.2634 |
| No log        | 3.6774  | 114  | 1.1910          | 0.0448  | 1.1910 | 1.0913 |
| No log        | 3.7419  | 116  | 1.1723          | 0.0799  | 1.1723 | 1.0827 |
| No log        | 3.8065  | 118  | 1.1995          | 0.0741  | 1.1995 | 1.0952 |
| No log        | 3.8710  | 120  | 1.2603          | 0.0707  | 1.2603 | 1.1226 |
| No log        | 3.9355  | 122  | 0.9792          | -0.1444 | 0.9792 | 0.9895 |
| No log        | 4.0     | 124  | 0.9183          | -0.2138 | 0.9183 | 0.9583 |
| No log        | 4.0645  | 126  | 0.9083          | -0.0798 | 0.9083 | 0.9531 |
| No log        | 4.1290  | 128  | 1.0443          | -0.0746 | 1.0443 | 1.0219 |
| No log        | 4.1935  | 130  | 1.4139          | -0.1172 | 1.4139 | 1.1891 |
| No log        | 4.2581  | 132  | 1.3395          | -0.0274 | 1.3395 | 1.1574 |
| No log        | 4.3226  | 134  | 0.9325          | 0.0118  | 0.9325 | 0.9657 |
| No log        | 4.3871  | 136  | 0.8525          | -0.0517 | 0.8525 | 0.9233 |
| No log        | 4.4516  | 138  | 0.8707          | -0.0200 | 0.8707 | 0.9331 |
| No log        | 4.5161  | 140  | 1.1391          | 0.0778  | 1.1391 | 1.0673 |
| No log        | 4.5806  | 142  | 1.5130          | 0.0153  | 1.5130 | 1.2300 |
| No log        | 4.6452  | 144  | 1.3119          | 0.0287  | 1.3119 | 1.1454 |
| No log        | 4.7097  | 146  | 0.9904          | 0.0224  | 0.9904 | 0.9952 |
| No log        | 4.7742  | 148  | 0.8171          | -0.0070 | 0.8171 | 0.9040 |
| No log        | 4.8387  | 150  | 0.8212          | 0.0856  | 0.8212 | 0.9062 |
| No log        | 4.9032  | 152  | 0.9358          | -0.0076 | 0.9358 | 0.9673 |
| No log        | 4.9677  | 154  | 1.1182          | 0.0481  | 1.1182 | 1.0574 |
| No log        | 5.0323  | 156  | 0.9408          | 0.0392  | 0.9408 | 0.9700 |
| No log        | 5.0968  | 158  | 0.7875          | 0.1131  | 0.7875 | 0.8874 |
| No log        | 5.1613  | 160  | 0.7852          | 0.1130  | 0.7852 | 0.8861 |
| No log        | 5.2258  | 162  | 0.8438          | 0.2048  | 0.8438 | 0.9186 |
| No log        | 5.2903  | 164  | 1.0743          | 0.1228  | 1.0743 | 1.0365 |
| No log        | 5.3548  | 166  | 1.1039          | 0.1189  | 1.1039 | 1.0507 |
| No log        | 5.4194  | 168  | 0.8254          | 0.1239  | 0.8254 | 0.9085 |
| No log        | 5.4839  | 170  | 0.7786          | 0.0081  | 0.7786 | 0.8824 |
| No log        | 5.5484  | 172  | 0.8092          | -0.1146 | 0.8092 | 0.8996 |
| No log        | 5.6129  | 174  | 0.8005          | 0.0679  | 0.8005 | 0.8947 |
| No log        | 5.6774  | 176  | 0.9018          | 0.1065  | 0.9018 | 0.9496 |
| No log        | 5.7419  | 178  | 1.2352          | -0.0348 | 1.2352 | 1.1114 |
| No log        | 5.8065  | 180  | 1.2191          | -0.0361 | 1.2191 | 1.1041 |
| No log        | 5.8710  | 182  | 0.8414          | 0.1149  | 0.8414 | 0.9173 |
| No log        | 5.9355  | 184  | 0.7744          | -0.1678 | 0.7744 | 0.8800 |
| No log        | 6.0     | 186  | 0.8401          | -0.0040 | 0.8401 | 0.9166 |
| No log        | 6.0645  | 188  | 0.7477          | -0.0322 | 0.7477 | 0.8647 |
| No log        | 6.1290  | 190  | 0.7654          | 0.1440  | 0.7654 | 0.8749 |
| No log        | 6.1935  | 192  | 1.4970          | 0.1330  | 1.4970 | 1.2235 |
| No log        | 6.2581  | 194  | 1.9447          | 0.0242  | 1.9447 | 1.3945 |
| No log        | 6.3226  | 196  | 1.6526          | 0.0434  | 1.6526 | 1.2855 |
| No log        | 6.3871  | 198  | 1.0448          | 0.0915  | 1.0448 | 1.0222 |
| No log        | 6.4516  | 200  | 0.7884          | 0.0200  | 0.7884 | 0.8879 |
| No log        | 6.5161  | 202  | 0.7471          | 0.0764  | 0.7471 | 0.8644 |
| No log        | 6.5806  | 204  | 0.7944          | 0.2070  | 0.7944 | 0.8913 |
| No log        | 6.6452  | 206  | 1.1712          | 0.0104  | 1.1712 | 1.0822 |
| No log        | 6.7097  | 208  | 1.3872          | -0.0647 | 1.3872 | 1.1778 |
| No log        | 6.7742  | 210  | 1.1462          | -0.0597 | 1.1462 | 1.0706 |
| No log        | 6.8387  | 212  | 0.7587          | 0.1286  | 0.7587 | 0.8710 |
| No log        | 6.9032  | 214  | 0.7053          | 0.2315  | 0.7053 | 0.8398 |
| No log        | 6.9677  | 216  | 0.7410          | 0.1047  | 0.7410 | 0.8608 |
| No log        | 7.0323  | 218  | 0.9176          | 0.1825  | 0.9176 | 0.9579 |
| No log        | 7.0968  | 220  | 0.9738          | 0.1825  | 0.9738 | 0.9868 |
| No log        | 7.1613  | 222  | 0.8383          | 0.1239  | 0.8383 | 0.9156 |
| No log        | 7.2258  | 224  | 0.7434          | 0.2358  | 0.7434 | 0.8622 |
| No log        | 7.2903  | 226  | 0.7517          | 0.1336  | 0.7517 | 0.8670 |
| No log        | 7.3548  | 228  | 0.8030          | 0.1193  | 0.8030 | 0.8961 |
| No log        | 7.4194  | 230  | 0.9508          | 0.0200  | 0.9508 | 0.9751 |
| No log        | 7.4839  | 232  | 0.9193          | 0.0250  | 0.9193 | 0.9588 |
| No log        | 7.5484  | 234  | 0.9525          | -0.0157 | 0.9525 | 0.9760 |
| No log        | 7.6129  | 236  | 1.0342          | -0.0899 | 1.0342 | 1.0170 |
| No log        | 7.6774  | 238  | 1.0258          | -0.0551 | 1.0258 | 1.0128 |
| No log        | 7.7419  | 240  | 0.8080          | 0.1149  | 0.8080 | 0.8989 |
| No log        | 7.8065  | 242  | 0.7368          | 0.1659  | 0.7368 | 0.8584 |
| No log        | 7.8710  | 244  | 0.7414          | 0.1304  | 0.7414 | 0.8611 |
| No log        | 7.9355  | 246  | 0.7741          | 0.0783  | 0.7741 | 0.8798 |
| No log        | 8.0     | 248  | 0.8896          | 0.0762  | 0.8896 | 0.9432 |
| No log        | 8.0645  | 250  | 1.1999          | -0.0597 | 1.1999 | 1.0954 |
| No log        | 8.1290  | 252  | 1.3903          | -0.0959 | 1.3903 | 1.1791 |
| No log        | 8.1935  | 254  | 1.2196          | -0.0925 | 1.2196 | 1.1043 |
| No log        | 8.2581  | 256  | 0.8410          | 0.0490  | 0.8410 | 0.9170 |
| No log        | 8.3226  | 258  | 0.8315          | -0.1329 | 0.8315 | 0.9118 |
| No log        | 8.3871  | 260  | 0.8764          | -0.1647 | 0.8764 | 0.9361 |
| No log        | 8.4516  | 262  | 0.7840          | -0.0366 | 0.7840 | 0.8854 |
| No log        | 8.5161  | 264  | 1.0334          | 0.0508  | 1.0334 | 1.0166 |
| No log        | 8.5806  | 266  | 1.9377          | -0.0046 | 1.9377 | 1.3920 |
| No log        | 8.6452  | 268  | 2.1811          | -0.0120 | 2.1811 | 1.4769 |
| No log        | 8.7097  | 270  | 1.7844          | -0.0190 | 1.7844 | 1.3358 |
| No log        | 8.7742  | 272  | 1.1139          | 0.0147  | 1.1139 | 1.0554 |
| No log        | 8.8387  | 274  | 0.9395          | 0.0587  | 0.9395 | 0.9693 |
| No log        | 8.9032  | 276  | 0.8154          | 0.1095  | 0.8154 | 0.9030 |
| No log        | 8.9677  | 278  | 0.7681          | -0.0056 | 0.7681 | 0.8764 |
| No log        | 9.0323  | 280  | 0.7737          | 0.0376  | 0.7737 | 0.8796 |
| No log        | 9.0968  | 282  | 0.7818          | 0.0327  | 0.7818 | 0.8842 |
| No log        | 9.1613  | 284  | 0.7956          | 0.0246  | 0.7956 | 0.8920 |
| No log        | 9.2258  | 286  | 0.8442          | 0.0497  | 0.8442 | 0.9188 |
| No log        | 9.2903  | 288  | 1.0212          | 0.0200  | 1.0212 | 1.0105 |
| No log        | 9.3548  | 290  | 1.1304          | 0.0443  | 1.1304 | 1.0632 |
| No log        | 9.4194  | 292  | 1.0972          | 0.0443  | 1.0972 | 1.0475 |
| No log        | 9.4839  | 294  | 0.9889          | 0.0175  | 0.9889 | 0.9944 |
| No log        | 9.5484  | 296  | 0.8190          | 0.0837  | 0.8190 | 0.9050 |
| No log        | 9.6129  | 298  | 0.7854          | -0.0912 | 0.7854 | 0.8862 |
| No log        | 9.6774  | 300  | 0.8057          | -0.0976 | 0.8057 | 0.8976 |
| No log        | 9.7419  | 302  | 0.8960          | 0.0538  | 0.8960 | 0.9466 |
| No log        | 9.8065  | 304  | 1.0693          | -0.1232 | 1.0693 | 1.0341 |
| No log        | 9.8710  | 306  | 1.1229          | -0.0905 | 1.1229 | 1.0597 |
| No log        | 9.9355  | 308  | 0.9882          | -0.0408 | 0.9882 | 0.9941 |
| No log        | 10.0    | 310  | 0.8900          | 0.0791  | 0.8900 | 0.9434 |
| No log        | 10.0645 | 312  | 0.8877          | 0.0465  | 0.8877 | 0.9422 |
| No log        | 10.1290 | 314  | 0.9243          | -0.0271 | 0.9243 | 0.9614 |
| No log        | 10.1935 | 316  | 1.0636          | -0.0862 | 1.0636 | 1.0313 |
| No log        | 10.2581 | 318  | 1.1321          | -0.0905 | 1.1321 | 1.0640 |
| No log        | 10.3226 | 320  | 1.0424          | -0.0486 | 1.0424 | 1.0210 |
| No log        | 10.3871 | 322  | 0.9453          | 0.0041  | 0.9453 | 0.9722 |
| No log        | 10.4516 | 324  | 0.9316          | 0.0424  | 0.9316 | 0.9652 |
| No log        | 10.5161 | 326  | 1.0273          | -0.0138 | 1.0273 | 1.0135 |
| No log        | 10.5806 | 328  | 1.2673          | -0.0629 | 1.2673 | 1.1257 |
| No log        | 10.6452 | 330  | 1.2990          | -0.0353 | 1.2990 | 1.1397 |
| No log        | 10.7097 | 332  | 1.0638          | -0.0539 | 1.0638 | 1.0314 |
| No log        | 10.7742 | 334  | 0.9457          | -0.0138 | 0.9457 | 0.9725 |
| No log        | 10.8387 | 336  | 0.9238          | 0.1239  | 0.9238 | 0.9611 |
| No log        | 10.9032 | 338  | 0.8745          | -0.0132 | 0.8745 | 0.9351 |
| No log        | 10.9677 | 340  | 0.8669          | -0.0462 | 0.8669 | 0.9311 |
| No log        | 11.0323 | 342  | 0.8725          | -0.0462 | 0.8725 | 0.9341 |
| No log        | 11.0968 | 344  | 0.8962          | 0.0741  | 0.8962 | 0.9467 |
| No log        | 11.1613 | 346  | 0.9856          | 0.0250  | 0.9856 | 0.9927 |
| No log        | 11.2258 | 348  | 1.0187          | -0.0513 | 1.0187 | 1.0093 |
| No log        | 11.2903 | 350  | 0.9376          | 0.0651  | 0.9376 | 0.9683 |
| No log        | 11.3548 | 352  | 0.8895          | 0.0684  | 0.8895 | 0.9432 |
| No log        | 11.4194 | 354  | 0.8601          | 0.0684  | 0.8601 | 0.9274 |
| No log        | 11.4839 | 356  | 0.8392          | 0.0871  | 0.8392 | 0.9161 |
| No log        | 11.5484 | 358  | 0.8715          | 0.0304  | 0.8715 | 0.9335 |
| No log        | 11.6129 | 360  | 0.8642          | -0.0097 | 0.8642 | 0.9296 |
| No log        | 11.6774 | 362  | 0.8238          | 0.1800  | 0.8238 | 0.9076 |
| No log        | 11.7419 | 364  | 0.8237          | 0.1475  | 0.8237 | 0.9076 |
| No log        | 11.8065 | 366  | 0.8777          | 0.0684  | 0.8777 | 0.9369 |
| No log        | 11.8710 | 368  | 0.9986          | -0.0157 | 0.9986 | 0.9993 |
| No log        | 11.9355 | 370  | 0.9584          | -0.0138 | 0.9584 | 0.9790 |
| No log        | 12.0    | 372  | 0.8808          | 0.0684  | 0.8808 | 0.9385 |
| No log        | 12.0645 | 374  | 0.8076          | 0.1758  | 0.8076 | 0.8987 |
| No log        | 12.1290 | 376  | 0.8211          | 0.1646  | 0.8211 | 0.9061 |
| No log        | 12.1935 | 378  | 0.9441          | -0.0138 | 0.9441 | 0.9716 |
| No log        | 12.2581 | 380  | 0.9433          | -0.0138 | 0.9433 | 0.9712 |
| No log        | 12.3226 | 382  | 0.9140          | -0.0138 | 0.9140 | 0.9560 |
| No log        | 12.3871 | 384  | 0.9188          | -0.0138 | 0.9188 | 0.9585 |
| No log        | 12.4516 | 386  | 1.0220          | -0.0575 | 1.0220 | 1.0110 |
| No log        | 12.5161 | 388  | 1.0598          | -0.1245 | 1.0598 | 1.0295 |
| No log        | 12.5806 | 390  | 0.9323          | -0.0539 | 0.9323 | 0.9656 |
| No log        | 12.6452 | 392  | 0.8725          | 0.0304  | 0.8725 | 0.9341 |
| No log        | 12.7097 | 394  | 0.9472          | -0.0551 | 0.9472 | 0.9732 |
| No log        | 12.7742 | 396  | 1.0039          | -0.0899 | 1.0039 | 1.0019 |
| No log        | 12.8387 | 398  | 0.9761          | -0.0551 | 0.9761 | 0.9880 |
| No log        | 12.9032 | 400  | 0.8966          | 0.0587  | 0.8966 | 0.9469 |
| No log        | 12.9677 | 402  | 0.8158          | 0.1599  | 0.8158 | 0.9032 |
| No log        | 13.0323 | 404  | 0.8290          | -0.2338 | 0.8290 | 0.9105 |
| No log        | 13.0968 | 406  | 0.8378          | -0.1411 | 0.8378 | 0.9153 |
| No log        | 13.1613 | 408  | 0.8867          | 0.0551  | 0.8867 | 0.9417 |
| No log        | 13.2258 | 410  | 1.1302          | -0.0905 | 1.1302 | 1.0631 |
| No log        | 13.2903 | 412  | 1.3570          | -0.0947 | 1.3570 | 1.1649 |
| No log        | 13.3548 | 414  | 1.2674          | -0.1254 | 1.2674 | 1.1258 |
| No log        | 13.4194 | 416  | 1.0452          | -0.0912 | 1.0452 | 1.0224 |
| No log        | 13.4839 | 418  | 0.9109          | 0.1025  | 0.9109 | 0.9544 |
| No log        | 13.5484 | 420  | 0.8774          | 0.1106  | 0.8774 | 0.9367 |
| No log        | 13.6129 | 422  | 0.9069          | 0.0651  | 0.9069 | 0.9523 |
| No log        | 13.6774 | 424  | 1.0431          | -0.0899 | 1.0431 | 1.0213 |
| No log        | 13.7419 | 426  | 1.1266          | -0.1243 | 1.1266 | 1.0614 |
| No log        | 13.8065 | 428  | 1.0826          | -0.0892 | 1.0826 | 1.0405 |
| No log        | 13.8710 | 430  | 0.9214          | 0.0755  | 0.9214 | 0.9599 |
| No log        | 13.9355 | 432  | 0.8576          | -0.0326 | 0.8576 | 0.9261 |
| No log        | 14.0    | 434  | 0.8618          | -0.0024 | 0.8618 | 0.9283 |
| No log        | 14.0645 | 436  | 0.9181          | 0.0769  | 0.9181 | 0.9582 |
| No log        | 14.1290 | 438  | 0.9928          | 0.1065  | 0.9928 | 0.9964 |
| No log        | 14.1935 | 440  | 1.0033          | 0.1025  | 1.0033 | 1.0016 |
| No log        | 14.2581 | 442  | 0.9818          | 0.0277  | 0.9818 | 0.9909 |
| No log        | 14.3226 | 444  | 0.9458          | 0.0684  | 0.9458 | 0.9725 |
| No log        | 14.3871 | 446  | 0.9371          | 0.0651  | 0.9371 | 0.9681 |
| No log        | 14.4516 | 448  | 0.9358          | -0.0138 | 0.9358 | 0.9674 |
| No log        | 14.5161 | 450  | 0.9247          | -0.0526 | 0.9247 | 0.9616 |
| No log        | 14.5806 | 452  | 0.8488          | 0.1593  | 0.8488 | 0.9213 |
| No log        | 14.6452 | 454  | 0.8253          | 0.0956  | 0.8253 | 0.9084 |
| No log        | 14.7097 | 456  | 0.8529          | 0.1593  | 0.8529 | 0.9235 |
| No log        | 14.7742 | 458  | 1.0054          | -0.0899 | 1.0054 | 1.0027 |
| No log        | 14.8387 | 460  | 1.2321          | 0.0130  | 1.2321 | 1.1100 |
| No log        | 14.9032 | 462  | 1.3853          | 0.0031  | 1.3853 | 1.1770 |
| No log        | 14.9677 | 464  | 1.2537          | -0.0145 | 1.2537 | 1.1197 |
| No log        | 15.0323 | 466  | 1.0034          | -0.0885 | 1.0034 | 1.0017 |
| No log        | 15.0968 | 468  | 0.8897          | 0.1105  | 0.8897 | 0.9432 |
| No log        | 15.1613 | 470  | 0.9185          | 0.0277  | 0.9185 | 0.9584 |
| No log        | 15.2258 | 472  | 0.9690          | -0.0526 | 0.9690 | 0.9844 |
| No log        | 15.2903 | 474  | 0.9756          | -0.0885 | 0.9756 | 0.9877 |
| No log        | 15.3548 | 476  | 0.9316          | -0.0138 | 0.9316 | 0.9652 |
| No log        | 15.4194 | 478  | 0.9031          | 0.1149  | 0.9031 | 0.9503 |
| No log        | 15.4839 | 480  | 0.9048          | 0.0333  | 0.9048 | 0.9512 |
| No log        | 15.5484 | 482  | 0.9529          | -0.0513 | 0.9529 | 0.9762 |
| No log        | 15.6129 | 484  | 0.9899          | -0.0877 | 0.9899 | 0.9950 |
| No log        | 15.6774 | 486  | 0.9737          | -0.0500 | 0.9737 | 0.9868 |
| No log        | 15.7419 | 488  | 0.9536          | -0.0486 | 0.9536 | 0.9765 |
| No log        | 15.8065 | 490  | 0.9012          | 0.2054  | 0.9012 | 0.9493 |
| No log        | 15.8710 | 492  | 0.8363          | 0.1001  | 0.8363 | 0.9145 |
| No log        | 15.9355 | 494  | 0.8172          | 0.1001  | 0.8172 | 0.9040 |
| No log        | 16.0    | 496  | 0.8342          | 0.1001  | 0.8342 | 0.9134 |
| No log        | 16.0645 | 498  | 0.8814          | 0.1193  | 0.8814 | 0.9388 |
| 0.3098        | 16.1290 | 500  | 0.9759          | -0.0500 | 0.9759 | 0.9879 |
| 0.3098        | 16.1935 | 502  | 0.9435          | 0.0719  | 0.9435 | 0.9713 |
| 0.3098        | 16.2581 | 504  | 0.9250          | 0.1542  | 0.9250 | 0.9618 |
| 0.3098        | 16.3226 | 506  | 0.9600          | 0.1809  | 0.9600 | 0.9798 |
| 0.3098        | 16.3871 | 508  | 0.9024          | 0.1484  | 0.9024 | 0.9499 |
| 0.3098        | 16.4516 | 510  | 0.8220          | 0.0188  | 0.8220 | 0.9067 |
| 0.3098        | 16.5161 | 512  | 0.7862          | 0.0359  | 0.7862 | 0.8867 |
| 0.3098        | 16.5806 | 514  | 0.7537          | 0.0791  | 0.7537 | 0.8681 |
| 0.3098        | 16.6452 | 516  | 0.7212          | 0.0323  | 0.7212 | 0.8493 |
| 0.3098        | 16.7097 | 518  | 0.7349          | 0.2034  | 0.7349 | 0.8572 |
| 0.3098        | 16.7742 | 520  | 0.7999          | 0.1716  | 0.7999 | 0.8944 |
| 0.3098        | 16.8387 | 522  | 0.8206          | 0.1286  | 0.8206 | 0.9058 |
| 0.3098        | 16.9032 | 524  | 0.7911          | 0.0709  | 0.7911 | 0.8894 |
| 0.3098        | 16.9677 | 526  | 0.8265          | 0.0408  | 0.8265 | 0.9091 |
| 0.3098        | 17.0323 | 528  | 0.8467          | 0.0     | 0.8467 | 0.9202 |
| 0.3098        | 17.0968 | 530  | 0.8554          | 0.1423  | 0.8554 | 0.9249 |
| 0.3098        | 17.1613 | 532  | 0.9625          | 0.0362  | 0.9625 | 0.9811 |
| 0.3098        | 17.2258 | 534  | 0.9829          | -0.0076 | 0.9829 | 0.9914 |
| 0.3098        | 17.2903 | 536  | 0.9723          | 0.0277  | 0.9723 | 0.9861 |
| 0.3098        | 17.3548 | 538  | 0.9682          | 0.0250  | 0.9682 | 0.9840 |
| 0.3098        | 17.4194 | 540  | 0.8926          | 0.1542  | 0.8926 | 0.9448 |
| 0.3098        | 17.4839 | 542  | 0.9084          | 0.1542  | 0.9084 | 0.9531 |
| 0.3098        | 17.5484 | 544  | 0.8933          | 0.1542  | 0.8933 | 0.9452 |
| 0.3098        | 17.6129 | 546  | 0.8213          | 0.1003  | 0.8213 | 0.9063 |
| 0.3098        | 17.6774 | 548  | 0.8364          | -0.0517 | 0.8364 | 0.9146 |
| 0.3098        | 17.7419 | 550  | 0.8461          | -0.0533 | 0.8461 | 0.9198 |
| 0.3098        | 17.8065 | 552  | 0.9080          | 0.1862  | 0.9080 | 0.9529 |
| 0.3098        | 17.8710 | 554  | 1.0399          | 0.0881  | 1.0399 | 1.0197 |
| 0.3098        | 17.9355 | 556  | 1.1060          | -0.0557 | 1.1060 | 1.0517 |
| 0.3098        | 18.0    | 558  | 1.0695          | -0.0526 | 1.0695 | 1.0341 |
| 0.3098        | 18.0645 | 560  | 0.9505          | 0.1025  | 0.9505 | 0.9749 |
| 0.3098        | 18.1290 | 562  | 0.8637          | 0.1286  | 0.8637 | 0.9294 |
| 0.3098        | 18.1935 | 564  | 0.8616          | 0.1817  | 0.8616 | 0.9282 |
| 0.3098        | 18.2581 | 566  | 0.9803          | 0.0986  | 0.9803 | 0.9901 |
| 0.3098        | 18.3226 | 568  | 1.0636          | -0.0526 | 1.0636 | 1.0313 |
| 0.3098        | 18.3871 | 570  | 1.0435          | -0.0526 | 1.0435 | 1.0215 |
| 0.3098        | 18.4516 | 572  | 0.9923          | 0.0986  | 0.9923 | 0.9961 |
| 0.3098        | 18.5161 | 574  | 0.8948          | 0.0871  | 0.8948 | 0.9459 |
| 0.3098        | 18.5806 | 576  | 0.8299          | 0.1859  | 0.8299 | 0.9110 |
| 0.3098        | 18.6452 | 578  | 0.7925          | 0.1529  | 0.7925 | 0.8902 |
| 0.3098        | 18.7097 | 580  | 0.7851          | 0.1943  | 0.7851 | 0.8861 |
| 0.3098        | 18.7742 | 582  | 0.8061          | 0.1817  | 0.8061 | 0.8979 |
| 0.3098        | 18.8387 | 584  | 0.8552          | 0.1190  | 0.8552 | 0.9248 |
| 0.3098        | 18.9032 | 586  | 0.9171          | 0.1484  | 0.9171 | 0.9577 |
| 0.3098        | 18.9677 | 588  | 0.9327          | 0.1147  | 0.9327 | 0.9658 |
| 0.3098        | 19.0323 | 590  | 0.9133          | 0.2032  | 0.9133 | 0.9557 |
| 0.3098        | 19.0968 | 592  | 0.9178          | 0.1758  | 0.9178 | 0.9580 |
| 0.3098        | 19.1613 | 594  | 0.8968          | 0.1727  | 0.8968 | 0.9470 |
| 0.3098        | 19.2258 | 596  | 0.8584          | 0.1318  | 0.8584 | 0.9265 |
| 0.3098        | 19.2903 | 598  | 0.8452          | 0.1318  | 0.8452 | 0.9193 |
| 0.3098        | 19.3548 | 600  | 0.8833          | 0.1727  | 0.8833 | 0.9398 |
| 0.3098        | 19.4194 | 602  | 0.9765          | -0.0471 | 0.9765 | 0.9882 |
| 0.3098        | 19.4839 | 604  | 1.0810          | -0.1238 | 1.0810 | 1.0397 |
| 0.3098        | 19.5484 | 606  | 1.0831          | -0.1238 | 1.0831 | 1.0407 |
| 0.3098        | 19.6129 | 608  | 0.9775          | -0.0870 | 0.9775 | 0.9887 |
| 0.3098        | 19.6774 | 610  | 0.9304          | -0.0118 | 0.9304 | 0.9646 |
| 0.3098        | 19.7419 | 612  | 0.9089          | 0.1542  | 0.9089 | 0.9534 |
| 0.3098        | 19.8065 | 614  | 0.9231          | -0.0118 | 0.9231 | 0.9608 |
| 0.3098        | 19.8710 | 616  | 0.9663          | -0.0877 | 0.9663 | 0.9830 |
| 0.3098        | 19.9355 | 618  | 1.0580          | -0.1243 | 1.0580 | 1.0286 |
| 0.3098        | 20.0    | 620  | 1.1110          | -0.1248 | 1.1110 | 1.0540 |
| 0.3098        | 20.0645 | 622  | 1.1221          | -0.0953 | 1.1221 | 1.0593 |
| 0.3098        | 20.1290 | 624  | 1.0975          | -0.1246 | 1.0975 | 1.0476 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1