File size: 29,027 Bytes
3422f9e
 
 
 
 
 
2b2808d
3422f9e
 
 
 
 
 
2b2808d
3422f9e
 
 
2b2808d
 
 
 
3422f9e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2b2808d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3422f9e
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k16_task3_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_FineTuningAraBERT_run3_AugV5_k16_task3_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co./aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.8244
- Qwk: 0.0639
- Mse: 0.8244
- Rmse: 0.9080

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch   | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:-------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.0465  | 2    | 3.7246          | -0.0068 | 3.7246 | 1.9299 |
| No log        | 0.0930  | 4    | 2.0014          | 0.0304  | 2.0014 | 1.4147 |
| No log        | 0.1395  | 6    | 1.8875          | 0.0372  | 1.8875 | 1.3739 |
| No log        | 0.1860  | 8    | 1.6258          | -0.0702 | 1.6258 | 1.2751 |
| No log        | 0.2326  | 10   | 0.9176          | -0.1688 | 0.9176 | 0.9579 |
| No log        | 0.2791  | 12   | 0.7535          | -0.1236 | 0.7535 | 0.8680 |
| No log        | 0.3256  | 14   | 0.9002          | 0.0026  | 0.9002 | 0.9488 |
| No log        | 0.3721  | 16   | 1.1537          | 0.0279  | 1.1537 | 1.0741 |
| No log        | 0.4186  | 18   | 1.3957          | 0.0     | 1.3957 | 1.1814 |
| No log        | 0.4651  | 20   | 1.3179          | 0.0     | 1.3179 | 1.1480 |
| No log        | 0.5116  | 22   | 1.0646          | -0.0234 | 1.0646 | 1.0318 |
| No log        | 0.5581  | 24   | 0.9999          | -0.0695 | 0.9999 | 0.9999 |
| No log        | 0.6047  | 26   | 0.9609          | -0.0686 | 0.9609 | 0.9803 |
| No log        | 0.6512  | 28   | 1.0698          | -0.0234 | 1.0698 | 1.0343 |
| No log        | 0.6977  | 30   | 0.9765          | 0.0083  | 0.9765 | 0.9882 |
| No log        | 0.7442  | 32   | 1.0029          | -0.0221 | 1.0029 | 1.0014 |
| No log        | 0.7907  | 34   | 1.1231          | -0.0234 | 1.1231 | 1.0598 |
| No log        | 0.8372  | 36   | 1.0281          | -0.0468 | 1.0281 | 1.0140 |
| No log        | 0.8837  | 38   | 0.9512          | -0.0372 | 0.9512 | 0.9753 |
| No log        | 0.9302  | 40   | 0.7967          | -0.0766 | 0.7967 | 0.8926 |
| No log        | 0.9767  | 42   | 0.7191          | 0.0     | 0.7191 | 0.8480 |
| No log        | 1.0233  | 44   | 0.7244          | 0.0     | 0.7244 | 0.8511 |
| No log        | 1.0698  | 46   | 0.7943          | -0.0739 | 0.7943 | 0.8912 |
| No log        | 1.1163  | 48   | 0.8178          | -0.1241 | 0.8178 | 0.9043 |
| No log        | 1.1628  | 50   | 0.7800          | -0.0679 | 0.7800 | 0.8832 |
| No log        | 1.2093  | 52   | 0.8207          | -0.1233 | 0.8207 | 0.9059 |
| No log        | 1.2558  | 54   | 1.0522          | -0.0359 | 1.0522 | 1.0258 |
| No log        | 1.3023  | 56   | 1.0617          | -0.1612 | 1.0617 | 1.0304 |
| No log        | 1.3488  | 58   | 0.9348          | -0.0878 | 0.9348 | 0.9669 |
| No log        | 1.3953  | 60   | 0.8498          | -0.1244 | 0.8498 | 0.9218 |
| No log        | 1.4419  | 62   | 0.7397          | 0.0555  | 0.7397 | 0.8601 |
| No log        | 1.4884  | 64   | 0.7083          | 0.0555  | 0.7083 | 0.8416 |
| No log        | 1.5349  | 66   | 0.7603          | -0.0069 | 0.7603 | 0.8719 |
| No log        | 1.5814  | 68   | 1.1730          | -0.0720 | 1.1730 | 1.0831 |
| No log        | 1.6279  | 70   | 1.6100          | 0.0032  | 1.6100 | 1.2689 |
| No log        | 1.6744  | 72   | 1.6552          | 0.0279  | 1.6552 | 1.2865 |
| No log        | 1.7209  | 74   | 1.3500          | 0.0083  | 1.3500 | 1.1619 |
| No log        | 1.7674  | 76   | 0.9280          | -0.0902 | 0.9280 | 0.9633 |
| No log        | 1.8140  | 78   | 0.7687          | 0.0374  | 0.7687 | 0.8768 |
| No log        | 1.8605  | 80   | 0.7334          | -0.0069 | 0.7334 | 0.8564 |
| No log        | 1.9070  | 82   | 0.7383          | -0.0069 | 0.7383 | 0.8593 |
| No log        | 1.9535  | 84   | 0.9509          | 0.0793  | 0.9509 | 0.9752 |
| No log        | 2.0     | 86   | 1.4532          | -0.0433 | 1.4532 | 1.2055 |
| No log        | 2.0465  | 88   | 1.4944          | -0.0422 | 1.4944 | 1.2225 |
| No log        | 2.0930  | 90   | 1.0408          | 0.1399  | 1.0408 | 1.0202 |
| No log        | 2.1395  | 92   | 0.8014          | 0.0759  | 0.8014 | 0.8952 |
| No log        | 2.1860  | 94   | 0.8661          | -0.0331 | 0.8661 | 0.9306 |
| No log        | 2.2326  | 96   | 1.1521          | 0.0147  | 1.1521 | 1.0733 |
| No log        | 2.2791  | 98   | 1.3601          | 0.0585  | 1.3601 | 1.1662 |
| No log        | 2.3256  | 100  | 1.0854          | -0.0500 | 1.0854 | 1.0418 |
| No log        | 2.3721  | 102  | 0.7757          | 0.0918  | 0.7757 | 0.8807 |
| No log        | 2.4186  | 104  | 0.8418          | -0.1538 | 0.8418 | 0.9175 |
| No log        | 2.4651  | 106  | 0.8415          | -0.0633 | 0.8415 | 0.9173 |
| No log        | 2.5116  | 108  | 0.9006          | -0.1152 | 0.9006 | 0.9490 |
| No log        | 2.5581  | 110  | 1.2271          | 0.0305  | 1.2271 | 1.1077 |
| No log        | 2.6047  | 112  | 0.9688          | -0.0878 | 0.9688 | 0.9843 |
| No log        | 2.6512  | 114  | 0.7820          | -0.1001 | 0.7820 | 0.8843 |
| No log        | 2.6977  | 116  | 0.8291          | -0.0939 | 0.8291 | 0.9105 |
| No log        | 2.7442  | 118  | 0.7714          | -0.0499 | 0.7714 | 0.8783 |
| No log        | 2.7907  | 120  | 0.9501          | 0.0287  | 0.9501 | 0.9747 |
| No log        | 2.8372  | 122  | 0.9907          | 0.0287  | 0.9907 | 0.9953 |
| No log        | 2.8837  | 124  | 0.7636          | 0.0496  | 0.7636 | 0.8738 |
| No log        | 2.9302  | 126  | 0.7512          | -0.0571 | 0.7512 | 0.8667 |
| No log        | 2.9767  | 128  | 0.7572          | -0.0152 | 0.7572 | 0.8702 |
| No log        | 3.0233  | 130  | 0.8866          | 0.0456  | 0.8866 | 0.9416 |
| No log        | 3.0698  | 132  | 0.7488          | -0.0179 | 0.7488 | 0.8653 |
| No log        | 3.1163  | 134  | 0.7391          | 0.0395  | 0.7391 | 0.8597 |
| No log        | 3.1628  | 136  | 0.7963          | 0.0999  | 0.7963 | 0.8923 |
| No log        | 3.2093  | 138  | 0.7861          | 0.0588  | 0.7861 | 0.8866 |
| No log        | 3.2558  | 140  | 0.7664          | 0.0814  | 0.7664 | 0.8755 |
| No log        | 3.3023  | 142  | 0.8022          | 0.0338  | 0.8022 | 0.8957 |
| No log        | 3.3488  | 144  | 1.1238          | -0.0571 | 1.1238 | 1.0601 |
| No log        | 3.3953  | 146  | 1.2460          | 0.0945  | 1.2460 | 1.1162 |
| No log        | 3.4419  | 148  | 0.9069          | -0.1734 | 0.9069 | 0.9523 |
| No log        | 3.4884  | 150  | 0.9593          | -0.0616 | 0.9593 | 0.9794 |
| No log        | 3.5349  | 152  | 0.9033          | -0.0771 | 0.9033 | 0.9504 |
| No log        | 3.5814  | 154  | 0.8924          | 0.0226  | 0.8924 | 0.9447 |
| No log        | 3.6279  | 156  | 1.0415          | -0.1159 | 1.0415 | 1.0205 |
| No log        | 3.6744  | 158  | 0.8618          | 0.0327  | 0.8618 | 0.9283 |
| No log        | 3.7209  | 160  | 0.8643          | -0.0904 | 0.8643 | 0.9297 |
| No log        | 3.7674  | 162  | 0.8325          | 0.0509  | 0.8325 | 0.9124 |
| No log        | 3.8140  | 164  | 0.8676          | 0.0226  | 0.8676 | 0.9314 |
| No log        | 3.8605  | 166  | 0.8973          | 0.0175  | 0.8973 | 0.9473 |
| No log        | 3.9070  | 168  | 0.8325          | 0.0027  | 0.8325 | 0.9124 |
| No log        | 3.9535  | 170  | 0.9022          | -0.0059 | 0.9022 | 0.9498 |
| No log        | 4.0     | 172  | 0.8618          | -0.0796 | 0.8618 | 0.9284 |
| No log        | 4.0465  | 174  | 0.8376          | 0.0359  | 0.8376 | 0.9152 |
| No log        | 4.0930  | 176  | 0.7910          | 0.1413  | 0.7910 | 0.8894 |
| No log        | 4.1395  | 178  | 0.8113          | -0.0214 | 0.8113 | 0.9007 |
| No log        | 4.1860  | 180  | 0.7716          | 0.0122  | 0.7716 | 0.8784 |
| No log        | 4.2326  | 182  | 0.7906          | 0.0175  | 0.7906 | 0.8892 |
| No log        | 4.2791  | 184  | 0.7667          | 0.1856  | 0.7667 | 0.8756 |
| No log        | 4.3256  | 186  | 0.8539          | -0.0528 | 0.8539 | 0.9241 |
| No log        | 4.3721  | 188  | 0.8714          | -0.0528 | 0.8714 | 0.9335 |
| No log        | 4.4186  | 190  | 0.7605          | 0.0598  | 0.7605 | 0.8721 |
| No log        | 4.4651  | 192  | 0.7640          | 0.1506  | 0.7640 | 0.8741 |
| No log        | 4.5116  | 194  | 0.7475          | 0.0334  | 0.7475 | 0.8646 |
| No log        | 4.5581  | 196  | 0.7799          | 0.0089  | 0.7799 | 0.8831 |
| No log        | 4.6047  | 198  | 0.8485          | -0.0692 | 0.8485 | 0.9211 |
| No log        | 4.6512  | 200  | 0.8231          | -0.0366 | 0.8231 | 0.9073 |
| No log        | 4.6977  | 202  | 0.8408          | 0.0357  | 0.8408 | 0.9170 |
| No log        | 4.7442  | 204  | 0.8535          | -0.0810 | 0.8535 | 0.9239 |
| No log        | 4.7907  | 206  | 0.9587          | -0.0861 | 0.9587 | 0.9791 |
| No log        | 4.8372  | 208  | 0.8990          | -0.0996 | 0.8990 | 0.9481 |
| No log        | 4.8837  | 210  | 0.8625          | -0.0717 | 0.8625 | 0.9287 |
| No log        | 4.9302  | 212  | 0.8406          | 0.0     | 0.8406 | 0.9169 |
| No log        | 4.9767  | 214  | 0.8643          | 0.0247  | 0.8643 | 0.9297 |
| No log        | 5.0233  | 216  | 0.8506          | -0.0930 | 0.8506 | 0.9223 |
| No log        | 5.0698  | 218  | 0.9301          | -0.1194 | 0.9301 | 0.9644 |
| No log        | 5.1163  | 220  | 0.8812          | -0.1709 | 0.8812 | 0.9387 |
| No log        | 5.1628  | 222  | 0.9657          | -0.0408 | 0.9657 | 0.9827 |
| No log        | 5.2093  | 224  | 1.1581          | -0.0218 | 1.1581 | 1.0762 |
| No log        | 5.2558  | 226  | 0.9267          | -0.0283 | 0.9267 | 0.9627 |
| No log        | 5.3023  | 228  | 0.8749          | -0.1538 | 0.8749 | 0.9354 |
| No log        | 5.3488  | 230  | 0.8798          | -0.1843 | 0.8798 | 0.9380 |
| No log        | 5.3953  | 232  | 0.8413          | -0.1531 | 0.8413 | 0.9172 |
| No log        | 5.4419  | 234  | 0.8417          | -0.1106 | 0.8417 | 0.9174 |
| No log        | 5.4884  | 236  | 0.8380          | -0.1100 | 0.8380 | 0.9154 |
| No log        | 5.5349  | 238  | 0.8259          | -0.0675 | 0.8259 | 0.9088 |
| No log        | 5.5814  | 240  | 0.7798          | -0.0609 | 0.7798 | 0.8831 |
| No log        | 5.6279  | 242  | 0.7613          | -0.0571 | 0.7613 | 0.8726 |
| No log        | 5.6744  | 244  | 0.7668          | -0.0101 | 0.7668 | 0.8757 |
| No log        | 5.7209  | 246  | 0.7946          | 0.0334  | 0.7946 | 0.8914 |
| No log        | 5.7674  | 248  | 0.8031          | 0.0807  | 0.8031 | 0.8962 |
| No log        | 5.8140  | 250  | 0.7792          | -0.1088 | 0.7792 | 0.8827 |
| No log        | 5.8605  | 252  | 0.8104          | -0.1470 | 0.8104 | 0.9002 |
| No log        | 5.9070  | 254  | 0.7914          | -0.1026 | 0.7914 | 0.8896 |
| No log        | 5.9535  | 256  | 0.8502          | 0.0512  | 0.8502 | 0.9221 |
| No log        | 6.0     | 258  | 0.8092          | 0.0191  | 0.8092 | 0.8996 |
| No log        | 6.0465  | 260  | 0.8370          | -0.0204 | 0.8370 | 0.9149 |
| No log        | 6.0930  | 262  | 0.8940          | 0.0734  | 0.8940 | 0.9455 |
| No log        | 6.1395  | 264  | 0.8534          | -0.1045 | 0.8534 | 0.9238 |
| No log        | 6.1860  | 266  | 0.8198          | -0.0145 | 0.8198 | 0.9055 |
| No log        | 6.2326  | 268  | 0.8200          | -0.0145 | 0.8200 | 0.9056 |
| No log        | 6.2791  | 270  | 0.8376          | -0.0658 | 0.8376 | 0.9152 |
| No log        | 6.3256  | 272  | 0.8527          | -0.0658 | 0.8527 | 0.9234 |
| No log        | 6.3721  | 274  | 0.8481          | -0.0113 | 0.8481 | 0.9209 |
| No log        | 6.4186  | 276  | 0.8243          | -0.1026 | 0.8243 | 0.9079 |
| No log        | 6.4651  | 278  | 0.8080          | -0.0428 | 0.8080 | 0.8989 |
| No log        | 6.5116  | 280  | 0.7847          | -0.0550 | 0.7847 | 0.8858 |
| No log        | 6.5581  | 282  | 0.7885          | -0.1018 | 0.7885 | 0.8880 |
| No log        | 6.6047  | 284  | 0.8200          | -0.0826 | 0.8200 | 0.9055 |
| No log        | 6.6512  | 286  | 0.8767          | -0.1834 | 0.8767 | 0.9363 |
| No log        | 6.6977  | 288  | 0.9833          | -0.0317 | 0.9833 | 0.9916 |
| No log        | 6.7442  | 290  | 0.9799          | -0.1145 | 0.9799 | 0.9899 |
| No log        | 6.7907  | 292  | 0.9269          | -0.1163 | 0.9269 | 0.9628 |
| No log        | 6.8372  | 294  | 1.0290          | -0.1065 | 1.0290 | 1.0144 |
| No log        | 6.8837  | 296  | 1.0308          | -0.1065 | 1.0308 | 1.0153 |
| No log        | 6.9302  | 298  | 0.9483          | -0.1088 | 0.9483 | 0.9738 |
| No log        | 6.9767  | 300  | 0.8615          | -0.1155 | 0.8615 | 0.9282 |
| No log        | 7.0233  | 302  | 0.9106          | -0.0896 | 0.9106 | 0.9542 |
| No log        | 7.0698  | 304  | 0.8660          | -0.1588 | 0.8660 | 0.9306 |
| No log        | 7.1163  | 306  | 0.9435          | -0.0336 | 0.9435 | 0.9713 |
| No log        | 7.1628  | 308  | 1.2123          | -0.0608 | 1.2123 | 1.1010 |
| No log        | 7.2093  | 310  | 1.0730          | -0.0253 | 1.0730 | 1.0359 |
| No log        | 7.2558  | 312  | 0.8275          | -0.0541 | 0.8275 | 0.9097 |
| No log        | 7.3023  | 314  | 0.9043          | -0.0442 | 0.9043 | 0.9510 |
| No log        | 7.3488  | 316  | 0.8759          | -0.0477 | 0.8759 | 0.9359 |
| No log        | 7.3953  | 318  | 0.7766          | -0.0967 | 0.7766 | 0.8812 |
| No log        | 7.4419  | 320  | 0.8352          | 0.0953  | 0.8352 | 0.9139 |
| No log        | 7.4884  | 322  | 0.8255          | 0.0909  | 0.8255 | 0.9086 |
| No log        | 7.5349  | 324  | 0.7637          | 0.0395  | 0.7637 | 0.8739 |
| No log        | 7.5814  | 326  | 0.7825          | -0.1398 | 0.7825 | 0.8846 |
| No log        | 7.6279  | 328  | 0.7973          | -0.0465 | 0.7973 | 0.8929 |
| No log        | 7.6744  | 330  | 0.9531          | 0.0233  | 0.9531 | 0.9762 |
| No log        | 7.7209  | 332  | 1.0713          | -0.0595 | 1.0713 | 1.0350 |
| No log        | 7.7674  | 334  | 0.8744          | 0.0091  | 0.8744 | 0.9351 |
| No log        | 7.8140  | 336  | 0.8604          | -0.1002 | 0.8604 | 0.9276 |
| No log        | 7.8605  | 338  | 0.8548          | -0.1002 | 0.8548 | 0.9246 |
| No log        | 7.9070  | 340  | 0.8246          | 0.0851  | 0.8246 | 0.9081 |
| No log        | 7.9535  | 342  | 0.8164          | 0.0495  | 0.8164 | 0.9036 |
| No log        | 8.0     | 344  | 0.8187          | 0.0846  | 0.8187 | 0.9048 |
| No log        | 8.0465  | 346  | 0.8285          | 0.0893  | 0.8285 | 0.9102 |
| No log        | 8.0930  | 348  | 0.8383          | -0.0717 | 0.8383 | 0.9156 |
| No log        | 8.1395  | 350  | 0.8605          | 0.0283  | 0.8605 | 0.9277 |
| No log        | 8.1860  | 352  | 0.9299          | 0.0084  | 0.9299 | 0.9643 |
| No log        | 8.2326  | 354  | 0.9317          | -0.0094 | 0.9317 | 0.9652 |
| No log        | 8.2791  | 356  | 0.8173          | 0.0393  | 0.8173 | 0.9040 |
| No log        | 8.3256  | 358  | 0.7960          | -0.0967 | 0.7960 | 0.8922 |
| No log        | 8.3721  | 360  | 0.8017          | 0.0828  | 0.8017 | 0.8954 |
| No log        | 8.4186  | 362  | 0.8565          | 0.0755  | 0.8565 | 0.9255 |
| No log        | 8.4651  | 364  | 0.8423          | 0.1239  | 0.8423 | 0.9178 |
| No log        | 8.5116  | 366  | 0.8005          | -0.0387 | 0.8005 | 0.8947 |
| No log        | 8.5581  | 368  | 0.8926          | 0.0377  | 0.8926 | 0.9448 |
| No log        | 8.6047  | 370  | 0.8257          | -0.1051 | 0.8257 | 0.9087 |
| No log        | 8.6512  | 372  | 0.8398          | 0.0068  | 0.8398 | 0.9164 |
| No log        | 8.6977  | 374  | 1.1599          | 0.0238  | 1.1599 | 1.0770 |
| No log        | 8.7442  | 376  | 0.9975          | 0.0515  | 0.9975 | 0.9987 |
| No log        | 8.7907  | 378  | 0.7840          | 0.0628  | 0.7840 | 0.8854 |
| No log        | 8.8372  | 380  | 0.7208          | -0.0065 | 0.7208 | 0.8490 |
| No log        | 8.8837  | 382  | 0.7104          | -0.0065 | 0.7104 | 0.8429 |
| No log        | 8.9302  | 384  | 0.7153          | -0.0571 | 0.7153 | 0.8457 |
| No log        | 8.9767  | 386  | 0.7211          | 0.0416  | 0.7211 | 0.8492 |
| No log        | 9.0233  | 388  | 0.8703          | 0.0486  | 0.8703 | 0.9329 |
| No log        | 9.0698  | 390  | 0.8490          | 0.0545  | 0.8490 | 0.9214 |
| No log        | 9.1163  | 392  | 0.7225          | -0.0096 | 0.7225 | 0.8500 |
| No log        | 9.1628  | 394  | 0.7607          | -0.0738 | 0.7607 | 0.8722 |
| No log        | 9.2093  | 396  | 0.8050          | -0.0121 | 0.8050 | 0.8972 |
| No log        | 9.2558  | 398  | 0.7436          | -0.0387 | 0.7436 | 0.8623 |
| No log        | 9.3023  | 400  | 0.7765          | 0.2009  | 0.7765 | 0.8812 |
| No log        | 9.3488  | 402  | 0.7871          | 0.1836  | 0.7871 | 0.8872 |
| No log        | 9.3953  | 404  | 0.7364          | 0.0814  | 0.7364 | 0.8582 |
| No log        | 9.4419  | 406  | 0.7554          | -0.0307 | 0.7554 | 0.8691 |
| No log        | 9.4884  | 408  | 0.7888          | -0.0271 | 0.7888 | 0.8882 |
| No log        | 9.5349  | 410  | 0.7535          | -0.0992 | 0.7535 | 0.8680 |
| No log        | 9.5814  | 412  | 0.7886          | 0.0282  | 0.7886 | 0.8880 |
| No log        | 9.6279  | 414  | 0.7725          | -0.0170 | 0.7725 | 0.8789 |
| No log        | 9.6744  | 416  | 0.8408          | 0.0867  | 0.8408 | 0.9170 |
| No log        | 9.7209  | 418  | 0.8605          | 0.0711  | 0.8605 | 0.9276 |
| No log        | 9.7674  | 420  | 0.8665          | -0.0008 | 0.8665 | 0.9309 |
| No log        | 9.8140  | 422  | 0.8107          | 0.0205  | 0.8107 | 0.9004 |
| No log        | 9.8605  | 424  | 0.7729          | -0.0062 | 0.7729 | 0.8791 |
| No log        | 9.9070  | 426  | 0.7858          | -0.1091 | 0.7858 | 0.8864 |
| No log        | 9.9535  | 428  | 0.7918          | -0.1474 | 0.7918 | 0.8898 |
| No log        | 10.0    | 430  | 0.7848          | -0.1538 | 0.7848 | 0.8859 |
| No log        | 10.0465 | 432  | 0.7290          | 0.1081  | 0.7290 | 0.8538 |
| No log        | 10.0930 | 434  | 0.7834          | 0.1047  | 0.7834 | 0.8851 |
| No log        | 10.1395 | 436  | 0.8009          | 0.0588  | 0.8009 | 0.8949 |
| No log        | 10.1860 | 438  | 0.7792          | 0.0     | 0.7792 | 0.8827 |
| No log        | 10.2326 | 440  | 0.8539          | -0.1245 | 0.8539 | 0.9241 |
| No log        | 10.2791 | 442  | 0.8531          | -0.1194 | 0.8531 | 0.9236 |
| No log        | 10.3256 | 444  | 0.7802          | -0.0329 | 0.7802 | 0.8833 |
| No log        | 10.3721 | 446  | 0.8072          | 0.1096  | 0.8072 | 0.8984 |
| No log        | 10.4186 | 448  | 0.8245          | 0.0409  | 0.8245 | 0.9080 |
| No log        | 10.4651 | 450  | 0.7819          | 0.0999  | 0.7819 | 0.8842 |
| No log        | 10.5116 | 452  | 0.7335          | -0.0513 | 0.7335 | 0.8565 |
| No log        | 10.5581 | 454  | 0.8086          | -0.0949 | 0.8086 | 0.8992 |
| No log        | 10.6047 | 456  | 0.8352          | -0.0904 | 0.8352 | 0.9139 |
| No log        | 10.6512 | 458  | 0.8171          | 0.0798  | 0.8171 | 0.9039 |
| No log        | 10.6977 | 460  | 0.8611          | 0.0608  | 0.8611 | 0.9280 |
| No log        | 10.7442 | 462  | 0.8329          | 0.0330  | 0.8329 | 0.9126 |
| No log        | 10.7907 | 464  | 0.8562          | -0.0107 | 0.8562 | 0.9253 |
| No log        | 10.8372 | 466  | 0.8553          | -0.0107 | 0.8553 | 0.9248 |
| No log        | 10.8837 | 468  | 0.8087          | 0.0376  | 0.8087 | 0.8993 |
| No log        | 10.9302 | 470  | 0.9274          | -0.0182 | 0.9274 | 0.9630 |
| No log        | 10.9767 | 472  | 1.0693          | 0.0282  | 1.0693 | 1.0341 |
| No log        | 11.0233 | 474  | 1.0165          | 0.0305  | 1.0165 | 1.0082 |
| No log        | 11.0698 | 476  | 0.8670          | 0.0576  | 0.8670 | 0.9311 |
| No log        | 11.1163 | 478  | 0.7764          | 0.1675  | 0.7764 | 0.8811 |
| No log        | 11.1628 | 480  | 0.7698          | 0.1659  | 0.7698 | 0.8774 |
| No log        | 11.2093 | 482  | 0.8518          | -0.0122 | 0.8518 | 0.9229 |
| No log        | 11.2558 | 484  | 0.9214          | 0.0545  | 0.9214 | 0.9599 |
| No log        | 11.3023 | 486  | 0.8699          | -0.0122 | 0.8699 | 0.9327 |
| No log        | 11.3488 | 488  | 0.7776          | 0.1617  | 0.7776 | 0.8818 |
| No log        | 11.3953 | 490  | 0.7644          | 0.1298  | 0.7644 | 0.8743 |
| No log        | 11.4419 | 492  | 0.7535          | 0.1298  | 0.7535 | 0.8680 |
| No log        | 11.4884 | 494  | 0.7431          | 0.1298  | 0.7431 | 0.8620 |
| No log        | 11.5349 | 496  | 0.8243          | 0.0346  | 0.8243 | 0.9079 |
| No log        | 11.5814 | 498  | 0.8956          | -0.0143 | 0.8956 | 0.9463 |
| 0.368         | 11.6279 | 500  | 0.8305          | 0.0786  | 0.8305 | 0.9113 |
| 0.368         | 11.6744 | 502  | 0.7938          | 0.1143  | 0.7938 | 0.8909 |
| 0.368         | 11.7209 | 504  | 0.8121          | 0.0757  | 0.8121 | 0.9012 |
| 0.368         | 11.7674 | 506  | 0.8349          | 0.0586  | 0.8349 | 0.9137 |
| 0.368         | 11.8140 | 508  | 0.8230          | 0.0725  | 0.8230 | 0.9072 |
| 0.368         | 11.8605 | 510  | 0.8026          | 0.0840  | 0.8026 | 0.8959 |
| 0.368         | 11.9070 | 512  | 0.8130          | 0.0377  | 0.8130 | 0.9017 |
| 0.368         | 11.9535 | 514  | 0.7956          | 0.0867  | 0.7956 | 0.8920 |
| 0.368         | 12.0    | 516  | 0.7593          | 0.0444  | 0.7593 | 0.8714 |
| 0.368         | 12.0465 | 518  | 0.7895          | -0.0248 | 0.7895 | 0.8885 |
| 0.368         | 12.0930 | 520  | 0.7779          | 0.0074  | 0.7779 | 0.8820 |
| 0.368         | 12.1395 | 522  | 0.7662          | 0.0460  | 0.7662 | 0.8753 |
| 0.368         | 12.1860 | 524  | 0.7671          | 0.1599  | 0.7671 | 0.8758 |
| 0.368         | 12.2326 | 526  | 0.7662          | 0.1249  | 0.7662 | 0.8753 |
| 0.368         | 12.2791 | 528  | 0.7714          | 0.1249  | 0.7714 | 0.8783 |
| 0.368         | 12.3256 | 530  | 0.7626          | -0.0056 | 0.7626 | 0.8733 |
| 0.368         | 12.3721 | 532  | 0.7618          | -0.1399 | 0.7618 | 0.8728 |
| 0.368         | 12.4186 | 534  | 0.7408          | -0.1067 | 0.7408 | 0.8607 |
| 0.368         | 12.4651 | 536  | 0.7384          | 0.0814  | 0.7384 | 0.8593 |
| 0.368         | 12.5116 | 538  | 0.7757          | 0.1202  | 0.7757 | 0.8807 |
| 0.368         | 12.5581 | 540  | 0.8614          | 0.0442  | 0.8614 | 0.9281 |
| 0.368         | 12.6047 | 542  | 0.9273          | -0.0122 | 0.9273 | 0.9630 |
| 0.368         | 12.6512 | 544  | 0.8589          | 0.0442  | 0.8589 | 0.9268 |
| 0.368         | 12.6977 | 546  | 0.7514          | 0.1318  | 0.7514 | 0.8668 |
| 0.368         | 12.7442 | 548  | 0.7533          | -0.0469 | 0.7533 | 0.8679 |
| 0.368         | 12.7907 | 550  | 0.7741          | -0.1329 | 0.7741 | 0.8798 |
| 0.368         | 12.8372 | 552  | 0.7768          | -0.0446 | 0.7768 | 0.8814 |
| 0.368         | 12.8837 | 554  | 0.7941          | 0.0357  | 0.7941 | 0.8911 |
| 0.368         | 12.9302 | 556  | 0.8220          | 0.1506  | 0.8220 | 0.9067 |
| 0.368         | 12.9767 | 558  | 0.8225          | 0.1449  | 0.8225 | 0.9069 |
| 0.368         | 13.0233 | 560  | 0.7916          | 0.1254  | 0.7916 | 0.8897 |
| 0.368         | 13.0698 | 562  | 0.7792          | 0.0376  | 0.7792 | 0.8827 |
| 0.368         | 13.1163 | 564  | 0.7854          | 0.0376  | 0.7854 | 0.8862 |
| 0.368         | 13.1628 | 566  | 0.7918          | 0.0741  | 0.7918 | 0.8898 |
| 0.368         | 13.2093 | 568  | 0.8064          | 0.0741  | 0.8064 | 0.8980 |
| 0.368         | 13.2558 | 570  | 0.8249          | 0.0913  | 0.8249 | 0.9082 |
| 0.368         | 13.3023 | 572  | 0.8011          | 0.1199  | 0.8011 | 0.8951 |
| 0.368         | 13.3488 | 574  | 0.7755          | 0.0741  | 0.7755 | 0.8806 |
| 0.368         | 13.3953 | 576  | 0.7824          | 0.1196  | 0.7824 | 0.8845 |
| 0.368         | 13.4419 | 578  | 0.7979          | 0.1612  | 0.7979 | 0.8933 |
| 0.368         | 13.4884 | 580  | 0.7934          | 0.0749  | 0.7934 | 0.8907 |
| 0.368         | 13.5349 | 582  | 0.7868          | 0.0359  | 0.7868 | 0.8870 |
| 0.368         | 13.5814 | 584  | 0.8012          | 0.0902  | 0.8012 | 0.8951 |
| 0.368         | 13.6279 | 586  | 0.7896          | 0.0359  | 0.7896 | 0.8886 |
| 0.368         | 13.6744 | 588  | 0.7783          | 0.0359  | 0.7783 | 0.8822 |
| 0.368         | 13.7209 | 590  | 0.8108          | 0.1001  | 0.8108 | 0.9004 |
| 0.368         | 13.7674 | 592  | 0.8974          | 0.0676  | 0.8974 | 0.9473 |
| 0.368         | 13.8140 | 594  | 0.8765          | 0.0711  | 0.8765 | 0.9362 |
| 0.368         | 13.8605 | 596  | 0.8146          | 0.0867  | 0.8146 | 0.9026 |
| 0.368         | 13.9070 | 598  | 0.7876          | 0.1321  | 0.7876 | 0.8875 |
| 0.368         | 13.9535 | 600  | 0.9149          | -0.0650 | 0.9149 | 0.9565 |
| 0.368         | 14.0    | 602  | 0.9117          | -0.1530 | 0.9117 | 0.9548 |
| 0.368         | 14.0465 | 604  | 0.7871          | 0.0535  | 0.7871 | 0.8872 |
| 0.368         | 14.0930 | 606  | 0.7569          | 0.0834  | 0.7569 | 0.8700 |
| 0.368         | 14.1395 | 608  | 0.7738          | 0.1096  | 0.7738 | 0.8797 |
| 0.368         | 14.1860 | 610  | 0.7630          | 0.1146  | 0.7630 | 0.8735 |
| 0.368         | 14.2326 | 612  | 0.7302          | 0.0914  | 0.7302 | 0.8545 |
| 0.368         | 14.2791 | 614  | 0.7472          | 0.0     | 0.7472 | 0.8644 |
| 0.368         | 14.3256 | 616  | 0.7765          | -0.0821 | 0.7765 | 0.8812 |
| 0.368         | 14.3721 | 618  | 0.7697          | -0.0426 | 0.7697 | 0.8773 |
| 0.368         | 14.4186 | 620  | 0.8220          | 0.1495  | 0.8220 | 0.9066 |
| 0.368         | 14.4651 | 622  | 0.8578          | 0.0871  | 0.8578 | 0.9262 |
| 0.368         | 14.5116 | 624  | 0.7986          | 0.0700  | 0.7986 | 0.8937 |
| 0.368         | 14.5581 | 626  | 0.7754          | 0.0027  | 0.7754 | 0.8805 |
| 0.368         | 14.6047 | 628  | 0.7685          | -0.0054 | 0.7685 | 0.8766 |
| 0.368         | 14.6512 | 630  | 0.7625          | 0.0828  | 0.7625 | 0.8732 |
| 0.368         | 14.6977 | 632  | 0.7526          | 0.0783  | 0.7526 | 0.8675 |
| 0.368         | 14.7442 | 634  | 0.7338          | 0.0884  | 0.7338 | 0.8566 |
| 0.368         | 14.7907 | 636  | 0.7297          | 0.0488  | 0.7297 | 0.8542 |
| 0.368         | 14.8372 | 638  | 0.7317          | -0.0810 | 0.7317 | 0.8554 |
| 0.368         | 14.8837 | 640  | 0.7236          | 0.0930  | 0.7236 | 0.8506 |
| 0.368         | 14.9302 | 642  | 0.7275          | 0.1758  | 0.7275 | 0.8529 |
| 0.368         | 14.9767 | 644  | 0.7917          | 0.1565  | 0.7917 | 0.8898 |
| 0.368         | 15.0233 | 646  | 0.7810          | 0.1565  | 0.7810 | 0.8837 |
| 0.368         | 15.0698 | 648  | 0.7392          | 0.2180  | 0.7392 | 0.8598 |
| 0.368         | 15.1163 | 650  | 0.7299          | 0.1705  | 0.7299 | 0.8543 |
| 0.368         | 15.1628 | 652  | 0.7334          | 0.0840  | 0.7334 | 0.8564 |
| 0.368         | 15.2093 | 654  | 0.7874          | 0.1449  | 0.7874 | 0.8874 |
| 0.368         | 15.2558 | 656  | 1.0108          | -0.0200 | 1.0108 | 1.0054 |
| 0.368         | 15.3023 | 658  | 1.1127          | -0.0966 | 1.1127 | 1.0548 |
| 0.368         | 15.3488 | 660  | 0.9706          | -0.0200 | 0.9706 | 0.9852 |
| 0.368         | 15.3953 | 662  | 0.7863          | 0.1675  | 0.7863 | 0.8867 |
| 0.368         | 15.4419 | 664  | 0.7695          | 0.0     | 0.7695 | 0.8772 |
| 0.368         | 15.4884 | 666  | 0.7714          | 0.0357  | 0.7714 | 0.8783 |
| 0.368         | 15.5349 | 668  | 0.7890          | 0.1612  | 0.7890 | 0.8883 |
| 0.368         | 15.5814 | 670  | 0.8148          | 0.1506  | 0.8148 | 0.9027 |
| 0.368         | 15.6279 | 672  | 0.8640          | -0.0056 | 0.8640 | 0.9295 |
| 0.368         | 15.6744 | 674  | 0.8981          | -0.0474 | 0.8981 | 0.9477 |
| 0.368         | 15.7209 | 676  | 0.8650          | 0.0095  | 0.8650 | 0.9300 |
| 0.368         | 15.7674 | 678  | 0.8304          | 0.0639  | 0.8304 | 0.9113 |
| 0.368         | 15.8140 | 680  | 0.8244          | 0.0639  | 0.8244 | 0.9080 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1