File size: 24,246 Bytes
585b523
 
 
 
 
 
e912fc7
585b523
 
 
 
 
 
e912fc7
585b523
 
 
e912fc7
 
 
 
585b523
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e912fc7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
585b523
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
---
library_name: transformers
base_model: aubmindlab/bert-base-arabertv02
tags:
- generated_from_trainer
model-index:
- name: ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k5_task5_organization
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k5_task5_organization

This model is a fine-tuned version of [aubmindlab/bert-base-arabertv02](https://huggingface.co./aubmindlab/bert-base-arabertv02) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 0.5319
- Qwk: 0.6620
- Mse: 0.5319
- Rmse: 0.7293

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100

### Training results

| Training Loss | Epoch   | Step | Validation Loss | Qwk     | Mse    | Rmse   |
|:-------------:|:-------:|:----:|:---------------:|:-------:|:------:|:------:|
| No log        | 0.1333  | 2    | 4.0121          | 0.0069  | 4.0121 | 2.0030 |
| No log        | 0.2667  | 4    | 2.1405          | 0.0450  | 2.1405 | 1.4630 |
| No log        | 0.4     | 6    | 1.4755          | 0.0408  | 1.4755 | 1.2147 |
| No log        | 0.5333  | 8    | 1.0516          | 0.2734  | 1.0516 | 1.0255 |
| No log        | 0.6667  | 10   | 1.0824          | 0.1643  | 1.0824 | 1.0404 |
| No log        | 0.8     | 12   | 1.2759          | -0.1333 | 1.2759 | 1.1295 |
| No log        | 0.9333  | 14   | 1.4281          | -0.0777 | 1.4281 | 1.1951 |
| No log        | 1.0667  | 16   | 1.5161          | -0.0709 | 1.5161 | 1.2313 |
| No log        | 1.2     | 18   | 1.2867          | -0.0394 | 1.2867 | 1.1343 |
| No log        | 1.3333  | 20   | 1.1995          | 0.0967  | 1.1995 | 1.0952 |
| No log        | 1.4667  | 22   | 1.2540          | -0.0032 | 1.2540 | 1.1198 |
| No log        | 1.6     | 24   | 1.1729          | 0.0820  | 1.1729 | 1.0830 |
| No log        | 1.7333  | 26   | 1.0244          | 0.3326  | 1.0244 | 1.0121 |
| No log        | 1.8667  | 28   | 1.0345          | 0.2697  | 1.0345 | 1.0171 |
| No log        | 2.0     | 30   | 1.0688          | 0.2236  | 1.0688 | 1.0338 |
| No log        | 2.1333  | 32   | 1.0751          | 0.2390  | 1.0751 | 1.0369 |
| No log        | 2.2667  | 34   | 1.0323          | 0.2416  | 1.0323 | 1.0160 |
| No log        | 2.4     | 36   | 1.0861          | 0.1436  | 1.0861 | 1.0422 |
| No log        | 2.5333  | 38   | 1.0908          | 0.1436  | 1.0908 | 1.0444 |
| No log        | 2.6667  | 40   | 0.9866          | 0.2416  | 0.9866 | 0.9933 |
| No log        | 2.8     | 42   | 0.9687          | 0.2265  | 0.9687 | 0.9842 |
| No log        | 2.9333  | 44   | 0.9994          | 0.3372  | 0.9994 | 0.9997 |
| No log        | 3.0667  | 46   | 1.0022          | 0.3687  | 1.0022 | 1.0011 |
| No log        | 3.2     | 48   | 1.1401          | 0.3863  | 1.1401 | 1.0678 |
| No log        | 3.3333  | 50   | 1.2943          | 0.2993  | 1.2943 | 1.1377 |
| No log        | 3.4667  | 52   | 1.1018          | 0.3502  | 1.1018 | 1.0497 |
| No log        | 3.6     | 54   | 0.8783          | 0.4494  | 0.8783 | 0.9372 |
| No log        | 3.7333  | 56   | 1.0112          | 0.3449  | 1.0112 | 1.0056 |
| No log        | 3.8667  | 58   | 1.3693          | 0.0840  | 1.3693 | 1.1702 |
| No log        | 4.0     | 60   | 1.4294          | 0.1379  | 1.4294 | 1.1956 |
| No log        | 4.1333  | 62   | 1.1873          | 0.2857  | 1.1873 | 1.0896 |
| No log        | 4.2667  | 64   | 0.8918          | 0.4265  | 0.8918 | 0.9443 |
| No log        | 4.4     | 66   | 0.7505          | 0.5010  | 0.7505 | 0.8663 |
| No log        | 4.5333  | 68   | 0.7444          | 0.5375  | 0.7444 | 0.8628 |
| No log        | 4.6667  | 70   | 0.7857          | 0.5199  | 0.7857 | 0.8864 |
| No log        | 4.8     | 72   | 0.9551          | 0.3624  | 0.9551 | 0.9773 |
| No log        | 4.9333  | 74   | 0.8291          | 0.5586  | 0.8291 | 0.9105 |
| No log        | 5.0667  | 76   | 0.7306          | 0.4850  | 0.7306 | 0.8547 |
| No log        | 5.2     | 78   | 0.8554          | 0.5230  | 0.8554 | 0.9249 |
| No log        | 5.3333  | 80   | 0.7357          | 0.5163  | 0.7357 | 0.8578 |
| No log        | 5.4667  | 82   | 0.6618          | 0.5235  | 0.6618 | 0.8135 |
| No log        | 5.6     | 84   | 0.7039          | 0.5910  | 0.7039 | 0.8390 |
| No log        | 5.7333  | 86   | 0.6963          | 0.4708  | 0.6963 | 0.8345 |
| No log        | 5.8667  | 88   | 0.6581          | 0.4995  | 0.6581 | 0.8112 |
| No log        | 6.0     | 90   | 0.7346          | 0.5598  | 0.7346 | 0.8571 |
| No log        | 6.1333  | 92   | 0.6786          | 0.5860  | 0.6786 | 0.8238 |
| No log        | 6.2667  | 94   | 0.6124          | 0.6095  | 0.6124 | 0.7826 |
| No log        | 6.4     | 96   | 0.5998          | 0.6306  | 0.5998 | 0.7745 |
| No log        | 6.5333  | 98   | 0.6586          | 0.6573  | 0.6586 | 0.8115 |
| No log        | 6.6667  | 100  | 0.6830          | 0.6395  | 0.6830 | 0.8264 |
| No log        | 6.8     | 102  | 0.6050          | 0.7001  | 0.6050 | 0.7778 |
| No log        | 6.9333  | 104  | 0.7241          | 0.5259  | 0.7241 | 0.8509 |
| No log        | 7.0667  | 106  | 1.0517          | 0.4929  | 1.0517 | 1.0255 |
| No log        | 7.2     | 108  | 0.8991          | 0.5283  | 0.8991 | 0.9482 |
| No log        | 7.3333  | 110  | 0.6204          | 0.5876  | 0.6204 | 0.7876 |
| No log        | 7.4667  | 112  | 0.6082          | 0.6695  | 0.6082 | 0.7799 |
| No log        | 7.6     | 114  | 0.5754          | 0.7074  | 0.5754 | 0.7585 |
| No log        | 7.7333  | 116  | 0.6044          | 0.6234  | 0.6044 | 0.7774 |
| No log        | 7.8667  | 118  | 0.7455          | 0.5664  | 0.7455 | 0.8634 |
| No log        | 8.0     | 120  | 0.7479          | 0.5821  | 0.7479 | 0.8648 |
| No log        | 8.1333  | 122  | 0.6144          | 0.6386  | 0.6144 | 0.7838 |
| No log        | 8.2667  | 124  | 0.6060          | 0.6345  | 0.6060 | 0.7784 |
| No log        | 8.4     | 126  | 0.6244          | 0.6237  | 0.6244 | 0.7902 |
| No log        | 8.5333  | 128  | 0.8180          | 0.5157  | 0.8180 | 0.9044 |
| No log        | 8.6667  | 130  | 0.9115          | 0.4961  | 0.9115 | 0.9547 |
| No log        | 8.8     | 132  | 0.7593          | 0.4767  | 0.7593 | 0.8714 |
| No log        | 8.9333  | 134  | 0.6838          | 0.5438  | 0.6838 | 0.8269 |
| No log        | 9.0667  | 136  | 0.6782          | 0.5327  | 0.6782 | 0.8235 |
| No log        | 9.2     | 138  | 0.8244          | 0.5804  | 0.8244 | 0.9080 |
| No log        | 9.3333  | 140  | 0.8647          | 0.5581  | 0.8647 | 0.9299 |
| No log        | 9.4667  | 142  | 0.6710          | 0.5325  | 0.6710 | 0.8191 |
| No log        | 9.6     | 144  | 0.6290          | 0.6055  | 0.6290 | 0.7931 |
| No log        | 9.7333  | 146  | 0.6244          | 0.6055  | 0.6244 | 0.7902 |
| No log        | 9.8667  | 148  | 0.6315          | 0.6234  | 0.6315 | 0.7947 |
| No log        | 10.0    | 150  | 0.7901          | 0.6057  | 0.7901 | 0.8889 |
| No log        | 10.1333 | 152  | 0.7441          | 0.6074  | 0.7441 | 0.8626 |
| No log        | 10.2667 | 154  | 0.5948          | 0.6374  | 0.5948 | 0.7712 |
| No log        | 10.4    | 156  | 0.7070          | 0.6291  | 0.7070 | 0.8408 |
| No log        | 10.5333 | 158  | 0.7442          | 0.5745  | 0.7442 | 0.8626 |
| No log        | 10.6667 | 160  | 0.6055          | 0.6605  | 0.6055 | 0.7781 |
| No log        | 10.8    | 162  | 0.6192          | 0.5794  | 0.6192 | 0.7869 |
| No log        | 10.9333 | 164  | 0.7527          | 0.5905  | 0.7527 | 0.8676 |
| No log        | 11.0667 | 166  | 0.6687          | 0.6014  | 0.6687 | 0.8177 |
| No log        | 11.2    | 168  | 0.5640          | 0.6667  | 0.5640 | 0.7510 |
| No log        | 11.3333 | 170  | 0.5807          | 0.6623  | 0.5807 | 0.7620 |
| No log        | 11.4667 | 172  | 0.5696          | 0.6335  | 0.5696 | 0.7547 |
| No log        | 11.6    | 174  | 0.5696          | 0.6750  | 0.5696 | 0.7547 |
| No log        | 11.7333 | 176  | 0.5664          | 0.6409  | 0.5664 | 0.7526 |
| No log        | 11.8667 | 178  | 0.5595          | 0.6699  | 0.5595 | 0.7480 |
| No log        | 12.0    | 180  | 0.5714          | 0.6497  | 0.5714 | 0.7559 |
| No log        | 12.1333 | 182  | 0.5717          | 0.6393  | 0.5717 | 0.7561 |
| No log        | 12.2667 | 184  | 0.5515          | 0.6374  | 0.5515 | 0.7426 |
| No log        | 12.4    | 186  | 0.5841          | 0.5865  | 0.5841 | 0.7643 |
| No log        | 12.5333 | 188  | 0.6035          | 0.6050  | 0.6035 | 0.7769 |
| No log        | 12.6667 | 190  | 0.5787          | 0.5926  | 0.5787 | 0.7607 |
| No log        | 12.8    | 192  | 0.5802          | 0.6051  | 0.5802 | 0.7617 |
| No log        | 12.9333 | 194  | 0.5536          | 0.6460  | 0.5536 | 0.7440 |
| No log        | 13.0667 | 196  | 0.5157          | 0.7409  | 0.5157 | 0.7181 |
| No log        | 13.2    | 198  | 0.5539          | 0.6485  | 0.5539 | 0.7442 |
| No log        | 13.3333 | 200  | 0.4963          | 0.7165  | 0.4963 | 0.7045 |
| No log        | 13.4667 | 202  | 0.4672          | 0.7110  | 0.4672 | 0.6835 |
| No log        | 13.6    | 204  | 0.4704          | 0.7158  | 0.4704 | 0.6859 |
| No log        | 13.7333 | 206  | 0.4760          | 0.6748  | 0.4760 | 0.6899 |
| No log        | 13.8667 | 208  | 0.5319          | 0.6572  | 0.5319 | 0.7293 |
| No log        | 14.0    | 210  | 0.5973          | 0.5873  | 0.5973 | 0.7729 |
| No log        | 14.1333 | 212  | 0.5754          | 0.6302  | 0.5754 | 0.7586 |
| No log        | 14.2667 | 214  | 0.5846          | 0.6322  | 0.5846 | 0.7646 |
| No log        | 14.4    | 216  | 0.6027          | 0.6435  | 0.6027 | 0.7764 |
| No log        | 14.5333 | 218  | 0.5950          | 0.5759  | 0.5950 | 0.7714 |
| No log        | 14.6667 | 220  | 0.6926          | 0.5598  | 0.6926 | 0.8323 |
| No log        | 14.8    | 222  | 0.7060          | 0.5590  | 0.7060 | 0.8402 |
| No log        | 14.9333 | 224  | 0.6087          | 0.5876  | 0.6087 | 0.7802 |
| No log        | 15.0667 | 226  | 0.5902          | 0.5817  | 0.5902 | 0.7683 |
| No log        | 15.2    | 228  | 0.5766          | 0.6207  | 0.5766 | 0.7593 |
| No log        | 15.3333 | 230  | 0.5803          | 0.6018  | 0.5803 | 0.7618 |
| No log        | 15.4667 | 232  | 0.6179          | 0.6125  | 0.6179 | 0.7861 |
| No log        | 15.6    | 234  | 0.7473          | 0.5257  | 0.7473 | 0.8645 |
| No log        | 15.7333 | 236  | 0.7555          | 0.5039  | 0.7555 | 0.8692 |
| No log        | 15.8667 | 238  | 0.8393          | 0.4826  | 0.8393 | 0.9161 |
| No log        | 16.0    | 240  | 1.0294          | 0.4228  | 1.0294 | 1.0146 |
| No log        | 16.1333 | 242  | 0.9448          | 0.3973  | 0.9448 | 0.9720 |
| No log        | 16.2667 | 244  | 0.6934          | 0.5138  | 0.6934 | 0.8327 |
| No log        | 16.4    | 246  | 0.6082          | 0.6057  | 0.6082 | 0.7799 |
| No log        | 16.5333 | 248  | 0.5950          | 0.5735  | 0.5950 | 0.7713 |
| No log        | 16.6667 | 250  | 0.5974          | 0.5373  | 0.5974 | 0.7729 |
| No log        | 16.8    | 252  | 0.6038          | 0.5886  | 0.6038 | 0.7770 |
| No log        | 16.9333 | 254  | 0.6004          | 0.6187  | 0.6004 | 0.7749 |
| No log        | 17.0667 | 256  | 0.6427          | 0.6090  | 0.6427 | 0.8017 |
| No log        | 17.2    | 258  | 0.6524          | 0.5970  | 0.6524 | 0.8077 |
| No log        | 17.3333 | 260  | 0.6206          | 0.6499  | 0.6206 | 0.7878 |
| No log        | 17.4667 | 262  | 0.6026          | 0.6435  | 0.6026 | 0.7763 |
| No log        | 17.6    | 264  | 0.6124          | 0.6076  | 0.6124 | 0.7825 |
| No log        | 17.7333 | 266  | 0.6104          | 0.5690  | 0.6104 | 0.7813 |
| No log        | 17.8667 | 268  | 0.6023          | 0.6105  | 0.6023 | 0.7761 |
| No log        | 18.0    | 270  | 0.5935          | 0.6549  | 0.5935 | 0.7704 |
| No log        | 18.1333 | 272  | 0.6049          | 0.6415  | 0.6049 | 0.7778 |
| No log        | 18.2667 | 274  | 0.6007          | 0.6301  | 0.6007 | 0.7751 |
| No log        | 18.4    | 276  | 0.5746          | 0.5978  | 0.5746 | 0.7580 |
| No log        | 18.5333 | 278  | 0.5538          | 0.5921  | 0.5538 | 0.7442 |
| No log        | 18.6667 | 280  | 0.5377          | 0.6228  | 0.5377 | 0.7333 |
| No log        | 18.8    | 282  | 0.5058          | 0.6857  | 0.5058 | 0.7112 |
| No log        | 18.9333 | 284  | 0.5029          | 0.6962  | 0.5029 | 0.7091 |
| No log        | 19.0667 | 286  | 0.4965          | 0.6962  | 0.4965 | 0.7046 |
| No log        | 19.2    | 288  | 0.4966          | 0.6962  | 0.4966 | 0.7047 |
| No log        | 19.3333 | 290  | 0.5004          | 0.7001  | 0.5004 | 0.7074 |
| No log        | 19.4667 | 292  | 0.5033          | 0.7001  | 0.5033 | 0.7094 |
| No log        | 19.6    | 294  | 0.5183          | 0.6993  | 0.5183 | 0.7200 |
| No log        | 19.7333 | 296  | 0.5118          | 0.7001  | 0.5118 | 0.7154 |
| No log        | 19.8667 | 298  | 0.5325          | 0.6383  | 0.5325 | 0.7297 |
| No log        | 20.0    | 300  | 0.5527          | 0.6248  | 0.5527 | 0.7434 |
| No log        | 20.1333 | 302  | 0.5250          | 0.6374  | 0.5250 | 0.7246 |
| No log        | 20.2667 | 304  | 0.5470          | 0.6807  | 0.5470 | 0.7396 |
| No log        | 20.4    | 306  | 0.5785          | 0.6807  | 0.5785 | 0.7606 |
| No log        | 20.5333 | 308  | 0.5470          | 0.6815  | 0.5470 | 0.7396 |
| No log        | 20.6667 | 310  | 0.5703          | 0.5831  | 0.5703 | 0.7552 |
| No log        | 20.8    | 312  | 0.6233          | 0.5699  | 0.6233 | 0.7895 |
| No log        | 20.9333 | 314  | 0.6063          | 0.6092  | 0.6063 | 0.7787 |
| No log        | 21.0667 | 316  | 0.5146          | 0.6838  | 0.5146 | 0.7174 |
| No log        | 21.2    | 318  | 0.4926          | 0.7164  | 0.4926 | 0.7019 |
| No log        | 21.3333 | 320  | 0.6147          | 0.6300  | 0.6147 | 0.7840 |
| No log        | 21.4667 | 322  | 0.6386          | 0.5835  | 0.6386 | 0.7992 |
| No log        | 21.6    | 324  | 0.5804          | 0.6654  | 0.5804 | 0.7619 |
| No log        | 21.7333 | 326  | 0.5391          | 0.5666  | 0.5391 | 0.7342 |
| No log        | 21.8667 | 328  | 0.5396          | 0.5704  | 0.5396 | 0.7346 |
| No log        | 22.0    | 330  | 0.5383          | 0.6129  | 0.5383 | 0.7337 |
| No log        | 22.1333 | 332  | 0.5272          | 0.6390  | 0.5272 | 0.7261 |
| No log        | 22.2667 | 334  | 0.5411          | 0.6588  | 0.5411 | 0.7356 |
| No log        | 22.4    | 336  | 0.6175          | 0.6295  | 0.6175 | 0.7858 |
| No log        | 22.5333 | 338  | 0.6316          | 0.6101  | 0.6316 | 0.7947 |
| No log        | 22.6667 | 340  | 0.6025          | 0.6051  | 0.6025 | 0.7762 |
| No log        | 22.8    | 342  | 0.5840          | 0.6407  | 0.5840 | 0.7642 |
| No log        | 22.9333 | 344  | 0.5864          | 0.5188  | 0.5864 | 0.7657 |
| No log        | 23.0667 | 346  | 0.5979          | 0.5568  | 0.5979 | 0.7732 |
| No log        | 23.2    | 348  | 0.5749          | 0.5301  | 0.5749 | 0.7583 |
| No log        | 23.3333 | 350  | 0.5665          | 0.6407  | 0.5665 | 0.7527 |
| No log        | 23.4667 | 352  | 0.5613          | 0.5845  | 0.5613 | 0.7492 |
| No log        | 23.6    | 354  | 0.6211          | 0.5977  | 0.6211 | 0.7881 |
| No log        | 23.7333 | 356  | 0.7599          | 0.5491  | 0.7599 | 0.8717 |
| No log        | 23.8667 | 358  | 0.7348          | 0.5495  | 0.7348 | 0.8572 |
| No log        | 24.0    | 360  | 0.6497          | 0.5782  | 0.6497 | 0.8060 |
| No log        | 24.1333 | 362  | 0.5732          | 0.5669  | 0.5732 | 0.7571 |
| No log        | 24.2667 | 364  | 0.5905          | 0.6122  | 0.5905 | 0.7684 |
| No log        | 24.4    | 366  | 0.6120          | 0.6021  | 0.6120 | 0.7823 |
| No log        | 24.5333 | 368  | 0.5852          | 0.6241  | 0.5852 | 0.7650 |
| No log        | 24.6667 | 370  | 0.5725          | 0.6518  | 0.5725 | 0.7566 |
| No log        | 24.8    | 372  | 0.5717          | 0.6241  | 0.5717 | 0.7561 |
| No log        | 24.9333 | 374  | 0.5861          | 0.5763  | 0.5861 | 0.7656 |
| No log        | 25.0667 | 376  | 0.5692          | 0.5986  | 0.5692 | 0.7544 |
| No log        | 25.2    | 378  | 0.5601          | 0.6241  | 0.5601 | 0.7484 |
| No log        | 25.3333 | 380  | 0.5625          | 0.6688  | 0.5625 | 0.7500 |
| No log        | 25.4667 | 382  | 0.5724          | 0.6499  | 0.5724 | 0.7566 |
| No log        | 25.6    | 384  | 0.5883          | 0.6377  | 0.5883 | 0.7670 |
| No log        | 25.7333 | 386  | 0.6158          | 0.6244  | 0.6158 | 0.7847 |
| No log        | 25.8667 | 388  | 0.6442          | 0.6244  | 0.6442 | 0.8026 |
| No log        | 26.0    | 390  | 0.6119          | 0.6244  | 0.6119 | 0.7823 |
| No log        | 26.1333 | 392  | 0.5540          | 0.6460  | 0.5540 | 0.7443 |
| No log        | 26.2667 | 394  | 0.5267          | 0.6230  | 0.5267 | 0.7257 |
| No log        | 26.4    | 396  | 0.5248          | 0.6787  | 0.5248 | 0.7244 |
| No log        | 26.5333 | 398  | 0.5055          | 0.6978  | 0.5055 | 0.7110 |
| No log        | 26.6667 | 400  | 0.5111          | 0.6479  | 0.5111 | 0.7149 |
| No log        | 26.8    | 402  | 0.5614          | 0.6646  | 0.5614 | 0.7493 |
| No log        | 26.9333 | 404  | 0.5711          | 0.6916  | 0.5711 | 0.7557 |
| No log        | 27.0667 | 406  | 0.5579          | 0.6902  | 0.5579 | 0.7469 |
| No log        | 27.2    | 408  | 0.5467          | 0.6161  | 0.5467 | 0.7394 |
| No log        | 27.3333 | 410  | 0.5475          | 0.6276  | 0.5475 | 0.7399 |
| No log        | 27.4667 | 412  | 0.5345          | 0.6139  | 0.5345 | 0.7311 |
| No log        | 27.6    | 414  | 0.5085          | 0.6950  | 0.5085 | 0.7131 |
| No log        | 27.7333 | 416  | 0.5218          | 0.7051  | 0.5218 | 0.7224 |
| No log        | 27.8667 | 418  | 0.5390          | 0.7051  | 0.5390 | 0.7342 |
| No log        | 28.0    | 420  | 0.5683          | 0.6539  | 0.5683 | 0.7538 |
| No log        | 28.1333 | 422  | 0.5992          | 0.6415  | 0.5992 | 0.7741 |
| No log        | 28.2667 | 424  | 0.6020          | 0.6210  | 0.6020 | 0.7759 |
| No log        | 28.4    | 426  | 0.6044          | 0.6444  | 0.6044 | 0.7774 |
| No log        | 28.5333 | 428  | 0.6084          | 0.6394  | 0.6084 | 0.7800 |
| No log        | 28.6667 | 430  | 0.5814          | 0.6601  | 0.5814 | 0.7625 |
| No log        | 28.8    | 432  | 0.5689          | 0.6601  | 0.5689 | 0.7543 |
| No log        | 28.9333 | 434  | 0.5527          | 0.6620  | 0.5527 | 0.7435 |
| No log        | 29.0667 | 436  | 0.5604          | 0.6302  | 0.5604 | 0.7486 |
| No log        | 29.2    | 438  | 0.5787          | 0.5359  | 0.5787 | 0.7607 |
| No log        | 29.3333 | 440  | 0.5624          | 0.6067  | 0.5624 | 0.7500 |
| No log        | 29.4667 | 442  | 0.5443          | 0.6508  | 0.5443 | 0.7378 |
| No log        | 29.6    | 444  | 0.5581          | 0.6620  | 0.5581 | 0.7471 |
| No log        | 29.7333 | 446  | 0.5841          | 0.6394  | 0.5841 | 0.7643 |
| No log        | 29.8667 | 448  | 0.6036          | 0.6394  | 0.6036 | 0.7769 |
| No log        | 30.0    | 450  | 0.5883          | 0.6769  | 0.5883 | 0.7670 |
| No log        | 30.1333 | 452  | 0.5650          | 0.6243  | 0.5650 | 0.7517 |
| No log        | 30.2667 | 454  | 0.5431          | 0.6343  | 0.5431 | 0.7369 |
| No log        | 30.4    | 456  | 0.5365          | 0.6685  | 0.5365 | 0.7325 |
| No log        | 30.5333 | 458  | 0.5069          | 0.6442  | 0.5069 | 0.7119 |
| No log        | 30.6667 | 460  | 0.5036          | 0.6712  | 0.5036 | 0.7096 |
| No log        | 30.8    | 462  | 0.5081          | 0.6880  | 0.5081 | 0.7128 |
| No log        | 30.9333 | 464  | 0.5110          | 0.6649  | 0.5110 | 0.7149 |
| No log        | 31.0667 | 466  | 0.5487          | 0.6334  | 0.5487 | 0.7408 |
| No log        | 31.2    | 468  | 0.5944          | 0.6308  | 0.5944 | 0.7710 |
| No log        | 31.3333 | 470  | 0.6059          | 0.5913  | 0.6059 | 0.7784 |
| No log        | 31.4667 | 472  | 0.5750          | 0.6292  | 0.5750 | 0.7583 |
| No log        | 31.6    | 474  | 0.5660          | 0.6681  | 0.5660 | 0.7524 |
| No log        | 31.7333 | 476  | 0.5597          | 0.6354  | 0.5597 | 0.7481 |
| No log        | 31.8667 | 478  | 0.5518          | 0.6479  | 0.5518 | 0.7428 |
| No log        | 32.0    | 480  | 0.5442          | 0.6535  | 0.5442 | 0.7377 |
| No log        | 32.1333 | 482  | 0.5363          | 0.6215  | 0.5363 | 0.7323 |
| No log        | 32.2667 | 484  | 0.5282          | 0.6575  | 0.5282 | 0.7268 |
| No log        | 32.4    | 486  | 0.5314          | 0.7009  | 0.5314 | 0.7290 |
| No log        | 32.5333 | 488  | 0.5594          | 0.7035  | 0.5594 | 0.7479 |
| No log        | 32.6667 | 490  | 0.6227          | 0.5981  | 0.6227 | 0.7891 |
| No log        | 32.8    | 492  | 0.6521          | 0.5860  | 0.6521 | 0.8075 |
| No log        | 32.9333 | 494  | 0.6376          | 0.5860  | 0.6376 | 0.7985 |
| No log        | 33.0667 | 496  | 0.6016          | 0.6009  | 0.6016 | 0.7756 |
| No log        | 33.2    | 498  | 0.5645          | 0.7035  | 0.5645 | 0.7513 |
| 0.268         | 33.3333 | 500  | 0.5431          | 0.6903  | 0.5431 | 0.7369 |
| 0.268         | 33.4667 | 502  | 0.5382          | 0.6575  | 0.5382 | 0.7336 |
| 0.268         | 33.6    | 504  | 0.5327          | 0.6903  | 0.5327 | 0.7299 |
| 0.268         | 33.7333 | 506  | 0.5355          | 0.7043  | 0.5355 | 0.7318 |
| 0.268         | 33.8667 | 508  | 0.5549          | 0.7035  | 0.5549 | 0.7449 |
| 0.268         | 34.0    | 510  | 0.5987          | 0.6520  | 0.5987 | 0.7738 |
| 0.268         | 34.1333 | 512  | 0.5974          | 0.6691  | 0.5974 | 0.7729 |
| 0.268         | 34.2667 | 514  | 0.5568          | 0.6985  | 0.5568 | 0.7462 |
| 0.268         | 34.4    | 516  | 0.5250          | 0.6824  | 0.5250 | 0.7246 |
| 0.268         | 34.5333 | 518  | 0.5154          | 0.6380  | 0.5154 | 0.7179 |
| 0.268         | 34.6667 | 520  | 0.5138          | 0.6488  | 0.5138 | 0.7168 |
| 0.268         | 34.8    | 522  | 0.5250          | 0.7101  | 0.5250 | 0.7246 |
| 0.268         | 34.9333 | 524  | 0.5509          | 0.7157  | 0.5509 | 0.7422 |
| 0.268         | 35.0667 | 526  | 0.5415          | 0.7101  | 0.5415 | 0.7359 |
| 0.268         | 35.2    | 528  | 0.5170          | 0.6993  | 0.5170 | 0.7190 |
| 0.268         | 35.3333 | 530  | 0.5086          | 0.6911  | 0.5086 | 0.7132 |
| 0.268         | 35.4667 | 532  | 0.5172          | 0.6675  | 0.5172 | 0.7192 |
| 0.268         | 35.6    | 534  | 0.5092          | 0.6675  | 0.5092 | 0.7136 |
| 0.268         | 35.7333 | 536  | 0.4906          | 0.6770  | 0.4906 | 0.7004 |
| 0.268         | 35.8667 | 538  | 0.4885          | 0.6962  | 0.4885 | 0.6989 |
| 0.268         | 36.0    | 540  | 0.5149          | 0.6993  | 0.5149 | 0.7176 |
| 0.268         | 36.1333 | 542  | 0.5228          | 0.6993  | 0.5228 | 0.7230 |
| 0.268         | 36.2667 | 544  | 0.5029          | 0.7171  | 0.5029 | 0.7092 |
| 0.268         | 36.4    | 546  | 0.5031          | 0.6681  | 0.5031 | 0.7093 |
| 0.268         | 36.5333 | 548  | 0.5101          | 0.6911  | 0.5101 | 0.7142 |
| 0.268         | 36.6667 | 550  | 0.4975          | 0.7186  | 0.4975 | 0.7053 |
| 0.268         | 36.8    | 552  | 0.4923          | 0.7082  | 0.4923 | 0.7017 |
| 0.268         | 36.9333 | 554  | 0.5038          | 0.6778  | 0.5038 | 0.7098 |
| 0.268         | 37.0667 | 556  | 0.5383          | 0.6828  | 0.5383 | 0.7337 |
| 0.268         | 37.2    | 558  | 0.5528          | 0.6707  | 0.5528 | 0.7435 |
| 0.268         | 37.3333 | 560  | 0.5621          | 0.6648  | 0.5621 | 0.7497 |
| 0.268         | 37.4667 | 562  | 0.5319          | 0.6620  | 0.5319 | 0.7293 |


### Framework versions

- Transformers 4.44.2
- Pytorch 2.4.0+cu118
- Datasets 2.21.0
- Tokenizers 0.19.1