File size: 36,727 Bytes
d6c92a7
 
 
 
 
2e3e15b
 
d6c92a7
 
 
 
 
 
 
 
 
 
 
2e3e15b
d6c92a7
 
 
 
 
f04744e
 
 
 
 
d6c92a7
f04744e
 
d6c92a7
 
 
 
 
 
 
 
f04744e
 
 
d6c92a7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
f04744e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d6c92a7
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---
library_name: transformers
license: apache-2.0
base_model: facebook/detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: detr-finetuned-cppe-5-10k-steps
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# detr-finetuned-cppe-5-10k-steps

This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co./facebook/detr-resnet-50) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.2683
- Map: 0.2876
- Map 50: 0.548
- Map 75: 0.268
- Map Coverall: 0.5615
- Map Face Shield: 0.2396
- Map Gloves: 0.2085
- Map Goggles: 0.1386
- Map Mask: 0.2901
- Map Large: 0.4466
- Map Medium: 0.2337
- Map Small: 0.0849
- Mar 1: 0.2822
- Mar 10: 0.4586
- Mar 100: 0.471
- Mar 100 Coverall: 0.6995
- Mar 100 Face Shield: 0.5013
- Mar 100 Gloves: 0.3946
- Mar 100 Goggles: 0.3754
- Mar 100 Mask: 0.384
- Mar Large: 0.6399
- Mar Medium: 0.4132
- Mar Small: 0.2103

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 1337
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Coverall | Map Face Shield | Map Gloves | Map Goggles | Map Mask | Map Large | Map Medium | Map Small | Mar 1  | Mar 10 | Mar 100 | Mar 100 Coverall | Mar 100 Face Shield | Mar 100 Gloves | Mar 100 Goggles | Mar 100 Mask | Mar Large | Mar Medium | Mar Small |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:------------:|:---------------:|:----------:|:-----------:|:--------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:----------------:|:-------------------:|:--------------:|:---------------:|:------------:|:---------:|:----------:|:---------:|
| 2.5588        | 1.0   | 107   | 2.5836          | 0.0189 | 0.0371 | 0.017  | 0.0728       | 0.0             | 0.0017     | 0.0         | 0.0201   | 0.0198    | 0.0199     | 0.004     | 0.045  | 0.0925 | 0.1133  | 0.2428           | 0.0                 | 0.1125         | 0.0             | 0.2111       | 0.1708    | 0.0911     | 0.0268    |
| 2.2402        | 2.0   | 214   | 2.7766          | 0.0381 | 0.0854 | 0.0301 | 0.1538       | 0.0             | 0.0027     | 0.0         | 0.0338   | 0.0476    | 0.0275     | 0.0078    | 0.0705 | 0.1321 | 0.1381  | 0.4532           | 0.0                 | 0.0576         | 0.0             | 0.1796       | 0.1649    | 0.0957     | 0.0334    |
| 2.1058        | 3.0   | 321   | 2.1333          | 0.0441 | 0.106  | 0.0342 | 0.1568       | 0.0             | 0.0175     | 0.0         | 0.0464   | 0.0512    | 0.0314     | 0.0193    | 0.076  | 0.1619 | 0.1837  | 0.5527           | 0.0                 | 0.1621         | 0.0             | 0.2036       | 0.2292    | 0.1393     | 0.0466    |
| 1.8196        | 4.0   | 428   | 2.0629          | 0.051  | 0.1266 | 0.0344 | 0.1591       | 0.0             | 0.0068     | 0.0007      | 0.0883   | 0.065     | 0.0424     | 0.0161    | 0.0825 | 0.162  | 0.189   | 0.5351           | 0.0                 | 0.1576         | 0.0046          | 0.2476       | 0.2274    | 0.1422     | 0.06      |
| 1.7891        | 5.0   | 535   | 2.0399          | 0.0539 | 0.1328 | 0.0344 | 0.1232       | 0.0003          | 0.0279     | 0.0012      | 0.1167   | 0.0796    | 0.0677     | 0.0243    | 0.071  | 0.1731 | 0.2076  | 0.5383           | 0.0025              | 0.2254         | 0.0292          | 0.2427       | 0.2783    | 0.1554     | 0.0689    |
| 1.7706        | 6.0   | 642   | 1.8604          | 0.0952 | 0.222  | 0.0713 | 0.3453       | 0.002           | 0.0296     | 0.0008      | 0.0983   | 0.107     | 0.0771     | 0.029     | 0.1126 | 0.2069 | 0.2277  | 0.6108           | 0.0405              | 0.1924         | 0.0892          | 0.2058       | 0.3101    | 0.1681     | 0.0683    |
| 1.6854        | 7.0   | 749   | 1.8219          | 0.1078 | 0.2395 | 0.0842 | 0.3538       | 0.0165          | 0.0316     | 0.0084      | 0.1289   | 0.1379    | 0.0985     | 0.0377    | 0.1338 | 0.2557 | 0.2776  | 0.5527           | 0.1203              | 0.2491         | 0.1677          | 0.2982       | 0.3665    | 0.2327     | 0.1161    |
| 1.5801        | 8.0   | 856   | 1.7859          | 0.1217 | 0.2614 | 0.1017 | 0.4204       | 0.0264          | 0.0411     | 0.0024      | 0.1184   | 0.1512    | 0.0877     | 0.0184    | 0.1429 | 0.2905 | 0.3167  | 0.6414           | 0.3089              | 0.2567         | 0.1015          | 0.2751       | 0.4161    | 0.2536     | 0.0875    |
| 1.5666        | 9.0   | 963   | 1.7921          | 0.1176 | 0.2803 | 0.0871 | 0.3524       | 0.0458          | 0.0532     | 0.0066      | 0.13     | 0.1568    | 0.1007     | 0.0249    | 0.1566 | 0.2935 | 0.3133  | 0.5626           | 0.2785              | 0.2835         | 0.1862          | 0.2556       | 0.4029    | 0.2667     | 0.1035    |
| 1.5349        | 10.0  | 1070  | 1.7596          | 0.1323 | 0.2877 | 0.1122 | 0.4035       | 0.0477          | 0.0512     | 0.0115      | 0.1479   | 0.2039    | 0.0962     | 0.0298    | 0.1723 | 0.3053 | 0.3315  | 0.5811           | 0.2975              | 0.2857         | 0.2108          | 0.2827       | 0.4874    | 0.26       | 0.0993    |
| 1.5319        | 11.0  | 1177  | 1.8014          | 0.1077 | 0.2538 | 0.0798 | 0.3197       | 0.0526          | 0.0417     | 0.006       | 0.1183   | 0.1372    | 0.0797     | 0.0359    | 0.1409 | 0.271  | 0.291   | 0.5347           | 0.2468              | 0.2482         | 0.1477          | 0.2773       | 0.3782    | 0.2435     | 0.1001    |
| 1.5349        | 12.0  | 1284  | 1.7285          | 0.1314 | 0.3    | 0.0875 | 0.3845       | 0.0591          | 0.0477     | 0.0095      | 0.156    | 0.1712    | 0.1022     | 0.0687    | 0.1497 | 0.2993 | 0.3162  | 0.5545           | 0.3177              | 0.2629         | 0.1538          | 0.292        | 0.4104    | 0.2602     | 0.1458    |
| 1.6402        | 13.0  | 1391  | 1.7097          | 0.1283 | 0.2851 | 0.0997 | 0.3808       | 0.0348          | 0.0565     | 0.0109      | 0.1587   | 0.1878    | 0.0979     | 0.0372    | 0.1636 | 0.3236 | 0.3445  | 0.5842           | 0.2899              | 0.2973         | 0.2615          | 0.2898       | 0.4481    | 0.2919     | 0.1307    |
| 1.5345        | 14.0  | 1498  | 1.7460          | 0.13   | 0.2783 | 0.1091 | 0.3747       | 0.0664          | 0.0602     | 0.0213      | 0.1276   | 0.1994    | 0.0909     | 0.0476    | 0.1856 | 0.3292 | 0.3538  | 0.5595           | 0.4038              | 0.2839         | 0.2538          | 0.268        | 0.4851    | 0.2861     | 0.1474    |
| 1.4773        | 15.0  | 1605  | 1.6503          | 0.152  | 0.3114 | 0.1354 | 0.4279       | 0.07            | 0.0538     | 0.016       | 0.1922   | 0.222     | 0.1119     | 0.0422    | 0.2026 | 0.3373 | 0.3607  | 0.6185           | 0.3506              | 0.2576         | 0.2431          | 0.3338       | 0.5023    | 0.2948     | 0.1211    |
| 1.4822        | 16.0  | 1712  | 1.6648          | 0.1429 | 0.304  | 0.1187 | 0.4522       | 0.0567          | 0.0463     | 0.0083      | 0.1512   | 0.2121    | 0.1058     | 0.0414    | 0.1637 | 0.3194 | 0.3386  | 0.641            | 0.3456              | 0.2411         | 0.1815          | 0.284        | 0.4395    | 0.2802     | 0.1365    |
| 1.4557        | 17.0  | 1819  | 1.6038          | 0.1592 | 0.3358 | 0.1331 | 0.4363       | 0.0785          | 0.0755     | 0.0167      | 0.1888   | 0.2358    | 0.1184     | 0.0566    | 0.191  | 0.3525 | 0.3758  | 0.6396           | 0.343               | 0.3129         | 0.2477          | 0.3356       | 0.5437    | 0.2989     | 0.1301    |
| 1.4644        | 18.0  | 1926  | 1.5534          | 0.1588 | 0.3444 | 0.1257 | 0.4351       | 0.0745          | 0.0715     | 0.0269      | 0.1859   | 0.2247    | 0.1262     | 0.0442    | 0.197  | 0.3433 | 0.3615  | 0.6387           | 0.3443              | 0.2964         | 0.22            | 0.308        | 0.4799    | 0.2992     | 0.1397    |
| 1.3847        | 19.0  | 2033  | 1.5755          | 0.1583 | 0.3576 | 0.1261 | 0.4503       | 0.0837          | 0.0715     | 0.0187      | 0.1675   | 0.2379    | 0.1209     | 0.0607    | 0.1929 | 0.354  | 0.3715  | 0.6356           | 0.3544              | 0.3121         | 0.2492          | 0.3062       | 0.4949    | 0.3157     | 0.1753    |
| 1.4198        | 20.0  | 2140  | 1.7037          | 0.1494 | 0.3249 | 0.1212 | 0.4156       | 0.0408          | 0.0673     | 0.0314      | 0.1921   | 0.2208    | 0.1153     | 0.0494    | 0.1936 | 0.3216 | 0.3395  | 0.6095           | 0.2924              | 0.2629         | 0.2292          | 0.3036       | 0.4689    | 0.2765     | 0.1058    |
| 1.3866        | 21.0  | 2247  | 1.5504          | 0.1694 | 0.3681 | 0.1379 | 0.4553       | 0.0792          | 0.0844     | 0.0318      | 0.196    | 0.2608    | 0.1283     | 0.0575    | 0.2032 | 0.3554 | 0.371   | 0.6365           | 0.3342              | 0.3196         | 0.2523          | 0.3124       | 0.5051    | 0.3138     | 0.1409    |
| 1.3592        | 22.0  | 2354  | 1.5890          | 0.1604 | 0.3461 | 0.1333 | 0.4449       | 0.0731          | 0.0836     | 0.0173      | 0.183    | 0.2533    | 0.1223     | 0.0404    | 0.1985 | 0.3634 | 0.3789  | 0.6324           | 0.357               | 0.3254         | 0.2785          | 0.3013       | 0.5302    | 0.3158     | 0.1263    |
| 1.3602        | 23.0  | 2461  | 1.6250          | 0.1629 | 0.3567 | 0.1342 | 0.4446       | 0.0775          | 0.0669     | 0.0233      | 0.2023   | 0.2478    | 0.1267     | 0.043     | 0.1933 | 0.3375 | 0.3551  | 0.6167           | 0.3354              | 0.2777         | 0.2415          | 0.304        | 0.4965    | 0.2959     | 0.094     |
| 1.3773        | 24.0  | 2568  | 1.5816          | 0.1766 | 0.3699 | 0.1473 | 0.4844       | 0.0793          | 0.0792     | 0.026       | 0.2142   | 0.2542    | 0.1417     | 0.0498    | 0.1935 | 0.3434 | 0.3658  | 0.6482           | 0.3177              | 0.3219         | 0.2292          | 0.312        | 0.4903    | 0.3218     | 0.1367    |
| 1.3918        | 25.0  | 2675  | 1.5896          | 0.1545 | 0.3315 | 0.1288 | 0.4496       | 0.0587          | 0.0753     | 0.0218      | 0.1673   | 0.2443    | 0.1112     | 0.0442    | 0.1822 | 0.347  | 0.3684  | 0.6203           | 0.3772              | 0.2996         | 0.2538          | 0.2911       | 0.49      | 0.3188     | 0.1396    |
| 1.3254        | 26.0  | 2782  | 1.5416          | 0.1723 | 0.3638 | 0.1517 | 0.4706       | 0.0722          | 0.0743     | 0.0394      | 0.2052   | 0.2513    | 0.1429     | 0.0496    | 0.1992 | 0.3594 | 0.3776  | 0.6333           | 0.3747              | 0.3121         | 0.2585          | 0.3093       | 0.5114    | 0.319      | 0.1536    |
| 1.3393        | 27.0  | 2889  | 1.4658          | 0.184  | 0.3695 | 0.1653 | 0.4922       | 0.0744          | 0.0949     | 0.0226      | 0.2356   | 0.297     | 0.1286     | 0.0564    | 0.2007 | 0.3848 | 0.4005  | 0.6383           | 0.3861              | 0.3103         | 0.3308          | 0.3373       | 0.5409    | 0.3371     | 0.1833    |
| 1.2816        | 28.0  | 2996  | 1.5467          | 0.1792 | 0.3764 | 0.1497 | 0.4785       | 0.0672          | 0.0855     | 0.0317      | 0.2331   | 0.265     | 0.1387     | 0.0474    | 0.2154 | 0.3713 | 0.3842  | 0.6351           | 0.362               | 0.3085         | 0.2738          | 0.3413       | 0.5269    | 0.321      | 0.1462    |
| 1.298         | 29.0  | 3103  | 1.4971          | 0.1777 | 0.3909 | 0.1386 | 0.482        | 0.0694          | 0.0983     | 0.0289      | 0.21     | 0.2805    | 0.134      | 0.0686    | 0.2097 | 0.3774 | 0.3919  | 0.6541           | 0.3532              | 0.3201         | 0.2908          | 0.3413       | 0.5229    | 0.3339     | 0.1733    |
| 1.3079        | 30.0  | 3210  | 1.5049          | 0.1741 | 0.3718 | 0.1437 | 0.4674       | 0.071           | 0.0998     | 0.0228      | 0.2097   | 0.2751    | 0.1147     | 0.0593    | 0.2156 | 0.3669 | 0.383   | 0.6279           | 0.319               | 0.3259         | 0.3015          | 0.3404       | 0.5281    | 0.2951     | 0.1667    |
| 1.2494        | 31.0  | 3317  | 1.4427          | 0.1919 | 0.4041 | 0.1543 | 0.4876       | 0.0968          | 0.1214     | 0.0282      | 0.2253   | 0.3002    | 0.1385     | 0.0653    | 0.2212 | 0.382  | 0.3987  | 0.6419           | 0.3937              | 0.3634         | 0.2738          | 0.3209       | 0.5467    | 0.3201     | 0.1964    |
| 1.2191        | 32.0  | 3424  | 1.4607          | 0.182  | 0.3715 | 0.1605 | 0.48         | 0.0694          | 0.1278     | 0.0247      | 0.2083   | 0.304     | 0.1289     | 0.0594    | 0.2245 | 0.3891 | 0.4068  | 0.6279           | 0.3873              | 0.3424         | 0.3508          | 0.3253       | 0.5578    | 0.3428     | 0.1695    |
| 1.2032        | 33.0  | 3531  | 1.4382          | 0.2014 | 0.4103 | 0.1757 | 0.4792       | 0.1109          | 0.1354     | 0.0283      | 0.2534   | 0.3126    | 0.1516     | 0.0608    | 0.2291 | 0.3929 | 0.4089  | 0.6324           | 0.3949              | 0.3576         | 0.3123          | 0.3471       | 0.5595    | 0.3468     | 0.1781    |
| 1.2524        | 34.0  | 3638  | 1.5703          | 0.1823 | 0.3973 | 0.1353 | 0.4378       | 0.0926          | 0.12       | 0.0292      | 0.2316   | 0.2772    | 0.1383     | 0.0732    | 0.2236 | 0.3887 | 0.4039  | 0.6086           | 0.4165              | 0.3348         | 0.3185          | 0.3413       | 0.5526    | 0.3554     | 0.1525    |
| 1.242         | 35.0  | 3745  | 1.5388          | 0.1906 | 0.4011 | 0.1575 | 0.4706       | 0.0915          | 0.1242     | 0.039       | 0.2278   | 0.3073    | 0.1399     | 0.0547    | 0.2317 | 0.3938 | 0.4173  | 0.6144           | 0.4038              | 0.329          | 0.3969          | 0.3422       | 0.574     | 0.3629     | 0.1648    |
| 1.229         | 36.0  | 3852  | 1.4810          | 0.1744 | 0.3838 | 0.1452 | 0.4299       | 0.0909          | 0.118      | 0.0195      | 0.2136   | 0.2838    | 0.1259     | 0.0516    | 0.2159 | 0.3755 | 0.3965  | 0.5802           | 0.4177              | 0.3424         | 0.3215          | 0.3204       | 0.5457    | 0.3359     | 0.1789    |
| 1.2041        | 37.0  | 3959  | 1.4555          | 0.1896 | 0.3921 | 0.155  | 0.4721       | 0.0731          | 0.1309     | 0.0379      | 0.2339   | 0.2935    | 0.1495     | 0.0486    | 0.2215 | 0.3904 | 0.4061  | 0.6243           | 0.4114              | 0.3527         | 0.3015          | 0.3404       | 0.5462    | 0.3605     | 0.1592    |
| 1.1762        | 38.0  | 4066  | 1.4493          | 0.1818 | 0.3896 | 0.1507 | 0.4733       | 0.0844          | 0.1198     | 0.0236      | 0.2081   | 0.2867    | 0.1387     | 0.046     | 0.2103 | 0.3867 | 0.411   | 0.6387           | 0.4367              | 0.3607         | 0.3046          | 0.3142       | 0.532     | 0.362      | 0.1857    |
| 1.1731        | 39.0  | 4173  | 1.4147          | 0.1999 | 0.4084 | 0.1802 | 0.5015       | 0.1047          | 0.1363     | 0.0317      | 0.2254   | 0.3095    | 0.1505     | 0.0556    | 0.2195 | 0.4139 | 0.4268  | 0.6441           | 0.4519              | 0.3598         | 0.3569          | 0.3213       | 0.5706    | 0.3736     | 0.1939    |
| 1.1373        | 40.0  | 4280  | 1.4616          | 0.2065 | 0.4203 | 0.179  | 0.5155       | 0.0951          | 0.1367     | 0.0446      | 0.2406   | 0.3142    | 0.1577     | 0.0629    | 0.2322 | 0.3984 | 0.416   | 0.6653           | 0.4051              | 0.3558         | 0.32            | 0.3338       | 0.5772    | 0.3599     | 0.1669    |
| 1.1555        | 41.0  | 4387  | 1.4085          | 0.2056 | 0.4298 | 0.1852 | 0.5084       | 0.0938          | 0.1467     | 0.0318      | 0.2473   | 0.3073    | 0.1579     | 0.0613    | 0.2332 | 0.4107 | 0.4286  | 0.6599           | 0.4506              | 0.3522         | 0.3308          | 0.3493       | 0.5641    | 0.3887     | 0.1693    |
| 1.1251        | 42.0  | 4494  | 1.4251          | 0.2016 | 0.4199 | 0.1708 | 0.4991       | 0.0886          | 0.1526     | 0.0353      | 0.2325   | 0.3155    | 0.1518     | 0.0622    | 0.2355 | 0.4061 | 0.4188  | 0.6369           | 0.4266              | 0.3571         | 0.3262          | 0.3471       | 0.5733    | 0.36       | 0.1816    |
| 1.13          | 43.0  | 4601  | 1.4109          | 0.2082 | 0.4235 | 0.1871 | 0.5153       | 0.0981          | 0.1493     | 0.0355      | 0.243    | 0.3314    | 0.1561     | 0.0468    | 0.2499 | 0.4077 | 0.4286  | 0.6527           | 0.4443              | 0.3504         | 0.3538          | 0.3418       | 0.5721    | 0.3896     | 0.1574    |
| 1.1054        | 44.0  | 4708  | 1.4445          | 0.1986 | 0.414  | 0.1641 | 0.4908       | 0.0998          | 0.1489     | 0.0334      | 0.2202   | 0.3213    | 0.1555     | 0.0467    | 0.2271 | 0.3984 | 0.4155  | 0.6622           | 0.3987              | 0.3696         | 0.3123          | 0.3347       | 0.5447    | 0.3817     | 0.1669    |
| 1.0976        | 45.0  | 4815  | 1.3522          | 0.2204 | 0.4545 | 0.1927 | 0.5164       | 0.1406          | 0.1522     | 0.0447      | 0.2481   | 0.3496    | 0.1758     | 0.0601    | 0.2479 | 0.4202 | 0.4408  | 0.6626           | 0.4316              | 0.3692         | 0.3785          | 0.3622       | 0.5881    | 0.4096     | 0.1567    |
| 1.0902        | 46.0  | 4922  | 1.3911          | 0.2255 | 0.459  | 0.1903 | 0.5246       | 0.1499          | 0.1554     | 0.0443      | 0.2531   | 0.3737    | 0.1667     | 0.0562    | 0.2534 | 0.4091 | 0.427   | 0.6608           | 0.4278              | 0.3321         | 0.3492          | 0.3649       | 0.5908    | 0.3789     | 0.1419    |
| 1.0924        | 47.0  | 5029  | 1.4129          | 0.2179 | 0.438  | 0.1968 | 0.5126       | 0.1287          | 0.1623     | 0.0357      | 0.2502   | 0.3678    | 0.1568     | 0.064     | 0.2464 | 0.4227 | 0.4414  | 0.6613           | 0.4671              | 0.3656         | 0.3615          | 0.3516       | 0.6118    | 0.3921     | 0.156     |
| 1.0578        | 48.0  | 5136  | 1.3591          | 0.226  | 0.458  | 0.1983 | 0.5164       | 0.1453          | 0.1699     | 0.0535      | 0.245    | 0.3499    | 0.1859     | 0.0795    | 0.2654 | 0.4282 | 0.4467  | 0.6649           | 0.4291              | 0.3714         | 0.4092          | 0.3587       | 0.6001    | 0.4059     | 0.1825    |
| 1.0784        | 49.0  | 5243  | 1.3628          | 0.2351 | 0.4789 | 0.2056 | 0.5266       | 0.1709          | 0.1683     | 0.0821      | 0.2278   | 0.3749    | 0.1851     | 0.0632    | 0.2463 | 0.4193 | 0.434   | 0.6635           | 0.4241              | 0.3723         | 0.3769          | 0.3333       | 0.5954    | 0.3687     | 0.1871    |
| 1.0538        | 50.0  | 5350  | 1.3747          | 0.2235 | 0.4678 | 0.1824 | 0.5198       | 0.1498          | 0.1553     | 0.0658      | 0.2268   | 0.3455    | 0.1741     | 0.0559    | 0.251  | 0.4235 | 0.441   | 0.6698           | 0.4658              | 0.3688         | 0.3646          | 0.336        | 0.5987    | 0.3796     | 0.2044    |
| 1.073         | 51.0  | 5457  | 1.3670          | 0.2327 | 0.4743 | 0.2008 | 0.5208       | 0.1665          | 0.153      | 0.0708      | 0.2526   | 0.3665    | 0.1921     | 0.065     | 0.2572 | 0.4244 | 0.4447  | 0.6685           | 0.4519              | 0.3754         | 0.3738          | 0.3538       | 0.6049    | 0.3983     | 0.1842    |
| 1.046         | 52.0  | 5564  | 1.3740          | 0.2274 | 0.4689 | 0.2021 | 0.5104       | 0.1316          | 0.1589     | 0.085       | 0.2511   | 0.3452    | 0.1893     | 0.0699    | 0.2603 | 0.4256 | 0.4417  | 0.6599           | 0.443               | 0.3853         | 0.3646          | 0.3556       | 0.6094    | 0.3834     | 0.1673    |
| 1.0357        | 53.0  | 5671  | 1.3717          | 0.234  | 0.4706 | 0.205  | 0.5205       | 0.1471          | 0.1758     | 0.0706      | 0.2559   | 0.3477    | 0.1915     | 0.0707    | 0.2489 | 0.4459 | 0.4583  | 0.6752           | 0.4696              | 0.3844         | 0.4108          | 0.3516       | 0.6231    | 0.4067     | 0.1743    |
| 1.0409        | 54.0  | 5778  | 1.3340          | 0.2379 | 0.4808 | 0.2053 | 0.5229       | 0.1567          | 0.1758     | 0.078       | 0.2562   | 0.3685    | 0.185      | 0.0666    | 0.257  | 0.4239 | 0.4391  | 0.6788           | 0.4519              | 0.3853         | 0.3246          | 0.3551       | 0.6022    | 0.3845     | 0.1809    |
| 0.9965        | 55.0  | 5885  | 1.3820          | 0.2278 | 0.4612 | 0.2021 | 0.5011       | 0.1362          | 0.1706     | 0.0689      | 0.262    | 0.357     | 0.1874     | 0.05      | 0.2588 | 0.4149 | 0.4334  | 0.6586           | 0.4165              | 0.3915         | 0.3354          | 0.3649       | 0.5898    | 0.3901     | 0.1513    |
| 1.0164        | 56.0  | 5992  | 1.3389          | 0.2296 | 0.4745 | 0.2029 | 0.5153       | 0.1461          | 0.1701     | 0.0799      | 0.2365   | 0.3576    | 0.1839     | 0.053     | 0.2526 | 0.4205 | 0.438   | 0.6743           | 0.4203              | 0.4062         | 0.3462          | 0.3431       | 0.5991    | 0.3765     | 0.1948    |
| 1.0269        | 57.0  | 6099  | 1.3383          | 0.2428 | 0.4846 | 0.2082 | 0.517        | 0.1608          | 0.1881     | 0.0976      | 0.2505   | 0.3809    | 0.1975     | 0.0578    | 0.2657 | 0.4294 | 0.4426  | 0.6757           | 0.4532              | 0.383          | 0.3369          | 0.364        | 0.6041    | 0.3911     | 0.1599    |
| 1.0046        | 58.0  | 6206  | 1.3327          | 0.242  | 0.5002 | 0.2153 | 0.5332       | 0.1674          | 0.1622     | 0.1032      | 0.2439   | 0.3925    | 0.1925     | 0.0694    | 0.2554 | 0.4239 | 0.4404  | 0.682            | 0.4595              | 0.3629         | 0.3415          | 0.356        | 0.6121    | 0.3883     | 0.1649    |
| 0.9824        | 59.0  | 6313  | 1.3146          | 0.2374 | 0.4831 | 0.2061 | 0.532        | 0.1447          | 0.1729     | 0.0735      | 0.2638   | 0.3835    | 0.1987     | 0.0489    | 0.2584 | 0.4291 | 0.4468  | 0.6811           | 0.4506              | 0.3777         | 0.3508          | 0.3738       | 0.6235    | 0.405      | 0.1578    |
| 0.993         | 60.0  | 6420  | 1.3323          | 0.2473 | 0.4911 | 0.2301 | 0.5446       | 0.1633          | 0.1693     | 0.0918      | 0.2675   | 0.3966    | 0.1955     | 0.062     | 0.2581 | 0.4351 | 0.4493  | 0.6959           | 0.4494              | 0.3741         | 0.3585          | 0.3684       | 0.6193    | 0.399      | 0.1689    |
| 0.9693        | 61.0  | 6527  | 1.3266          | 0.2482 | 0.5025 | 0.2301 | 0.531        | 0.1638          | 0.1818     | 0.0934      | 0.271    | 0.3887    | 0.208      | 0.0719    | 0.2538 | 0.4263 | 0.4394  | 0.6739           | 0.4203              | 0.3759         | 0.3569          | 0.3702       | 0.6136    | 0.3829     | 0.1565    |
| 0.9659        | 62.0  | 6634  | 1.3103          | 0.2489 | 0.5113 | 0.2211 | 0.5394       | 0.1635          | 0.2051     | 0.0788      | 0.2577   | 0.3992    | 0.1974     | 0.0613    | 0.2531 | 0.4417 | 0.4587  | 0.6874           | 0.443               | 0.4036         | 0.3938          | 0.3658       | 0.6242    | 0.4077     | 0.1785    |
| 0.9812        | 63.0  | 6741  | 1.3091          | 0.2484 | 0.5071 | 0.2221 | 0.5391       | 0.1971          | 0.1813     | 0.068       | 0.2565   | 0.3881    | 0.2023     | 0.059     | 0.261  | 0.4321 | 0.4472  | 0.6842           | 0.4443              | 0.3683         | 0.3815          | 0.3578       | 0.6004    | 0.4011     | 0.1762    |
| 0.9443        | 64.0  | 6848  | 1.3034          | 0.255  | 0.5053 | 0.234  | 0.5466       | 0.1946          | 0.196      | 0.0808      | 0.2569   | 0.4079    | 0.1967     | 0.0655    | 0.2622 | 0.4358 | 0.4519  | 0.6932           | 0.4658              | 0.3781         | 0.3569          | 0.3653       | 0.6256    | 0.4023     | 0.1695    |
| 0.9468        | 65.0  | 6955  | 1.3067          | 0.2543 | 0.5115 | 0.2286 | 0.5465       | 0.2078          | 0.1787     | 0.0851      | 0.2533   | 0.3954    | 0.2185     | 0.0509    | 0.2679 | 0.4375 | 0.4469  | 0.6806           | 0.4595              | 0.375          | 0.3646          | 0.3547       | 0.6126    | 0.4035     | 0.1647    |
| 0.9427        | 66.0  | 7062  | 1.3082          | 0.2566 | 0.5135 | 0.2296 | 0.5537       | 0.1822          | 0.1903     | 0.1002      | 0.2565   | 0.4108    | 0.2056     | 0.0582    | 0.2631 | 0.4291 | 0.444   | 0.6941           | 0.4481              | 0.3754         | 0.3446          | 0.3578       | 0.6226    | 0.3932     | 0.164     |
| 0.9407        | 67.0  | 7169  | 1.2939          | 0.2554 | 0.5046 | 0.2354 | 0.5447       | 0.1809          | 0.1784     | 0.1029      | 0.2699   | 0.3997    | 0.209      | 0.0651    | 0.2775 | 0.4442 | 0.459   | 0.6883           | 0.4405              | 0.4009         | 0.3769          | 0.3884       | 0.6138    | 0.4135     | 0.2002    |
| 0.9415        | 68.0  | 7276  | 1.3124          | 0.2646 | 0.5194 | 0.2399 | 0.5569       | 0.1971          | 0.1767     | 0.1011      | 0.2914   | 0.4107    | 0.2057     | 0.0701    | 0.2679 | 0.4475 | 0.4654  | 0.6973           | 0.457               | 0.3781         | 0.4             | 0.3947       | 0.6329    | 0.4028     | 0.2046    |
| 0.9355        | 69.0  | 7383  | 1.3057          | 0.2559 | 0.5018 | 0.2431 | 0.564        | 0.1882          | 0.1702     | 0.075       | 0.2823   | 0.397     | 0.2078     | 0.0678    | 0.2693 | 0.4378 | 0.4526  | 0.7054           | 0.457               | 0.3714         | 0.3354          | 0.3938       | 0.6233    | 0.3913     | 0.2025    |
| 0.9219        | 70.0  | 7490  | 1.3124          | 0.2597 | 0.5199 | 0.237  | 0.5355       | 0.2125          | 0.1808     | 0.0888      | 0.2806   | 0.3964    | 0.2092     | 0.0786    | 0.2741 | 0.4348 | 0.4492  | 0.6739           | 0.4671              | 0.3933         | 0.3323          | 0.3796       | 0.6152    | 0.3894     | 0.1811    |
| 0.924         | 71.0  | 7597  | 1.2846          | 0.2617 | 0.5187 | 0.2391 | 0.5557       | 0.1992          | 0.1934     | 0.0901      | 0.2704   | 0.4049    | 0.2025     | 0.0702    | 0.2746 | 0.4484 | 0.4624  | 0.6851           | 0.4582              | 0.3875         | 0.4015          | 0.3796       | 0.6209    | 0.4033     | 0.197     |
| 0.9059        | 72.0  | 7704  | 1.3033          | 0.2654 | 0.5153 | 0.2509 | 0.5439       | 0.2186          | 0.1882     | 0.0907      | 0.2857   | 0.4047    | 0.2232     | 0.0667    | 0.2793 | 0.4522 | 0.4674  | 0.6883           | 0.4861              | 0.3893         | 0.3892          | 0.384        | 0.6274    | 0.4195     | 0.2061    |
| 0.898         | 73.0  | 7811  | 1.3032          | 0.2566 | 0.5055 | 0.2341 | 0.5384       | 0.188           | 0.1921     | 0.0934      | 0.271    | 0.4023    | 0.1998     | 0.0624    | 0.2678 | 0.4448 | 0.4627  | 0.677            | 0.4747              | 0.3955         | 0.3908          | 0.3756       | 0.618     | 0.4065     | 0.2145    |
| 0.8891        | 74.0  | 7918  | 1.3166          | 0.2575 | 0.5163 | 0.2318 | 0.5505       | 0.1876          | 0.1786     | 0.0896      | 0.2811   | 0.3978    | 0.2063     | 0.0807    | 0.2714 | 0.4399 | 0.4573  | 0.6937           | 0.462               | 0.396          | 0.3477          | 0.3871       | 0.6207    | 0.405      | 0.2097    |
| 0.8795        | 75.0  | 8025  | 1.2989          | 0.2629 | 0.5072 | 0.2471 | 0.5572       | 0.198           | 0.1819     | 0.0975      | 0.28     | 0.4177    | 0.2137     | 0.0777    | 0.2667 | 0.4464 | 0.4623  | 0.6973           | 0.4582              | 0.4004         | 0.3738          | 0.3818       | 0.6225    | 0.4086     | 0.2155    |
| 0.8835        | 76.0  | 8132  | 1.2978          | 0.2714 | 0.5307 | 0.2606 | 0.5548       | 0.2234          | 0.1905     | 0.1016      | 0.2867   | 0.4302    | 0.2229     | 0.086     | 0.2744 | 0.4566 | 0.4724  | 0.6946           | 0.5038              | 0.3964         | 0.3831          | 0.384        | 0.6389    | 0.4226     | 0.2132    |
| 0.9           | 77.0  | 8239  | 1.2916          | 0.2674 | 0.5237 | 0.242  | 0.5506       | 0.2127          | 0.1916     | 0.1094      | 0.2727   | 0.4176    | 0.2194     | 0.0704    | 0.2639 | 0.4432 | 0.4565  | 0.6914           | 0.4532              | 0.4004         | 0.36            | 0.3773       | 0.6091    | 0.3982     | 0.2424    |
| 0.8872        | 78.0  | 8346  | 1.2752          | 0.2744 | 0.5395 | 0.2546 | 0.5543       | 0.2139          | 0.1967     | 0.121       | 0.2864   | 0.4319    | 0.2262     | 0.0621    | 0.2721 | 0.4467 | 0.4647  | 0.6964           | 0.481               | 0.3879         | 0.3692          | 0.3889       | 0.6395    | 0.4137     | 0.1906    |
| 0.8767        | 79.0  | 8453  | 1.2916          | 0.2737 | 0.5397 | 0.2503 | 0.5436       | 0.2175          | 0.1985     | 0.1219      | 0.287    | 0.4288    | 0.2291     | 0.0837    | 0.2797 | 0.4519 | 0.4664  | 0.6959           | 0.4873              | 0.392          | 0.3631          | 0.3938       | 0.6321    | 0.4188     | 0.1945    |
| 0.8785        | 80.0  | 8560  | 1.3004          | 0.2719 | 0.537  | 0.2452 | 0.549        | 0.2249          | 0.1836     | 0.1143      | 0.2876   | 0.426     | 0.2257     | 0.0863    | 0.2821 | 0.4519 | 0.4615  | 0.6892           | 0.4835              | 0.3839         | 0.3585          | 0.3924       | 0.6326    | 0.4125     | 0.1763    |
| 0.8733        | 81.0  | 8667  | 1.2918          | 0.2688 | 0.5325 | 0.2473 | 0.5406       | 0.2208          | 0.1963     | 0.1138      | 0.2725   | 0.421     | 0.2187     | 0.0796    | 0.2771 | 0.4499 | 0.4635  | 0.6946           | 0.5038              | 0.3893         | 0.3554          | 0.3747       | 0.6206    | 0.4117     | 0.2144    |
| 0.8823        | 82.0  | 8774  | 1.3056          | 0.2712 | 0.5299 | 0.2497 | 0.5278       | 0.2231          | 0.1861     | 0.1298      | 0.289    | 0.4239    | 0.2287     | 0.0651    | 0.2797 | 0.4489 | 0.4588  | 0.6869           | 0.4759              | 0.3737         | 0.3723          | 0.3853       | 0.6287    | 0.4063     | 0.1962    |
| 0.8704        | 83.0  | 8881  | 1.2819          | 0.2695 | 0.5333 | 0.2459 | 0.5283       | 0.2208          | 0.1939     | 0.1213      | 0.2834   | 0.4246    | 0.2255     | 0.0779    | 0.279  | 0.4489 | 0.4591  | 0.6869           | 0.4759              | 0.3938         | 0.3569          | 0.3818       | 0.6371    | 0.3994     | 0.1888    |
| 0.8465        | 84.0  | 8988  | 1.3033          | 0.2735 | 0.5394 | 0.2551 | 0.5387       | 0.2369          | 0.1953     | 0.1169      | 0.2797   | 0.4277    | 0.2244     | 0.0877    | 0.2786 | 0.4465 | 0.4575  | 0.6797           | 0.481               | 0.3951         | 0.3477          | 0.384        | 0.633     | 0.4044     | 0.1802    |
| 0.8366        | 85.0  | 9095  | 1.3053          | 0.2708 | 0.531  | 0.2427 | 0.5338       | 0.2317          | 0.1927     | 0.1134      | 0.2822   | 0.4223    | 0.2165     | 0.0786    | 0.2723 | 0.4379 | 0.4517  | 0.6752           | 0.4823              | 0.375          | 0.3477          | 0.3782       | 0.6049    | 0.4051     | 0.1898    |
| 0.8491        | 86.0  | 9202  | 1.2840          | 0.2805 | 0.5355 | 0.2549 | 0.5392       | 0.2504          | 0.2054     | 0.1197      | 0.288    | 0.4282    | 0.2341     | 0.0783    | 0.2831 | 0.4491 | 0.4645  | 0.6811           | 0.4962              | 0.4018         | 0.3569          | 0.3867       | 0.6288    | 0.4189     | 0.199     |
| 0.8473        | 87.0  | 9309  | 1.2829          | 0.2785 | 0.5435 | 0.2557 | 0.538        | 0.2432          | 0.2038     | 0.1273      | 0.2802   | 0.4339    | 0.2234     | 0.0868    | 0.2807 | 0.4509 | 0.4637  | 0.6815           | 0.4848              | 0.3879         | 0.3815          | 0.3827       | 0.6366    | 0.4085     | 0.2053    |
| 0.844         | 88.0  | 9416  | 1.2751          | 0.2794 | 0.5433 | 0.2532 | 0.5424       | 0.2415          | 0.2012     | 0.1279      | 0.2842   | 0.4367    | 0.2218     | 0.0767    | 0.2785 | 0.4568 | 0.4691  | 0.6829           | 0.5051              | 0.3969         | 0.3754          | 0.3853       | 0.6326    | 0.4168     | 0.2101    |
| 0.8411        | 89.0  | 9523  | 1.2844          | 0.2813 | 0.5461 | 0.2606 | 0.5418       | 0.2438          | 0.2045     | 0.1335      | 0.2831   | 0.4414    | 0.2267     | 0.0947    | 0.2824 | 0.4511 | 0.4647  | 0.6847           | 0.4911              | 0.3969         | 0.3662          | 0.3849       | 0.6306    | 0.4107     | 0.2043    |
| 0.8375        | 90.0  | 9630  | 1.2949          | 0.2758 | 0.5364 | 0.2516 | 0.5433       | 0.2321          | 0.1937     | 0.1287      | 0.2811   | 0.4359    | 0.2251     | 0.0942    | 0.2797 | 0.4481 | 0.462   | 0.6824           | 0.481               | 0.3929         | 0.3677          | 0.3858       | 0.6303    | 0.4087     | 0.2091    |
| 0.8338        | 91.0  | 9737  | 1.2828          | 0.2843 | 0.5496 | 0.2604 | 0.5478       | 0.2493          | 0.2043     | 0.1324      | 0.2877   | 0.4388    | 0.2413     | 0.0914    | 0.2825 | 0.4592 | 0.4735  | 0.6937           | 0.5025              | 0.4071         | 0.3738          | 0.3902       | 0.636     | 0.4261     | 0.2145    |
| 0.83          | 92.0  | 9844  | 1.3003          | 0.2866 | 0.5615 | 0.2591 | 0.5463       | 0.2636          | 0.2034     | 0.1303      | 0.2896   | 0.4329    | 0.244      | 0.0747    | 0.2854 | 0.4557 | 0.4687  | 0.6914           | 0.5013              | 0.3942         | 0.3738          | 0.3827       | 0.6259    | 0.4222     | 0.1996    |
| 0.8328        | 93.0  | 9951  | 1.2828          | 0.288  | 0.5537 | 0.2649 | 0.5568       | 0.2477          | 0.2126     | 0.1374      | 0.2854   | 0.4461    | 0.2385     | 0.0873    | 0.2819 | 0.4572 | 0.4693  | 0.7009           | 0.4873              | 0.4022         | 0.3769          | 0.3791       | 0.6381    | 0.4181     | 0.186     |
| 0.8267        | 94.0  | 10058 | 1.2746          | 0.2883 | 0.5541 | 0.2651 | 0.5599       | 0.249           | 0.212      | 0.1343      | 0.2866   | 0.4479    | 0.2336     | 0.0997    | 0.2809 | 0.4596 | 0.4717  | 0.7045           | 0.4911              | 0.4022         | 0.3769          | 0.3836       | 0.6444    | 0.4129     | 0.2108    |
| 0.8184        | 95.0  | 10165 | 1.2821          | 0.2885 | 0.5582 | 0.2654 | 0.5595       | 0.2428          | 0.2099     | 0.1405      | 0.29     | 0.4466    | 0.2342     | 0.0796    | 0.2815 | 0.4591 | 0.4703  | 0.7              | 0.4823              | 0.3973         | 0.3846          | 0.3871       | 0.6396    | 0.4184     | 0.2009    |
| 0.8347        | 96.0  | 10272 | 1.2907          | 0.2886 | 0.5566 | 0.2638 | 0.5606       | 0.243           | 0.211      | 0.1368      | 0.2915   | 0.4469    | 0.2346     | 0.0904    | 0.2789 | 0.4536 | 0.4663  | 0.7005           | 0.4785              | 0.3955         | 0.3708          | 0.3862       | 0.6404    | 0.4093     | 0.1899    |
| 0.8128        | 97.0  | 10379 | 1.2762          | 0.2894 | 0.5568 | 0.2646 | 0.5633       | 0.2445          | 0.2112     | 0.1379      | 0.2902   | 0.4477    | 0.2343     | 0.094     | 0.2824 | 0.4589 | 0.4704  | 0.7005           | 0.4949              | 0.3942         | 0.3738          | 0.3884       | 0.6454    | 0.4109     | 0.2085    |
| 0.8138        | 98.0  | 10486 | 1.2712          | 0.2856 | 0.5452 | 0.2679 | 0.5633       | 0.2304          | 0.2102     | 0.137       | 0.2873   | 0.4444    | 0.2318     | 0.0849    | 0.2804 | 0.4581 | 0.4701  | 0.7023           | 0.4937              | 0.3978         | 0.3754          | 0.3813       | 0.6402    | 0.4112     | 0.204     |
| 0.8153        | 99.0  | 10593 | 1.2698          | 0.2874 | 0.5483 | 0.2658 | 0.5605       | 0.2384          | 0.2089     | 0.1397      | 0.2896   | 0.4474    | 0.2323     | 0.0861    | 0.282  | 0.4581 | 0.4693  | 0.6986           | 0.4962              | 0.3938         | 0.3738          | 0.384        | 0.6407    | 0.4107     | 0.2069    |
| 0.8216        | 100.0 | 10700 | 1.2683          | 0.2876 | 0.548  | 0.268  | 0.5615       | 0.2396          | 0.2085     | 0.1386      | 0.2901   | 0.4466    | 0.2337     | 0.0849    | 0.2822 | 0.4586 | 0.471   | 0.6995           | 0.5013              | 0.3946         | 0.3754          | 0.384        | 0.6399    | 0.4132     | 0.2103    |


### Framework versions

- Transformers 4.45.0.dev0
- Pytorch 2.4.0+cu121
- Datasets 2.21.0
- Tokenizers 0.19.1