File size: 49,499 Bytes
ce2b232
7a21f04
 
ce2b232
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31233e0
ce2b232
 
31233e0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-seq_bn-0
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-seq_bn-0

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1597
- Location Precision: 0.8205
- Location Recall: 0.9275
- Location F1: 0.8707
- Location Number: 69
- Organization Precision: 0.6714
- Organization Recall: 0.8103
- Organization F1: 0.7344
- Organization Number: 58
- Person Precision: 0.8242
- Person Recall: 0.8947
- Person F1: 0.8580
- Person Number: 152
- Quantity Precision: 0.6857
- Quantity Recall: 0.8
- Quantity F1: 0.7385
- Quantity Number: 30
- Time Precision: 0.8387
- Time Recall: 0.8966
- Time F1: 0.8667
- Time Number: 29
- Overall Precision: 0.7836
- Overall Recall: 0.8787
- Overall F1: 0.8285
- Overall Accuracy: 0.9639

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9255        | 1.0   | 106   | 0.6140          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 58                  | 0.25             | 0.0066        | 0.0128    | 152           | 0.0                | 0.0             | 0.0         | 30              | 0.0            | 0.0         | 0.0     | 29          | 0.25              | 0.0030         | 0.0058     | 0.8402           |
| 0.5503        | 2.0   | 212   | 0.3995          | 0.2667             | 0.0580          | 0.0952      | 69              | 0.0                    | 0.0                 | 0.0             | 58                  | 0.4888           | 0.5724        | 0.5273    | 152           | 0.0                | 0.0             | 0.0         | 30              | 0.5625         | 0.3103      | 0.4     | 29          | 0.4505            | 0.2959         | 0.3571     | 0.8855           |
| 0.3808        | 3.0   | 318   | 0.2890          | 0.4941             | 0.6087          | 0.5455      | 69              | 0.3889                 | 0.2414              | 0.2979          | 58                  | 0.6531           | 0.8421        | 0.7356    | 152           | 0.2727             | 0.3             | 0.2857      | 30              | 0.7037         | 0.6552      | 0.6786  | 29          | 0.5623            | 0.6272         | 0.5930     | 0.9268           |
| 0.2833        | 4.0   | 424   | 0.2156          | 0.5730             | 0.7391          | 0.6456      | 69              | 0.4815                 | 0.4483              | 0.4643          | 58                  | 0.7253           | 0.8684        | 0.7904    | 152           | 0.4211             | 0.5333          | 0.4706      | 30              | 0.8276         | 0.8276      | 0.8276  | 29          | 0.6352            | 0.7367         | 0.6822     | 0.9406           |
| 0.2213        | 5.0   | 530   | 0.1828          | 0.6374             | 0.8406          | 0.725       | 69              | 0.5357                 | 0.5172              | 0.5263          | 58                  | 0.7389           | 0.875         | 0.8012    | 152           | 0.4444             | 0.6667          | 0.5333      | 30              | 0.8276         | 0.8276      | 0.8276  | 29          | 0.6608            | 0.7840         | 0.7172     | 0.9434           |
| 0.1845        | 6.0   | 636   | 0.1698          | 0.6854             | 0.8841          | 0.7722      | 69              | 0.5135                 | 0.6552              | 0.5758          | 58                  | 0.7556           | 0.8947        | 0.8193    | 152           | 0.5                | 0.6667          | 0.5714      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.6763            | 0.8284         | 0.7447     | 0.9467           |
| 0.17          | 7.0   | 742   | 0.1523          | 0.7349             | 0.8841          | 0.8026      | 69              | 0.5692                 | 0.6379              | 0.6016          | 58                  | 0.7746           | 0.8816        | 0.8246    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7242            | 0.8314         | 0.7741     | 0.9511           |
| 0.1552        | 8.0   | 848   | 0.1481          | 0.7654             | 0.8986          | 0.8267      | 69              | 0.5352                 | 0.6552              | 0.5891          | 58                  | 0.7803           | 0.8882        | 0.8308    | 152           | 0.6667             | 0.8             | 0.7273      | 30              | 0.7576         | 0.8621      | 0.8065  | 29          | 0.7208            | 0.8402         | 0.7760     | 0.9519           |
| 0.1486        | 9.0   | 954   | 0.1388          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.5538                 | 0.6207              | 0.5854          | 58                  | 0.8072           | 0.8816        | 0.8428    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7454            | 0.8314         | 0.7860     | 0.9544           |
| 0.1369        | 10.0  | 1060  | 0.1391          | 0.7722             | 0.8841          | 0.8243      | 69              | 0.5652                 | 0.6724              | 0.6142          | 58                  | 0.7929           | 0.8816        | 0.8349    | 152           | 0.6154             | 0.8             | 0.6957      | 30              | 0.7647         | 0.8966      | 0.8254  | 29          | 0.7282            | 0.8402         | 0.7802     | 0.9549           |
| 0.132         | 11.0  | 1166  | 0.1417          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.5797                 | 0.6897              | 0.6299          | 58                  | 0.8047           | 0.8947        | 0.8474    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.7143         | 0.8621      | 0.7813  | 29          | 0.7391            | 0.8550         | 0.7929     | 0.9534           |
| 0.1268        | 12.0  | 1272  | 0.1316          | 0.7848             | 0.8986          | 0.8378      | 69              | 0.625                  | 0.6034              | 0.6140          | 58                  | 0.8182           | 0.8882        | 0.8517    | 152           | 0.7222             | 0.8667          | 0.7879      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7690            | 0.8373         | 0.8017     | 0.9577           |
| 0.1206        | 13.0  | 1378  | 0.1325          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.5873                 | 0.6379              | 0.6116          | 58                  | 0.8144           | 0.8947        | 0.8527    | 152           | 0.6757             | 0.8333          | 0.7463      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7606            | 0.8462         | 0.8011     | 0.9575           |
| 0.1186        | 14.0  | 1484  | 0.1396          | 0.8158             | 0.8986          | 0.8552      | 69              | 0.6329                 | 0.8621              | 0.7299          | 58                  | 0.8095           | 0.8947        | 0.8500    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.7647         | 0.8966      | 0.8254  | 29          | 0.7570            | 0.8846         | 0.8158     | 0.9577           |
| 0.1141        | 15.0  | 1590  | 0.1282          | 0.8267             | 0.8986          | 0.8611      | 69              | 0.6129                 | 0.6552              | 0.6333          | 58                  | 0.8171           | 0.8816        | 0.8481    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7576         | 0.8621      | 0.8065  | 29          | 0.7676            | 0.8402         | 0.8023     | 0.9583           |
| 0.1083        | 16.0  | 1696  | 0.1356          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6479                 | 0.7931              | 0.7132          | 58                  | 0.8144           | 0.8947        | 0.8527    | 152           | 0.6667             | 0.8             | 0.7273      | 30              | 0.7647         | 0.8966      | 0.8254  | 29          | 0.7642            | 0.8728         | 0.8149     | 0.9577           |
| 0.1106        | 17.0  | 1802  | 0.1327          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6212                 | 0.7069              | 0.6613          | 58                  | 0.8182           | 0.8882        | 0.8517    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.7576         | 0.8621      | 0.8065  | 29          | 0.7652            | 0.8580         | 0.8089     | 0.9585           |
| 0.1053        | 18.0  | 1908  | 0.1359          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6349                 | 0.6897              | 0.6612          | 58                  | 0.8095           | 0.8947        | 0.8500    | 152           | 0.6410             | 0.8333          | 0.7246      | 30              | 0.7353         | 0.8621      | 0.7937  | 29          | 0.7572            | 0.8580         | 0.8044     | 0.9580           |
| 0.1089        | 19.0  | 2014  | 0.1244          | 0.8219             | 0.8696          | 0.8451      | 69              | 0.6                    | 0.5690              | 0.5841          | 58                  | 0.8210           | 0.875         | 0.8471    | 152           | 0.7429             | 0.8667          | 0.8         | 30              | 0.8667         | 0.8966      | 0.8814  | 29          | 0.7831            | 0.8225         | 0.8023     | 0.9595           |
| 0.1046        | 20.0  | 2120  | 0.1291          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6667                 | 0.6897              | 0.6780          | 58                  | 0.8155           | 0.9013        | 0.8562    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7727            | 0.8550         | 0.8118     | 0.9601           |
| 0.0965        | 21.0  | 2226  | 0.1389          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6622                 | 0.8448              | 0.7424          | 58                  | 0.8333           | 0.9211        | 0.875     | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7679            | 0.8905         | 0.8247     | 0.9572           |
| 0.0958        | 22.0  | 2332  | 0.1279          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6849                 | 0.8621              | 0.7634          | 58                  | 0.8232           | 0.8882        | 0.8544    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7868            | 0.8846         | 0.8329     | 0.9618           |
| 0.0929        | 23.0  | 2438  | 0.1228          | 0.8356             | 0.8841          | 0.8592      | 69              | 0.6290                 | 0.6724              | 0.6500          | 58                  | 0.8253           | 0.9013        | 0.8616    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7885            | 0.8491         | 0.8177     | 0.9629           |
| 0.0934        | 24.0  | 2544  | 0.1357          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6579                 | 0.8621              | 0.7463          | 58                  | 0.8059           | 0.9013        | 0.8509    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7724            | 0.8935         | 0.8285     | 0.9595           |
| 0.0887        | 25.0  | 2650  | 0.1232          | 0.7949             | 0.8986          | 0.8435      | 69              | 0.6935                 | 0.7414              | 0.7167          | 58                  | 0.8272           | 0.8816        | 0.8535    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7875            | 0.8550         | 0.8199     | 0.9616           |
| 0.1025        | 26.0  | 2756  | 0.1350          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.7101                 | 0.8448              | 0.7717          | 58                  | 0.8253           | 0.9013        | 0.8616    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7863            | 0.8817         | 0.8312     | 0.9618           |
| 0.0868        | 27.0  | 2862  | 0.1334          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.7206                 | 0.8448              | 0.7778          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7027             | 0.8667          | 0.7761      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7868            | 0.8846         | 0.8329     | 0.9613           |
| 0.0836        | 28.0  | 2968  | 0.1318          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6818                 | 0.7759              | 0.7258          | 58                  | 0.8253           | 0.9013        | 0.8616    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.6970         | 0.7931      | 0.7419  | 29          | 0.7778            | 0.8698         | 0.8212     | 0.9621           |
| 0.0791        | 29.0  | 3074  | 0.1344          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6912                 | 0.8103              | 0.7460          | 58                  | 0.8155           | 0.9013        | 0.8562    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7810            | 0.8757         | 0.8257     | 0.9618           |
| 0.0792        | 30.0  | 3180  | 0.1233          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6885                 | 0.7241              | 0.7059          | 58                  | 0.8303           | 0.9013        | 0.8644    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7984            | 0.8669         | 0.8312     | 0.9652           |
| 0.0772        | 31.0  | 3286  | 0.1278          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6923                 | 0.7759              | 0.7317          | 58                  | 0.8263           | 0.9079        | 0.8652    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8            | 0.8276      | 0.8136  | 29          | 0.7936            | 0.8757         | 0.8326     | 0.9647           |
| 0.0766        | 32.0  | 3392  | 0.1275          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6667                 | 0.7931              | 0.7244          | 58                  | 0.8232           | 0.8882        | 0.8544    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8            | 0.8276      | 0.8136  | 29          | 0.7861            | 0.8698         | 0.8258     | 0.9639           |
| 0.0746        | 33.0  | 3498  | 0.1314          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6812                 | 0.8103              | 0.7402          | 58                  | 0.8221           | 0.8816        | 0.8508    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8            | 0.8276      | 0.8136  | 29          | 0.7888            | 0.8728         | 0.8287     | 0.9636           |
| 0.072         | 34.0  | 3604  | 0.1335          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6957                 | 0.8276              | 0.7559          | 58                  | 0.8385           | 0.8882        | 0.8626    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8            | 0.8276      | 0.8136  | 29          | 0.7984            | 0.8787         | 0.8366     | 0.9639           |
| 0.0712        | 35.0  | 3710  | 0.1314          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.7031                 | 0.7759              | 0.7377          | 58                  | 0.8214           | 0.9079        | 0.8625    | 152           | 0.7429             | 0.8667          | 0.8         | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7926            | 0.8817         | 0.8347     | 0.9639           |
| 0.0702        | 36.0  | 3816  | 0.1303          | 0.8267             | 0.8986          | 0.8611      | 69              | 0.6528                 | 0.8103              | 0.7231          | 58                  | 0.8385           | 0.8882        | 0.8626    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8            | 0.8276      | 0.8136  | 29          | 0.7925            | 0.8698         | 0.8293     | 0.9641           |
| 0.0695        | 37.0  | 3922  | 0.1297          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.7121                 | 0.8103              | 0.7581          | 58                  | 0.8253           | 0.9013        | 0.8616    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8032            | 0.8817         | 0.8406     | 0.9649           |
| 0.0674        | 38.0  | 4028  | 0.1362          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6970                 | 0.7931              | 0.7419          | 58                  | 0.8364           | 0.9079        | 0.8707    | 152           | 0.6667             | 0.8667          | 0.7536      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7931            | 0.8846         | 0.8364     | 0.9639           |
| 0.0653        | 39.0  | 4134  | 0.1295          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6667                 | 0.7241              | 0.6942          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7935            | 0.8639         | 0.8272     | 0.9644           |
| 0.0637        | 40.0  | 4240  | 0.1349          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6818                 | 0.7759              | 0.7258          | 58                  | 0.8466           | 0.9079        | 0.8762    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.792             | 0.8787         | 0.8331     | 0.9639           |
| 0.0634        | 41.0  | 4346  | 0.1353          | 0.84               | 0.9130          | 0.8750      | 69              | 0.7059                 | 0.8276              | 0.7619          | 58                  | 0.8373           | 0.9145        | 0.8742    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.8016            | 0.8846         | 0.8411     | 0.9652           |
| 0.0622        | 42.0  | 4452  | 0.1350          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6769                 | 0.7586              | 0.7154          | 58                  | 0.8424           | 0.9145        | 0.8770    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8005            | 0.8787         | 0.8378     | 0.9649           |
| 0.0616        | 43.0  | 4558  | 0.1341          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.7015                 | 0.8103              | 0.752           | 58                  | 0.8373           | 0.9145        | 0.8742    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8048            | 0.8905         | 0.8455     | 0.9654           |
| 0.0603        | 44.0  | 4664  | 0.1411          | 0.7805             | 0.9275          | 0.8477      | 69              | 0.6620                 | 0.8103              | 0.7287          | 58                  | 0.8323           | 0.9145        | 0.8715    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7812            | 0.8876         | 0.8310     | 0.9629           |
| 0.0597        | 45.0  | 4770  | 0.1402          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6620                 | 0.8103              | 0.7287          | 58                  | 0.8263           | 0.9079        | 0.8652    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7740            | 0.8817         | 0.8243     | 0.9621           |
| 0.059         | 46.0  | 4876  | 0.1342          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6866                 | 0.7931              | 0.736           | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7936            | 0.8757         | 0.8326     | 0.9649           |
| 0.0574        | 47.0  | 4982  | 0.1355          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6866                 | 0.7931              | 0.736           | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7667         | 0.7931      | 0.7797  | 29          | 0.7861            | 0.8698         | 0.8258     | 0.9639           |
| 0.0581        | 48.0  | 5088  | 0.1352          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.7031                 | 0.7759              | 0.7377          | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.8027            | 0.8787         | 0.8390     | 0.9659           |
| 0.0561        | 49.0  | 5194  | 0.1386          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.6765                 | 0.7931              | 0.7302          | 58                  | 0.8313           | 0.9079        | 0.8679    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8667         | 0.8966      | 0.8814  | 29          | 0.7995            | 0.8846         | 0.8399     | 0.9649           |
| 0.0544        | 50.0  | 5300  | 0.1345          | 0.84               | 0.9130          | 0.8750      | 69              | 0.6866                 | 0.7931              | 0.736           | 58                  | 0.8210           | 0.875         | 0.8471    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8667         | 0.8966      | 0.8814  | 29          | 0.7984            | 0.8669         | 0.8312     | 0.9652           |
| 0.0534        | 51.0  | 5406  | 0.1369          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6944                 | 0.8621              | 0.7692          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8               | 0.8876         | 0.8415     | 0.9652           |
| 0.0521        | 52.0  | 5512  | 0.1461          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.68                   | 0.8793              | 0.7669          | 58                  | 0.8303           | 0.9013        | 0.8644    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7839            | 0.8905         | 0.8338     | 0.9629           |
| 0.0524        | 53.0  | 5618  | 0.1376          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.7164                 | 0.8276              | 0.768           | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8016            | 0.8846         | 0.8411     | 0.9657           |
| 0.0494        | 54.0  | 5724  | 0.1410          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.6812                 | 0.8103              | 0.7402          | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7995            | 0.8846         | 0.8399     | 0.9659           |
| 0.0516        | 55.0  | 5830  | 0.1382          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.6957                 | 0.8276              | 0.7559          | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.8048            | 0.8905         | 0.8455     | 0.9659           |
| 0.0497        | 56.0  | 5936  | 0.1393          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6716                 | 0.7759              | 0.7200          | 58                  | 0.8282           | 0.8882        | 0.8571    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7957            | 0.8757         | 0.8338     | 0.9654           |
| 0.048         | 57.0  | 6042  | 0.1442          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.7015                 | 0.8103              | 0.752           | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7926            | 0.8817         | 0.8347     | 0.9649           |
| 0.0474        | 58.0  | 6148  | 0.1420          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6712                 | 0.8448              | 0.7481          | 58                  | 0.8204           | 0.9013        | 0.8589    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7900            | 0.8905         | 0.8373     | 0.9647           |
| 0.0447        | 59.0  | 6254  | 0.1470          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6857                 | 0.8276              | 0.75            | 58                  | 0.8303           | 0.9013        | 0.8644    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7931            | 0.8846         | 0.8364     | 0.9647           |
| 0.045         | 60.0  | 6360  | 0.1453          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6765                 | 0.7931              | 0.7302          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.792             | 0.8787         | 0.8331     | 0.9649           |
| 0.0441        | 61.0  | 6466  | 0.1431          | 0.84               | 0.9130          | 0.8750      | 69              | 0.6667                 | 0.7931              | 0.7244          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7978            | 0.8757         | 0.8350     | 0.9649           |
| 0.0474        | 62.0  | 6572  | 0.1454          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8253           | 0.9013        | 0.8616    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7878            | 0.8787         | 0.8308     | 0.9647           |
| 0.0441        | 63.0  | 6678  | 0.1432          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6818                 | 0.7759              | 0.7258          | 58                  | 0.8364           | 0.9079        | 0.8707    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7989            | 0.8817         | 0.8383     | 0.9652           |
| 0.0449        | 64.0  | 6784  | 0.1622          | 0.8                | 0.9275          | 0.8591      | 69              | 0.5862                 | 0.8793              | 0.7034          | 58                  | 0.8166           | 0.9079        | 0.8598    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7519            | 0.8964         | 0.8178     | 0.9590           |
| 0.0452        | 65.0  | 6890  | 0.1489          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.6622                 | 0.8448              | 0.7424          | 58                  | 0.8155           | 0.9013        | 0.8562    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7859            | 0.8905         | 0.8350     | 0.9639           |
| 0.0418        | 66.0  | 6996  | 0.1543          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6712                 | 0.8448              | 0.7481          | 58                  | 0.8214           | 0.9079        | 0.8625    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7859            | 0.8905         | 0.8350     | 0.9639           |
| 0.0421        | 67.0  | 7102  | 0.1538          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6806                 | 0.8448              | 0.7538          | 58                  | 0.8204           | 0.9013        | 0.8589    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7833            | 0.8876         | 0.8322     | 0.9631           |
| 0.041         | 68.0  | 7208  | 0.1549          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6667                 | 0.8621              | 0.7519          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7807            | 0.8846         | 0.8294     | 0.9626           |
| 0.0411        | 69.0  | 7314  | 0.1511          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.6812                 | 0.8103              | 0.7402          | 58                  | 0.8193           | 0.8947        | 0.8553    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7926            | 0.8817         | 0.8347     | 0.9652           |
| 0.0414        | 70.0  | 7420  | 0.1538          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6765                 | 0.7931              | 0.7302          | 58                  | 0.8214           | 0.9079        | 0.8625    | 152           | 0.6757             | 0.8333          | 0.7463      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7775            | 0.8787         | 0.8250     | 0.9631           |
| 0.0407        | 71.0  | 7526  | 0.1484          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6667                 | 0.8276              | 0.7385          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7952            | 0.8846         | 0.8375     | 0.9649           |
| 0.0395        | 72.0  | 7632  | 0.1467          | 0.84               | 0.9130          | 0.8750      | 69              | 0.6970                 | 0.7931              | 0.7419          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.8043            | 0.8757         | 0.8385     | 0.9649           |
| 0.0388        | 73.0  | 7738  | 0.1468          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6761                 | 0.8276              | 0.7442          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7973            | 0.8846         | 0.8387     | 0.9652           |
| 0.0401        | 74.0  | 7844  | 0.1532          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6761                 | 0.8276              | 0.7442          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7931            | 0.8846         | 0.8364     | 0.9647           |
| 0.0376        | 75.0  | 7950  | 0.1554          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7857            | 0.8787         | 0.8296     | 0.9636           |
| 0.0389        | 76.0  | 8056  | 0.1553          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6712                 | 0.8448              | 0.7481          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7059             | 0.8             | 0.7500      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7868            | 0.8846         | 0.8329     | 0.9631           |
| 0.0385        | 77.0  | 8162  | 0.1526          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6806                 | 0.8448              | 0.7538          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7910            | 0.8846         | 0.8352     | 0.9644           |
| 0.0375        | 78.0  | 8268  | 0.1528          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.6620                 | 0.8103              | 0.7287          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7857            | 0.8787         | 0.8296     | 0.9639           |
| 0.0373        | 79.0  | 8374  | 0.1517          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6667                 | 0.7931              | 0.7244          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.792             | 0.8787         | 0.8331     | 0.9644           |
| 0.0375        | 80.0  | 8480  | 0.1577          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6812                 | 0.8103              | 0.7402          | 58                  | 0.8193           | 0.8947        | 0.8553    | 152           | 0.7059             | 0.8             | 0.7500      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7857            | 0.8787         | 0.8296     | 0.9639           |
| 0.0371        | 81.0  | 8586  | 0.1603          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6667                 | 0.8276              | 0.7385          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7848            | 0.8846         | 0.8317     | 0.9631           |
| 0.0364        | 82.0  | 8692  | 0.1597          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6761                 | 0.8276              | 0.7442          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7868            | 0.8846         | 0.8329     | 0.9634           |
| 0.0355        | 83.0  | 8798  | 0.1582          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7836            | 0.8787         | 0.8285     | 0.9631           |
| 0.0352        | 84.0  | 8904  | 0.1597          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6438                 | 0.8103              | 0.7176          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7728            | 0.8757         | 0.8211     | 0.9621           |
| 0.0351        | 85.0  | 9010  | 0.1546          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7899            | 0.8787         | 0.8319     | 0.9639           |
| 0.0358        | 86.0  | 9116  | 0.1546          | 0.8421             | 0.9275          | 0.8828      | 69              | 0.6479                 | 0.7931              | 0.7132          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7899            | 0.8787         | 0.8319     | 0.9639           |
| 0.0359        | 87.0  | 9222  | 0.1566          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6438                 | 0.8103              | 0.7176          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7863            | 0.8817         | 0.8312     | 0.9639           |
| 0.0338        | 88.0  | 9328  | 0.1550          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6522                 | 0.7759              | 0.7087          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7893            | 0.8757         | 0.8303     | 0.9641           |
| 0.0324        | 89.0  | 9434  | 0.1579          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6429                 | 0.7759              | 0.7031          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7810            | 0.8757         | 0.8257     | 0.9634           |
| 0.034         | 90.0  | 9540  | 0.1578          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7831            | 0.8757         | 0.8268     | 0.9639           |
| 0.0353        | 91.0  | 9646  | 0.1580          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6714                 | 0.8103              | 0.7344          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7857            | 0.8787         | 0.8296     | 0.9639           |
| 0.0325        | 92.0  | 9752  | 0.1565          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7878            | 0.8787         | 0.8308     | 0.9639           |
| 0.0344        | 93.0  | 9858  | 0.1590          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6714                 | 0.8103              | 0.7344          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7836            | 0.8787         | 0.8285     | 0.9639           |
| 0.0336        | 94.0  | 9964  | 0.1605          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6620                 | 0.8103              | 0.7287          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7059             | 0.8             | 0.7500      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7810            | 0.8757         | 0.8257     | 0.9634           |
| 0.0337        | 95.0  | 10070 | 0.1603          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6667                 | 0.7931              | 0.7244          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7857            | 0.8787         | 0.8296     | 0.9639           |
| 0.0326        | 96.0  | 10176 | 0.1594          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6429                 | 0.7759              | 0.7031          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7810            | 0.8757         | 0.8257     | 0.9634           |
| 0.0352        | 97.0  | 10282 | 0.1594          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6667                 | 0.7931              | 0.7244          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7878            | 0.8787         | 0.8308     | 0.9641           |
| 0.0329        | 98.0  | 10388 | 0.1579          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6714                 | 0.8103              | 0.7344          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7878            | 0.8787         | 0.8308     | 0.9639           |
| 0.0321        | 99.0  | 10494 | 0.1590          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6857                 | 0.8276              | 0.75            | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7884            | 0.8817         | 0.8324     | 0.9641           |
| 0.0322        | 100.0 | 10600 | 0.1597          | 0.8205             | 0.9275          | 0.8707      | 69              | 0.6714                 | 0.8103              | 0.7344          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.7836            | 0.8787         | 0.8285     | 0.9639           |


### Framework versions

- Transformers 4.40.2
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1