File size: 49,488 Bytes
ce12b4b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ef00384
 
 
 
ce12b4b
ef00384
 
 
ce12b4b
ef00384
 
 
ce12b4b
ef00384
 
 
ce12b4b
ef00384
 
 
ce12b4b
ef00384
 
 
 
ce12b4b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ef00384
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ce12b4b
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
---
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-pt-pl30-1
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-pt-pl30-1

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1730
- Location Precision: 0.7895
- Location Recall: 0.8696
- Location F1: 0.8276
- Location Number: 69
- Organization Precision: 0.6173
- Organization Recall: 0.8197
- Organization F1: 0.7042
- Organization Number: 61
- Person Precision: 0.8720
- Person Recall: 0.9346
- Person F1: 0.9022
- Person Number: 153
- Quantity Precision: 0.7429
- Quantity Recall: 0.8125
- Quantity F1: 0.7761
- Quantity Number: 32
- Time Precision: 0.8485
- Time Recall: 0.9032
- Time F1: 0.875
- Time Number: 31
- Overall Precision: 0.7892
- Overall Recall: 0.8873
- Overall F1: 0.8354
- Overall Accuracy: 0.9636

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9884        | 1.0   | 106   | 0.5702          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 61                  | 0.1852           | 0.0327        | 0.0556    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.0            | 0.0         | 0.0     | 31          | 0.1220            | 0.0145         | 0.0258     | 0.8395           |
| 0.4955        | 2.0   | 212   | 0.3472          | 0.4483             | 0.1884          | 0.2653      | 69              | 0.0333                 | 0.0164              | 0.0220          | 61                  | 0.4696           | 0.7582        | 0.5800    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.3077         | 0.2581      | 0.2807  | 31          | 0.4095            | 0.3988         | 0.4041     | 0.8935           |
| 0.3135        | 3.0   | 318   | 0.2126          | 0.5745             | 0.7826          | 0.6626      | 69              | 0.3733                 | 0.4590              | 0.4118          | 61                  | 0.7624           | 0.9020        | 0.8263    | 153           | 0.4565             | 0.6562          | 0.5385      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.6181            | 0.7717         | 0.6864     | 0.9329           |
| 0.2135        | 4.0   | 424   | 0.1868          | 0.58               | 0.8406          | 0.6864      | 69              | 0.4588                 | 0.6393              | 0.5342          | 61                  | 0.8150           | 0.9216        | 0.8650    | 153           | 0.4314             | 0.6875          | 0.5301      | 32              | 0.5909         | 0.8387      | 0.6933  | 31          | 0.6313            | 0.8266         | 0.7159     | 0.9363           |
| 0.1776        | 5.0   | 530   | 0.1490          | 0.6867             | 0.8261          | 0.75        | 69              | 0.5269                 | 0.8033              | 0.6364          | 61                  | 0.8161           | 0.9281        | 0.8685    | 153           | 0.6                | 0.75            | 0.6667      | 32              | 0.8966         | 0.8387      | 0.8667  | 31          | 0.7112            | 0.8613         | 0.7791     | 0.9510           |
| 0.1582        | 6.0   | 636   | 0.1369          | 0.6484             | 0.8551          | 0.7375      | 69              | 0.5341                 | 0.7705              | 0.6309          | 61                  | 0.8314           | 0.9346        | 0.8800    | 153           | 0.6                | 0.75            | 0.6667      | 32              | 0.8            | 0.9032      | 0.8485  | 31          | 0.7066            | 0.8699         | 0.7798     | 0.9559           |
| 0.1452        | 7.0   | 742   | 0.1393          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.5402                 | 0.7705              | 0.6351          | 61                  | 0.8353           | 0.9281        | 0.8793    | 153           | 0.6                | 0.8438          | 0.7013      | 32              | 0.8            | 0.9032      | 0.8485  | 31          | 0.7232            | 0.8757         | 0.7922     | 0.9549           |
| 0.1352        | 8.0   | 848   | 0.1316          | 0.7467             | 0.8116          | 0.7778      | 69              | 0.5732                 | 0.7705              | 0.6573          | 61                  | 0.8512           | 0.9346        | 0.8910    | 153           | 0.6410             | 0.7812          | 0.7042      | 32              | 0.6667         | 0.8387      | 0.7429  | 31          | 0.7370            | 0.8584         | 0.7931     | 0.9567           |
| 0.1268        | 9.0   | 954   | 0.1275          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.5658                 | 0.7049              | 0.6277          | 61                  | 0.8402           | 0.9281        | 0.8820    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.7338            | 0.8526         | 0.7888     | 0.9564           |
| 0.1197        | 10.0  | 1060  | 0.1243          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6053                 | 0.7541              | 0.6715          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.65               | 0.8125          | 0.7222      | 32              | 0.6842         | 0.8387      | 0.7536  | 31          | 0.7475            | 0.8642         | 0.8016     | 0.9581           |
| 0.1149        | 11.0  | 1166  | 0.1298          | 0.75               | 0.8696          | 0.8054      | 69              | 0.5854                 | 0.7869              | 0.6713          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.6                | 0.8438          | 0.7013      | 32              | 0.8            | 0.9032      | 0.8485  | 31          | 0.7512            | 0.8815         | 0.8112     | 0.9579           |
| 0.1074        | 12.0  | 1272  | 0.1298          | 0.8                | 0.8696          | 0.8333      | 69              | 0.5875                 | 0.7705              | 0.6667          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.6279             | 0.8438          | 0.72        | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7702            | 0.8815         | 0.8221     | 0.9584           |
| 0.1021        | 13.0  | 1378  | 0.1449          | 0.7564             | 0.8551          | 0.8027      | 69              | 0.53                   | 0.8689              | 0.6584          | 61                  | 0.8521           | 0.9412        | 0.8944    | 153           | 0.675              | 0.8438          | 0.75        | 32              | 0.6923         | 0.8710      | 0.7714  | 31          | 0.7277            | 0.8960         | 0.8031     | 0.9542           |
| 0.1           | 14.0  | 1484  | 0.1380          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.5833                 | 0.8033              | 0.6759          | 61                  | 0.8667           | 0.9346        | 0.8994    | 153           | 0.6429             | 0.8438          | 0.7297      | 32              | 0.675          | 0.8710      | 0.7606  | 31          | 0.7518            | 0.8844         | 0.8127     | 0.9564           |
| 0.0956        | 15.0  | 1590  | 0.1301          | 0.7532             | 0.8406          | 0.7945      | 69              | 0.6486                 | 0.7869              | 0.7111          | 61                  | 0.8834           | 0.9412        | 0.9114    | 153           | 0.675              | 0.8438          | 0.75        | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7789            | 0.8757         | 0.8245     | 0.9599           |
| 0.0952        | 16.0  | 1696  | 0.1324          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.5926                 | 0.7869              | 0.6761          | 61                  | 0.8631           | 0.9477        | 0.9034    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.8710         | 0.8710      | 0.8710  | 31          | 0.7663            | 0.8815         | 0.8199     | 0.9596           |
| 0.09          | 17.0  | 1802  | 0.1328          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.5862                 | 0.8361              | 0.6892          | 61                  | 0.8765           | 0.9281        | 0.9016    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7681            | 0.8902         | 0.8246     | 0.9591           |
| 0.0862        | 18.0  | 1908  | 0.1255          | 0.7532             | 0.8406          | 0.7945      | 69              | 0.6389                 | 0.7541              | 0.6917          | 61                  | 0.8951           | 0.9477        | 0.9206    | 153           | 0.675              | 0.8438          | 0.75        | 32              | 0.75           | 0.8710      | 0.8060  | 31          | 0.7829            | 0.8757         | 0.8267     | 0.9614           |
| 0.0825        | 19.0  | 2014  | 0.1247          | 0.76               | 0.8261          | 0.7917      | 69              | 0.6538                 | 0.8361              | 0.7338          | 61                  | 0.8667           | 0.9346        | 0.8994    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7781            | 0.8815         | 0.8266     | 0.9614           |
| 0.0814        | 20.0  | 2120  | 0.1330          | 0.7973             | 0.8551          | 0.8252      | 69              | 0.5833                 | 0.8033              | 0.6759          | 61                  | 0.8795           | 0.9542        | 0.9154    | 153           | 0.6923             | 0.8438          | 0.7606      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.7675            | 0.8873         | 0.8231     | 0.9589           |
| 0.0782        | 21.0  | 2226  | 0.1432          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6184                 | 0.7705              | 0.6861          | 61                  | 0.8683           | 0.9477        | 0.9062    | 153           | 0.6098             | 0.7812          | 0.6849      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.7531            | 0.8728         | 0.8086     | 0.9564           |
| 0.0799        | 22.0  | 2332  | 0.1451          | 0.7848             | 0.8986          | 0.8378      | 69              | 0.5354                 | 0.8689              | 0.6625          | 61                  | 0.8727           | 0.9412        | 0.9057    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7297         | 0.8710      | 0.7941  | 31          | 0.7464            | 0.9017         | 0.8168     | 0.9557           |
| 0.0756        | 23.0  | 2438  | 0.1407          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.6076                 | 0.7869              | 0.6857          | 61                  | 0.8650           | 0.9216        | 0.8924    | 153           | 0.6098             | 0.7812          | 0.6849      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7634            | 0.8671         | 0.8119     | 0.9574           |
| 0.0711        | 24.0  | 2544  | 0.1331          | 0.7733             | 0.8406          | 0.8056      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8735           | 0.9477        | 0.9091    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7722            | 0.8815         | 0.8232     | 0.9594           |
| 0.0715        | 25.0  | 2650  | 0.1326          | 0.775              | 0.8986          | 0.8322      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.9006           | 0.9477        | 0.9236    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7794            | 0.8988         | 0.8349     | 0.9623           |
| 0.0699        | 26.0  | 2756  | 0.1396          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6296                 | 0.8361              | 0.7183          | 61                  | 0.8675           | 0.9412        | 0.9028    | 153           | 0.6098             | 0.7812          | 0.6849      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7669            | 0.8844         | 0.8215     | 0.9594           |
| 0.064         | 27.0  | 2862  | 0.1338          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8683           | 0.9477        | 0.9062    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.75           | 0.8710      | 0.8060  | 31          | 0.7872            | 0.8873         | 0.8342     | 0.9628           |
| 0.066         | 28.0  | 2968  | 0.1395          | 0.7848             | 0.8986          | 0.8378      | 69              | 0.6316                 | 0.5902              | 0.6102          | 61                  | 0.8896           | 0.9477        | 0.9177    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.6923         | 0.8710      | 0.7714  | 31          | 0.7899            | 0.8584         | 0.8227     | 0.9606           |
| 0.0643        | 29.0  | 3074  | 0.1434          | 0.7625             | 0.8841          | 0.8188      | 69              | 0.6220                 | 0.8361              | 0.7133          | 61                  | 0.8735           | 0.9477        | 0.9091    | 153           | 0.75               | 0.8438          | 0.7941      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.775             | 0.8960         | 0.8311     | 0.9614           |
| 0.0613        | 30.0  | 3180  | 0.1416          | 0.7922             | 0.8841          | 0.8356      | 69              | 0.5904                 | 0.8033              | 0.6806          | 61                  | 0.8834           | 0.9412        | 0.9114    | 153           | 0.7714             | 0.8438          | 0.8060      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7852            | 0.8873         | 0.8331     | 0.9621           |
| 0.0611        | 31.0  | 3286  | 0.1443          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6184                 | 0.7705              | 0.6861          | 61                  | 0.8944           | 0.9412        | 0.9172    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7850            | 0.8757         | 0.8279     | 0.9601           |
| 0.0594        | 32.0  | 3392  | 0.1368          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8788           | 0.9477        | 0.9119    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7714         | 0.8710      | 0.8182  | 31          | 0.7772            | 0.8873         | 0.8286     | 0.9616           |
| 0.0591        | 33.0  | 3498  | 0.1401          | 0.775              | 0.8986          | 0.8322      | 69              | 0.6479                 | 0.7541              | 0.6970          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7891            | 0.8757         | 0.8301     | 0.9623           |
| 0.0586        | 34.0  | 3604  | 0.1381          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.625                  | 0.8197              | 0.7092          | 61                  | 0.8889           | 0.9412        | 0.9143    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7923            | 0.8931         | 0.8397     | 0.9631           |
| 0.0557        | 35.0  | 3710  | 0.1449          | 0.7654             | 0.8986          | 0.8267      | 69              | 0.5610                 | 0.7541              | 0.6434          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7677            | 0.8786         | 0.8194     | 0.9596           |
| 0.055         | 36.0  | 3816  | 0.1479          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.5529                 | 0.7705              | 0.6438          | 61                  | 0.8820           | 0.9281        | 0.9045    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7638            | 0.8786         | 0.8172     | 0.9594           |
| 0.0549        | 37.0  | 3922  | 0.1484          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.6024                 | 0.8197              | 0.6944          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7719            | 0.8902         | 0.8268     | 0.9606           |
| 0.0516        | 38.0  | 4028  | 0.1517          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.6486                 | 0.7869              | 0.7111          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.6667             | 0.8125          | 0.7324      | 32              | 0.7714         | 0.8710      | 0.8182  | 31          | 0.7846            | 0.8844         | 0.8315     | 0.9621           |
| 0.0525        | 39.0  | 4134  | 0.1387          | 0.7922             | 0.8841          | 0.8356      | 69              | 0.6267                 | 0.7705              | 0.6912          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7902            | 0.8815         | 0.8333     | 0.9643           |
| 0.0493        | 40.0  | 4240  | 0.1406          | 0.7922             | 0.8841          | 0.8356      | 69              | 0.6184                 | 0.7705              | 0.6861          | 61                  | 0.8834           | 0.9412        | 0.9114    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7297         | 0.8710      | 0.7941  | 31          | 0.7841            | 0.8815         | 0.8299     | 0.9628           |
| 0.0498        | 41.0  | 4346  | 0.1392          | 0.8026             | 0.8841          | 0.8414      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8727           | 0.9412        | 0.9057    | 153           | 0.7027             | 0.8125          | 0.7536      | 32              | 0.8710         | 0.8710      | 0.8710  | 31          | 0.7938            | 0.8902         | 0.8392     | 0.9631           |
| 0.048         | 42.0  | 4452  | 0.1464          | 0.8133             | 0.8841          | 0.8472      | 69              | 0.5854                 | 0.7869              | 0.6713          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7812         | 0.8065      | 0.7937  | 31          | 0.7758            | 0.8699         | 0.8202     | 0.9599           |
| 0.0514        | 43.0  | 4558  | 0.1435          | 0.7308             | 0.8261          | 0.7755      | 69              | 0.6316                 | 0.7869              | 0.7007          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7760            | 0.8613         | 0.8164     | 0.9596           |
| 0.0482        | 44.0  | 4664  | 0.1486          | 0.7654             | 0.8986          | 0.8267      | 69              | 0.625                  | 0.8197              | 0.7092          | 61                  | 0.8727           | 0.9412        | 0.9057    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7733            | 0.8873         | 0.8264     | 0.9604           |
| 0.0453        | 45.0  | 4770  | 0.1501          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6125                 | 0.8033              | 0.6950          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.6857             | 0.75            | 0.7164      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7763            | 0.8728         | 0.8218     | 0.9596           |
| 0.0444        | 46.0  | 4876  | 0.1433          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.6                    | 0.7869              | 0.6809          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.8710         | 0.8710      | 0.8710  | 31          | 0.7835            | 0.8786         | 0.8283     | 0.9633           |
| 0.0428        | 47.0  | 4982  | 0.1480          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.5679                 | 0.7541              | 0.6479          | 61                  | 0.8773           | 0.9346        | 0.9051    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7763            | 0.8728         | 0.8218     | 0.9616           |
| 0.0416        | 48.0  | 5088  | 0.1479          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.6184                 | 0.7705              | 0.6861          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.65               | 0.8125          | 0.7222      | 32              | 0.8387         | 0.8387      | 0.8387  | 31          | 0.7809            | 0.8757         | 0.8256     | 0.9619           |
| 0.0434        | 49.0  | 5194  | 0.1513          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6104                 | 0.7705              | 0.6812          | 61                  | 0.8667           | 0.9346        | 0.8994    | 153           | 0.7105             | 0.8438          | 0.7714      | 32              | 0.7778         | 0.9032      | 0.8358  | 31          | 0.7801            | 0.8815         | 0.8277     | 0.9619           |
| 0.0421        | 50.0  | 5300  | 0.1492          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.6234                 | 0.7869              | 0.6957          | 61                  | 0.8727           | 0.9412        | 0.9057    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7861            | 0.8815         | 0.8311     | 0.9614           |
| 0.0423        | 51.0  | 5406  | 0.1473          | 0.8026             | 0.8841          | 0.8414      | 69              | 0.6296                 | 0.8361              | 0.7183          | 61                  | 0.8788           | 0.9477        | 0.9119    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7949            | 0.8960         | 0.8424     | 0.9646           |
| 0.0421        | 52.0  | 5512  | 0.1539          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.5833                 | 0.8033              | 0.6759          | 61                  | 0.8773           | 0.9346        | 0.9051    | 153           | 0.75               | 0.8438          | 0.7941      | 32              | 0.8387         | 0.8387      | 0.8387  | 31          | 0.7821            | 0.8815         | 0.8288     | 0.9614           |
| 0.0415        | 53.0  | 5618  | 0.1545          | 0.7662             | 0.8551          | 0.8082      | 69              | 0.5854                 | 0.7869              | 0.6713          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7775            | 0.8786         | 0.8250     | 0.9621           |
| 0.0396        | 54.0  | 5724  | 0.1586          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.5952                 | 0.8197              | 0.6897          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7755            | 0.8786         | 0.8238     | 0.9631           |
| 0.0375        | 55.0  | 5830  | 0.1563          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.6                    | 0.7869              | 0.6809          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7763            | 0.8728         | 0.8218     | 0.9601           |
| 0.0379        | 56.0  | 5936  | 0.1533          | 0.7867             | 0.8551          | 0.8194      | 69              | 0.5679                 | 0.7541              | 0.6479          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7297             | 0.8438          | 0.7826      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7732            | 0.8671         | 0.8174     | 0.9614           |
| 0.0354        | 57.0  | 6042  | 0.1612          | 0.7922             | 0.8841          | 0.8356      | 69              | 0.5897                 | 0.7541              | 0.6619          | 61                  | 0.8667           | 0.9346        | 0.8994    | 153           | 0.6842             | 0.8125          | 0.7429      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7769            | 0.8757         | 0.8234     | 0.9604           |
| 0.0363        | 58.0  | 6148  | 0.1525          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.5663                 | 0.7705              | 0.6528          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.75               | 0.8438          | 0.7941      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7749            | 0.8757         | 0.8223     | 0.9623           |
| 0.0333        | 59.0  | 6254  | 0.1588          | 0.7722             | 0.8841          | 0.8243      | 69              | 0.6104                 | 0.7705              | 0.6812          | 61                  | 0.8727           | 0.9412        | 0.9057    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7789            | 0.8757         | 0.8245     | 0.9619           |
| 0.0352        | 60.0  | 6360  | 0.1654          | 0.7625             | 0.8841          | 0.8188      | 69              | 0.5647                 | 0.7869              | 0.6575          | 61                  | 0.8773           | 0.9346        | 0.9051    | 153           | 0.7353             | 0.7812          | 0.7576      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7696            | 0.8786         | 0.8205     | 0.9611           |
| 0.035         | 61.0  | 6466  | 0.1560          | 0.7838             | 0.8406          | 0.8112      | 69              | 0.5875                 | 0.7705              | 0.6667          | 61                  | 0.8667           | 0.9346        | 0.8994    | 153           | 0.7576             | 0.7812          | 0.7692      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7792            | 0.8671         | 0.8208     | 0.9619           |
| 0.0326        | 62.0  | 6572  | 0.1644          | 0.7922             | 0.8841          | 0.8356      | 69              | 0.5783                 | 0.7869              | 0.6667          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.7353             | 0.7812          | 0.7576      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7755            | 0.8786         | 0.8238     | 0.9619           |
| 0.0329        | 63.0  | 6678  | 0.1641          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6                    | 0.7869              | 0.6809          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.7568         | 0.9032      | 0.8235  | 31          | 0.7749            | 0.8757         | 0.8223     | 0.9616           |
| 0.0335        | 64.0  | 6784  | 0.1627          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.6125                 | 0.8033              | 0.6950          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7861            | 0.8815         | 0.8311     | 0.9638           |
| 0.0322        | 65.0  | 6890  | 0.1623          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.5949                 | 0.7705              | 0.6714          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7809            | 0.8757         | 0.8256     | 0.9621           |
| 0.0332        | 66.0  | 6996  | 0.1601          | 0.8026             | 0.8841          | 0.8414      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.75               | 0.8438          | 0.7941      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7872            | 0.8873         | 0.8342     | 0.9631           |
| 0.0327        | 67.0  | 7102  | 0.1585          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6125                 | 0.8033              | 0.6950          | 61                  | 0.8765           | 0.9281        | 0.9016    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7917            | 0.8786         | 0.8329     | 0.9616           |
| 0.0327        | 68.0  | 7208  | 0.1642          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7857            | 0.8902         | 0.8347     | 0.9626           |
| 0.0331        | 69.0  | 7314  | 0.1594          | 0.8219             | 0.8696          | 0.8451      | 69              | 0.6234                 | 0.7869              | 0.6957          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7891            | 0.8757         | 0.8301     | 0.9619           |
| 0.0311        | 70.0  | 7420  | 0.1673          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6026                 | 0.7705              | 0.6763          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7824            | 0.8728         | 0.8251     | 0.9606           |
| 0.0302        | 71.0  | 7526  | 0.1654          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7861            | 0.8815         | 0.8311     | 0.9626           |
| 0.0276        | 72.0  | 7632  | 0.1676          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6125                 | 0.8033              | 0.6950          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7876            | 0.8786         | 0.8306     | 0.9636           |
| 0.0304        | 73.0  | 7738  | 0.1573          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.6026                 | 0.7705              | 0.6763          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.875          | 0.9032      | 0.8889  | 31          | 0.7911            | 0.8757         | 0.8313     | 0.9651           |
| 0.029         | 74.0  | 7844  | 0.1682          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6                    | 0.7869              | 0.6809          | 61                  | 0.8765           | 0.9281        | 0.9016    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8387         | 0.8387      | 0.8387  | 31          | 0.7885            | 0.8728         | 0.8285     | 0.9626           |
| 0.0293        | 75.0  | 7950  | 0.1699          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.6                    | 0.7869              | 0.6809          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7855            | 0.8786         | 0.8295     | 0.9623           |
| 0.0292        | 76.0  | 8056  | 0.1714          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7852            | 0.8873         | 0.8331     | 0.9626           |
| 0.0292        | 77.0  | 8162  | 0.1613          | 0.8                | 0.8696          | 0.8333      | 69              | 0.5949                 | 0.7705              | 0.6714          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.7353             | 0.7812          | 0.7576      | 32              | 0.8710         | 0.8710      | 0.8710  | 31          | 0.7859            | 0.8699         | 0.8258     | 0.9631           |
| 0.0259        | 78.0  | 8268  | 0.1647          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.6154                 | 0.7869              | 0.6906          | 61                  | 0.8773           | 0.9346        | 0.9051    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8529         | 0.9355      | 0.8923  | 31          | 0.7907            | 0.8844         | 0.8349     | 0.9638           |
| 0.0274        | 79.0  | 8374  | 0.1649          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6104                 | 0.7705              | 0.6812          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.7353             | 0.7812          | 0.7576      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7906            | 0.8728         | 0.8297     | 0.9636           |
| 0.0269        | 80.0  | 8480  | 0.1669          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.5875                 | 0.7705              | 0.6667          | 61                  | 0.8780           | 0.9412        | 0.9085    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7815            | 0.8786         | 0.8272     | 0.9636           |
| 0.028         | 81.0  | 8586  | 0.1671          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.5949                 | 0.7705              | 0.6714          | 61                  | 0.8614           | 0.9346        | 0.8966    | 153           | 0.7059             | 0.75            | 0.7273      | 32              | 0.8            | 0.9032      | 0.8485  | 31          | 0.7724            | 0.8728         | 0.8195     | 0.9621           |
| 0.0279        | 82.0  | 8692  | 0.1679          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7775            | 0.8786         | 0.8250     | 0.9623           |
| 0.0258        | 83.0  | 8798  | 0.1649          | 0.8219             | 0.8696          | 0.8451      | 69              | 0.625                  | 0.8197              | 0.7092          | 61                  | 0.8773           | 0.9346        | 0.9051    | 153           | 0.7647             | 0.8125          | 0.7879      | 32              | 0.875          | 0.9032      | 0.8889  | 31          | 0.8037            | 0.8873         | 0.8434     | 0.9643           |
| 0.0272        | 84.0  | 8904  | 0.1686          | 0.8                | 0.8696          | 0.8333      | 69              | 0.625                  | 0.8197              | 0.7092          | 61                  | 0.8773           | 0.9346        | 0.9051    | 153           | 0.7143             | 0.7812          | 0.7463      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7907            | 0.8844         | 0.8349     | 0.9636           |
| 0.0261        | 85.0  | 9010  | 0.1691          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7866            | 0.8844         | 0.8327     | 0.9641           |
| 0.0254        | 86.0  | 9116  | 0.1746          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.5926                 | 0.7869              | 0.6761          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7941         | 0.8710      | 0.8308  | 31          | 0.7761            | 0.8815         | 0.8254     | 0.9623           |
| 0.028         | 87.0  | 9222  | 0.1669          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.5854                 | 0.7869              | 0.6713          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7714             | 0.8438          | 0.8060      | 32              | 0.875          | 0.9032      | 0.8889  | 31          | 0.7902            | 0.8815         | 0.8333     | 0.9648           |
| 0.0244        | 88.0  | 9328  | 0.1714          | 0.8026             | 0.8841          | 0.8414      | 69              | 0.6049                 | 0.8033              | 0.6901          | 61                  | 0.8773           | 0.9346        | 0.9051    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.7907            | 0.8844         | 0.8349     | 0.9636           |
| 0.0241        | 89.0  | 9434  | 0.1706          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.5802                 | 0.7705              | 0.6620          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7353             | 0.7812          | 0.7576      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7844            | 0.8728         | 0.8263     | 0.9631           |
| 0.0243        | 90.0  | 9540  | 0.1695          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.5897                 | 0.7541              | 0.6619          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.7353             | 0.7812          | 0.7576      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7848            | 0.8642         | 0.8226     | 0.9628           |
| 0.0275        | 91.0  | 9646  | 0.1680          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.5854                 | 0.7869              | 0.6713          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8125         | 0.8387      | 0.8254  | 31          | 0.7829            | 0.8757         | 0.8267     | 0.9638           |
| 0.0255        | 92.0  | 9752  | 0.1681          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8387         | 0.8387      | 0.8387  | 31          | 0.7876            | 0.8786         | 0.8306     | 0.9633           |
| 0.0263        | 93.0  | 9858  | 0.1713          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.7714             | 0.8438          | 0.8060      | 32              | 0.8387         | 0.8387      | 0.8387  | 31          | 0.7881            | 0.8815         | 0.8322     | 0.9633           |
| 0.0241        | 94.0  | 9964  | 0.1685          | 0.8                | 0.8696          | 0.8333      | 69              | 0.5854                 | 0.7869              | 0.6713          | 61                  | 0.8606           | 0.9281        | 0.8931    | 153           | 0.7714             | 0.8438          | 0.8060      | 32              | 0.8387         | 0.8387      | 0.8387  | 31          | 0.7809            | 0.8757         | 0.8256     | 0.9636           |
| 0.0226        | 95.0  | 10070 | 0.1730          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.6098                 | 0.8197              | 0.6993          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7714             | 0.8438          | 0.8060      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.7872            | 0.8873         | 0.8342     | 0.9641           |
| 0.0255        | 96.0  | 10176 | 0.1723          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.5904                 | 0.8033              | 0.6806          | 61                  | 0.8667           | 0.9346        | 0.8994    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7786            | 0.8844         | 0.8281     | 0.9633           |
| 0.0235        | 97.0  | 10282 | 0.1719          | 0.8108             | 0.8696          | 0.8392      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8667           | 0.9346        | 0.8994    | 153           | 0.7714             | 0.8438          | 0.8060      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7918            | 0.8902         | 0.8381     | 0.9646           |
| 0.0247        | 98.0  | 10388 | 0.1728          | 0.8                | 0.8696          | 0.8333      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7714             | 0.8438          | 0.8060      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7938            | 0.8902         | 0.8392     | 0.9643           |
| 0.0249        | 99.0  | 10494 | 0.1731          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7892            | 0.8873         | 0.8354     | 0.9636           |
| 0.0219        | 100.0 | 10600 | 0.1730          | 0.7895             | 0.8696          | 0.8276      | 69              | 0.6173                 | 0.8197              | 0.7042          | 61                  | 0.8720           | 0.9346        | 0.9022    | 153           | 0.7429             | 0.8125          | 0.7761      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7892            | 0.8873         | 0.8354     | 0.9636           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2