File size: 49,498 Bytes
a48c2f5
2888896
 
a48c2f5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-pt-pl5-4
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-pt-pl5-4

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1743
- Location Precision: 0.7778
- Location Recall: 0.8630
- Location F1: 0.8182
- Location Number: 73
- Organization Precision: 0.7037
- Organization Recall: 0.8769
- Organization F1: 0.7808
- Organization Number: 65
- Person Precision: 0.8734
- Person Recall: 0.92
- Person F1: 0.8961
- Person Number: 150
- Quantity Precision: 0.6857
- Quantity Recall: 0.8276
- Quantity F1: 0.75
- Quantity Number: 29
- Time Precision: 0.7073
- Time Recall: 0.8529
- Time F1: 0.7733
- Time Number: 34
- Overall Precision: 0.7854
- Overall Recall: 0.8860
- Overall F1: 0.8327
- Overall Accuracy: 0.9589

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.965         | 1.0   | 106   | 0.5562          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.2308           | 0.08          | 0.1188    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.3333         | 0.0294      | 0.0541  | 34          | 0.1806            | 0.0370         | 0.0615     | 0.8457           |
| 0.4705        | 2.0   | 212   | 0.3254          | 0.4167             | 0.2055          | 0.2752      | 73              | 0.0732                 | 0.0462              | 0.0566          | 65                  | 0.6010           | 0.8333        | 0.6983    | 150           | 0.2381             | 0.1724          | 0.2000      | 29              | 0.5581         | 0.7059      | 0.6234  | 34          | 0.4928            | 0.4900         | 0.4914     | 0.9030           |
| 0.2979        | 3.0   | 318   | 0.2105          | 0.5152             | 0.6986          | 0.5930      | 73              | 0.4605                 | 0.5385              | 0.4965          | 65                  | 0.7586           | 0.88          | 0.8148    | 150           | 0.4390             | 0.6207          | 0.5143      | 29              | 0.6579         | 0.7353      | 0.6944  | 34          | 0.6098            | 0.7436         | 0.6701     | 0.9345           |
| 0.2203        | 4.0   | 424   | 0.1712          | 0.6341             | 0.7123          | 0.6710      | 73              | 0.4423                 | 0.7077              | 0.5444          | 65                  | 0.8084           | 0.9           | 0.8517    | 150           | 0.5294             | 0.6207          | 0.5714      | 29              | 0.8788         | 0.8529      | 0.8657  | 34          | 0.6667            | 0.7977         | 0.7263     | 0.9439           |
| 0.19          | 5.0   | 530   | 0.1546          | 0.6875             | 0.7534          | 0.7190      | 73              | 0.5495                 | 0.7692              | 0.6410          | 65                  | 0.8293           | 0.9067        | 0.8662    | 150           | 0.525              | 0.7241          | 0.6087      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7053            | 0.8319         | 0.7634     | 0.9513           |
| 0.1692        | 6.0   | 636   | 0.1692          | 0.6180             | 0.7534          | 0.6790      | 73              | 0.5437                 | 0.8615              | 0.6667          | 65                  | 0.8323           | 0.9267        | 0.8770    | 150           | 0.5333             | 0.8276          | 0.6486      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.6771            | 0.8604         | 0.7578     | 0.9441           |
| 0.1547        | 7.0   | 742   | 0.1435          | 0.6707             | 0.7534          | 0.7097      | 73              | 0.5926                 | 0.7385              | 0.6575          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7320            | 0.8405         | 0.7825     | 0.9527           |
| 0.1459        | 8.0   | 848   | 0.1405          | 0.6774             | 0.8630          | 0.7590      | 73              | 0.5934                 | 0.8308              | 0.6923          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6667             | 0.8276          | 0.7385      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7346            | 0.8832         | 0.8021     | 0.9550           |
| 0.1372        | 9.0   | 954   | 0.1369          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.5914                 | 0.8462              | 0.6962          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7482            | 0.8803         | 0.8089     | 0.9559           |
| 0.1324        | 10.0  | 1060  | 0.1358          | 0.7564             | 0.8082          | 0.7815      | 73              | 0.6207                 | 0.8308              | 0.7105          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7537            | 0.8632         | 0.8048     | 0.9555           |
| 0.123         | 11.0  | 1166  | 0.1410          | 0.7403             | 0.7808          | 0.7600      | 73              | 0.6582                 | 0.8                 | 0.7222          | 65                  | 0.8589           | 0.9333        | 0.8946    | 150           | 0.5854             | 0.8276          | 0.6857      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7594            | 0.8632         | 0.808      | 0.9574           |
| 0.1175        | 12.0  | 1272  | 0.1413          | 0.6977             | 0.8219          | 0.7547      | 73              | 0.6463                 | 0.8154              | 0.7211          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7408            | 0.8632         | 0.7974     | 0.9567           |
| 0.1117        | 13.0  | 1378  | 0.1335          | 0.7763             | 0.8082          | 0.7919      | 73              | 0.6429                 | 0.8308              | 0.7248          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6316             | 0.8276          | 0.7164      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7663            | 0.8689         | 0.8144     | 0.9594           |
| 0.1119        | 14.0  | 1484  | 0.1401          | 0.7531             | 0.8356          | 0.7922      | 73              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.6667             | 0.8276          | 0.7385      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7630            | 0.8803         | 0.8175     | 0.9601           |
| 0.1091        | 15.0  | 1590  | 0.1297          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.6180                 | 0.8462              | 0.7143          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7838         | 0.8529      | 0.8169  | 34          | 0.77              | 0.8775         | 0.8202     | 0.9601           |
| 0.1012        | 16.0  | 1696  | 0.1470          | 0.775              | 0.8493          | 0.8105      | 73              | 0.6386                 | 0.8154              | 0.7162          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.5814             | 0.8621          | 0.6944      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7475            | 0.8689         | 0.8037     | 0.9540           |
| 0.0994        | 17.0  | 1802  | 0.1348          | 0.7625             | 0.8356          | 0.7974      | 73              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6765             | 0.7931          | 0.7302      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7714            | 0.8746         | 0.8198     | 0.9601           |
| 0.0963        | 18.0  | 1908  | 0.1387          | 0.7692             | 0.8219          | 0.7947      | 73              | 0.5773                 | 0.8615              | 0.6914          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7549            | 0.8775         | 0.8116     | 0.9572           |
| 0.0929        | 19.0  | 2014  | 0.1284          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8671           | 0.9133        | 0.8896    | 150           | 0.7188             | 0.7931          | 0.7541      | 29              | 0.7895         | 0.8824      | 0.8333  | 34          | 0.7823            | 0.8803         | 0.8284     | 0.9623           |
| 0.0925        | 20.0  | 2120  | 0.1409          | 0.7654             | 0.8493          | 0.8052      | 73              | 0.6235                 | 0.8154              | 0.7067          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6410             | 0.8621          | 0.7353      | 29              | 0.8108         | 0.8824      | 0.8451  | 34          | 0.7643            | 0.8775         | 0.8170     | 0.9591           |
| 0.0864        | 21.0  | 2226  | 0.1323          | 0.7531             | 0.8356          | 0.7922      | 73              | 0.6588                 | 0.8615              | 0.7467          | 65                  | 0.8782           | 0.9133        | 0.8954    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7692         | 0.8824      | 0.8219  | 34          | 0.7797            | 0.8775         | 0.8257     | 0.9626           |
| 0.0907        | 22.0  | 2332  | 0.1398          | 0.7531             | 0.8356          | 0.7922      | 73              | 0.6477                 | 0.8769              | 0.7451          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7635            | 0.8832         | 0.8190     | 0.9604           |
| 0.0852        | 23.0  | 2438  | 0.1318          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7823            | 0.8803         | 0.8284     | 0.9628           |
| 0.0837        | 24.0  | 2544  | 0.1401          | 0.775              | 0.8493          | 0.8105      | 73              | 0.6154                 | 0.8615              | 0.7179          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7273             | 0.8276          | 0.7742      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7706            | 0.8803         | 0.8218     | 0.9601           |
| 0.0826        | 25.0  | 2650  | 0.1459          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.7073                 | 0.8923              | 0.7891          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7854            | 0.8860         | 0.8327     | 0.9611           |
| 0.082         | 26.0  | 2756  | 0.1394          | 0.7662             | 0.8082          | 0.7867      | 73              | 0.6437                 | 0.8615              | 0.7368          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7949         | 0.9118      | 0.8493  | 34          | 0.7783            | 0.8803         | 0.8262     | 0.9609           |
| 0.0787        | 27.0  | 2862  | 0.1452          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.6395                 | 0.8462              | 0.7285          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.575              | 0.7931          | 0.6667      | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7562            | 0.8746         | 0.8111     | 0.9577           |
| 0.0797        | 28.0  | 2968  | 0.1434          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.7179                 | 0.8615              | 0.7832          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7188             | 0.7931          | 0.7541      | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7918            | 0.8775         | 0.8324     | 0.9614           |
| 0.0743        | 29.0  | 3074  | 0.1394          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.6744                 | 0.8923              | 0.7682          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.75               | 0.8276          | 0.7869      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7899            | 0.8889         | 0.8365     | 0.9623           |
| 0.0748        | 30.0  | 3180  | 0.1398          | 0.7922             | 0.8356          | 0.8133      | 73              | 0.6627                 | 0.8462              | 0.7432          | 65                  | 0.8553           | 0.9067        | 0.8803    | 150           | 0.6970             | 0.7931          | 0.7419      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7755            | 0.8661         | 0.8183     | 0.9591           |
| 0.0749        | 31.0  | 3286  | 0.1454          | 0.7922             | 0.8356          | 0.8133      | 73              | 0.7                    | 0.8615              | 0.7724          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7817            | 0.8775         | 0.8268     | 0.9596           |
| 0.0702        | 32.0  | 3392  | 0.1507          | 0.7975             | 0.8630          | 0.8289      | 73              | 0.6593                 | 0.9231              | 0.7692          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7748            | 0.8917         | 0.8291     | 0.9582           |
| 0.0687        | 33.0  | 3498  | 0.1462          | 0.7692             | 0.8219          | 0.7947      | 73              | 0.7143                 | 0.8462              | 0.7746          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7872            | 0.8746         | 0.8286     | 0.9601           |
| 0.0718        | 34.0  | 3604  | 0.1472          | 0.8052             | 0.8493          | 0.8267      | 73              | 0.6744                 | 0.8923              | 0.7682          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7828            | 0.8832         | 0.8300     | 0.9609           |
| 0.0696        | 35.0  | 3710  | 0.1485          | 0.7625             | 0.8356          | 0.7974      | 73              | 0.6941                 | 0.9077              | 0.7867          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.6667             | 0.8276          | 0.7385      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7786            | 0.8917         | 0.8313     | 0.9604           |
| 0.0681        | 36.0  | 3816  | 0.1446          | 0.8289             | 0.8630          | 0.8456      | 73              | 0.6742                 | 0.9231              | 0.7792          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.6364         | 0.8235      | 0.7179  | 34          | 0.7753            | 0.8946         | 0.8307     | 0.9599           |
| 0.0666        | 37.0  | 3922  | 0.1545          | 0.7821             | 0.8356          | 0.8079      | 73              | 0.6383                 | 0.9231              | 0.7547          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.6512         | 0.8235      | 0.7273  | 34          | 0.7585            | 0.8860         | 0.8173     | 0.9567           |
| 0.0666        | 38.0  | 4028  | 0.1448          | 0.8243             | 0.8356          | 0.8299      | 73              | 0.7308                 | 0.8769              | 0.7972          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.8               | 0.8775         | 0.8370     | 0.9619           |
| 0.0642        | 39.0  | 4134  | 0.1475          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.6977                 | 0.9231              | 0.7947          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.7812             | 0.8621          | 0.8197      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7915            | 0.8974         | 0.8411     | 0.9616           |
| 0.0653        | 40.0  | 4240  | 0.1560          | 0.8205             | 0.8767          | 0.8477      | 73              | 0.6122                 | 0.9231              | 0.7362          | 65                  | 0.8774           | 0.9067        | 0.8918    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7709            | 0.8917         | 0.8269     | 0.9579           |
| 0.0621        | 41.0  | 4346  | 0.1489          | 0.7821             | 0.8356          | 0.8079      | 73              | 0.6477                 | 0.8769              | 0.7451          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7576             | 0.8621          | 0.8065      | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7744            | 0.8803         | 0.824      | 0.9589           |
| 0.0621        | 42.0  | 4452  | 0.1464          | 0.7949             | 0.8493          | 0.8212      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.6512         | 0.8235      | 0.7273  | 34          | 0.7828            | 0.8832         | 0.8300     | 0.9611           |
| 0.059         | 43.0  | 4558  | 0.1482          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.7215                 | 0.8769              | 0.7917          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7812            | 0.8746         | 0.8253     | 0.9601           |
| 0.061         | 44.0  | 4664  | 0.1558          | 0.8052             | 0.8493          | 0.8267      | 73              | 0.725                  | 0.8923              | 0.8             | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6667             | 0.8276          | 0.7385      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7854            | 0.8860         | 0.8327     | 0.9604           |
| 0.0623        | 45.0  | 4770  | 0.1500          | 0.8077             | 0.8630          | 0.8344      | 73              | 0.7333                 | 0.8462              | 0.7857          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7984            | 0.8803         | 0.8374     | 0.9631           |
| 0.0585        | 46.0  | 4876  | 0.1510          | 0.8182             | 0.8630          | 0.8400      | 73              | 0.7143                 | 0.8462              | 0.7746          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7887            | 0.8718         | 0.8281     | 0.9621           |
| 0.0546        | 47.0  | 4982  | 0.1553          | 0.7949             | 0.8493          | 0.8212      | 73              | 0.6552                 | 0.8769              | 0.75            | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.775             | 0.8832         | 0.8256     | 0.9604           |
| 0.0581        | 48.0  | 5088  | 0.1582          | 0.775              | 0.8493          | 0.8105      | 73              | 0.6786                 | 0.8769              | 0.7651          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6667             | 0.8276          | 0.7385      | 29              | 0.7179         | 0.8235      | 0.7671  | 34          | 0.7719            | 0.8775         | 0.8213     | 0.9594           |
| 0.0569        | 49.0  | 5194  | 0.1614          | 0.7949             | 0.8493          | 0.8212      | 73              | 0.7125                 | 0.8769              | 0.7862          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.6970             | 0.7931          | 0.7419      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7949            | 0.8832         | 0.8367     | 0.9619           |
| 0.0569        | 50.0  | 5300  | 0.1571          | 0.7922             | 0.8356          | 0.8133      | 73              | 0.6897                 | 0.9231              | 0.7895          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7273             | 0.8276          | 0.7742      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7854            | 0.8860         | 0.8327     | 0.9599           |
| 0.0534        | 51.0  | 5406  | 0.1557          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.7361                 | 0.8154              | 0.7737          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7841            | 0.8689         | 0.8243     | 0.9616           |
| 0.0546        | 52.0  | 5512  | 0.1739          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.6522                 | 0.9231              | 0.7643          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.6905         | 0.8529      | 0.7632  | 34          | 0.7628            | 0.8889         | 0.8211     | 0.9545           |
| 0.0508        | 53.0  | 5618  | 0.1671          | 0.7949             | 0.8493          | 0.8212      | 73              | 0.6484                 | 0.9077              | 0.7564          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7632         | 0.8529      | 0.8056  | 34          | 0.7723            | 0.8889         | 0.8265     | 0.9550           |
| 0.0534        | 54.0  | 5724  | 0.1676          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.6413                 | 0.9077              | 0.7516          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7696            | 0.8946         | 0.8274     | 0.9557           |
| 0.0543        | 55.0  | 5830  | 0.1557          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.6951                 | 0.8769              | 0.7755          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7803            | 0.8803         | 0.8273     | 0.9599           |
| 0.0517        | 56.0  | 5936  | 0.1615          | 0.7949             | 0.8493          | 0.8212      | 73              | 0.7089                 | 0.8615              | 0.7778          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7837            | 0.8775         | 0.8280     | 0.9599           |
| 0.0512        | 57.0  | 6042  | 0.1632          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.7273                 | 0.8615              | 0.7887          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7832            | 0.8746         | 0.8264     | 0.9601           |
| 0.0522        | 58.0  | 6148  | 0.1610          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.6829                 | 0.8615              | 0.7619          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7789            | 0.8832         | 0.8278     | 0.9579           |
| 0.05          | 59.0  | 6254  | 0.1726          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6486             | 0.8276          | 0.7273      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7694            | 0.8746         | 0.8187     | 0.9567           |
| 0.0505        | 60.0  | 6360  | 0.1542          | 0.7821             | 0.8356          | 0.8079      | 73              | 0.7534                 | 0.8462              | 0.7971          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7995            | 0.8746         | 0.8354     | 0.9621           |
| 0.0479        | 61.0  | 6466  | 0.1623          | 0.7821             | 0.8356          | 0.8079      | 73              | 0.6860                 | 0.9077              | 0.7815          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7834            | 0.8860         | 0.8316     | 0.9599           |
| 0.0481        | 62.0  | 6572  | 0.1683          | 0.7722             | 0.8356          | 0.8026      | 73              | 0.6782                 | 0.9077              | 0.7763          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.78              | 0.8889         | 0.8309     | 0.9584           |
| 0.047         | 63.0  | 6678  | 0.1563          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.7108                 | 0.9077              | 0.7973          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7179         | 0.8235      | 0.7671  | 34          | 0.7904            | 0.8917         | 0.8380     | 0.9614           |
| 0.0483        | 64.0  | 6784  | 0.1606          | 0.8052             | 0.8493          | 0.8267      | 73              | 0.7160                 | 0.8923              | 0.7945          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7980            | 0.8889         | 0.8410     | 0.9616           |
| 0.0454        | 65.0  | 6890  | 0.1621          | 0.8077             | 0.8630          | 0.8344      | 73              | 0.7532                 | 0.8923              | 0.8169          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.8041            | 0.8889         | 0.8444     | 0.9626           |
| 0.046         | 66.0  | 6996  | 0.1635          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.7024                 | 0.9077              | 0.7919          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7949            | 0.8946         | 0.8418     | 0.9619           |
| 0.0451        | 67.0  | 7102  | 0.1660          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.6941                 | 0.9077              | 0.7867          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.785             | 0.8946         | 0.8362     | 0.9604           |
| 0.0436        | 68.0  | 7208  | 0.1605          | 0.8052             | 0.8493          | 0.8267      | 73              | 0.7160                 | 0.8923              | 0.7945          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7883            | 0.8803         | 0.8318     | 0.9614           |
| 0.043         | 69.0  | 7314  | 0.1672          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7859            | 0.8889         | 0.8342     | 0.9582           |
| 0.0424        | 70.0  | 7420  | 0.1644          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.6951                 | 0.8769              | 0.7755          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6970             | 0.7931          | 0.7419      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7848            | 0.8832         | 0.8311     | 0.9606           |
| 0.0469        | 71.0  | 7526  | 0.1667          | 0.7975             | 0.8630          | 0.8289      | 73              | 0.6744                 | 0.8923              | 0.7682          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7859            | 0.8889         | 0.8342     | 0.9604           |
| 0.0409        | 72.0  | 7632  | 0.1714          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7769            | 0.8832         | 0.8267     | 0.9594           |
| 0.0437        | 73.0  | 7738  | 0.1682          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7843            | 0.8803         | 0.8295     | 0.9591           |
| 0.0411        | 74.0  | 7844  | 0.1627          | 0.775              | 0.8493          | 0.8105      | 73              | 0.7333                 | 0.8462              | 0.7857          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6765             | 0.7931          | 0.7302      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7953            | 0.8746         | 0.8331     | 0.9611           |
| 0.0432        | 75.0  | 7950  | 0.1737          | 0.7949             | 0.8493          | 0.8212      | 73              | 0.6556                 | 0.9077              | 0.7613          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6765             | 0.7931          | 0.7302      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.78              | 0.8889         | 0.8309     | 0.9589           |
| 0.0398        | 76.0  | 8056  | 0.1650          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.6824                 | 0.8923              | 0.7733          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7429             | 0.8966          | 0.8125      | 29              | 0.7436         | 0.8529      | 0.7945  | 34          | 0.7884            | 0.8917         | 0.8369     | 0.9609           |
| 0.0392        | 77.0  | 8162  | 0.1677          | 0.775              | 0.8493          | 0.8105      | 73              | 0.7089                 | 0.8615              | 0.7778          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7903            | 0.8803         | 0.8329     | 0.9604           |
| 0.0404        | 78.0  | 8268  | 0.1741          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7059             | 0.8276          | 0.7619      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7854            | 0.8860         | 0.8327     | 0.9591           |
| 0.0414        | 79.0  | 8374  | 0.1812          | 0.775              | 0.8493          | 0.8105      | 73              | 0.7                    | 0.8615              | 0.7724          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7764            | 0.8803         | 0.8251     | 0.9577           |
| 0.0401        | 80.0  | 8480  | 0.1722          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7739            | 0.8775         | 0.8224     | 0.9577           |
| 0.041         | 81.0  | 8586  | 0.1709          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.6786                 | 0.8769              | 0.7651          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7273             | 0.8276          | 0.7742      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.7828            | 0.8832         | 0.8300     | 0.9596           |
| 0.0405        | 82.0  | 8692  | 0.1678          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.7179                 | 0.8615              | 0.7832          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7843            | 0.8803         | 0.8295     | 0.9594           |
| 0.0398        | 83.0  | 8798  | 0.1709          | 0.7848             | 0.8493          | 0.8158      | 73              | 0.6962                 | 0.8462              | 0.7639          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.7273             | 0.8276          | 0.7742      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7832            | 0.8746         | 0.8264     | 0.9587           |
| 0.04          | 84.0  | 8904  | 0.1728          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.7024                 | 0.9077              | 0.7919          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7845            | 0.8917         | 0.8347     | 0.9579           |
| 0.0404        | 85.0  | 9010  | 0.1716          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.6786                 | 0.8769              | 0.7651          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7756            | 0.8860         | 0.8271     | 0.9587           |
| 0.0364        | 86.0  | 9116  | 0.1696          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.7308                 | 0.8769              | 0.7972          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6667             | 0.8276          | 0.7385      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7873            | 0.8860         | 0.8338     | 0.9609           |
| 0.0377        | 87.0  | 9222  | 0.1743          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.6706                 | 0.8769              | 0.76            | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.775             | 0.8832         | 0.8256     | 0.9582           |
| 0.0379        | 88.0  | 9328  | 0.1730          | 0.775              | 0.8493          | 0.8105      | 73              | 0.6951                 | 0.8769              | 0.7755          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7854            | 0.8860         | 0.8327     | 0.9594           |
| 0.0375        | 89.0  | 9434  | 0.1742          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.6829         | 0.8235      | 0.7467  | 34          | 0.7809            | 0.8832         | 0.8289     | 0.9584           |
| 0.0385        | 90.0  | 9540  | 0.1698          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.7089                 | 0.8615              | 0.7778          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7843            | 0.8803         | 0.8295     | 0.9591           |
| 0.036         | 91.0  | 9646  | 0.1780          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.6588                 | 0.8615              | 0.7467          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7731            | 0.8832         | 0.8245     | 0.9577           |
| 0.0377        | 92.0  | 9752  | 0.1737          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7879            | 0.8889         | 0.8353     | 0.9596           |
| 0.0391        | 93.0  | 9858  | 0.1770          | 0.775              | 0.8493          | 0.8105      | 73              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7809            | 0.8832         | 0.8289     | 0.9587           |
| 0.0362        | 94.0  | 9964  | 0.1727          | 0.7875             | 0.8630          | 0.8235      | 73              | 0.7089                 | 0.8615              | 0.7778          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.6667         | 0.8235      | 0.7368  | 34          | 0.7888            | 0.8832         | 0.8333     | 0.9589           |
| 0.0372        | 95.0  | 10070 | 0.1736          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7353             | 0.8621          | 0.7937      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7899            | 0.8889         | 0.8365     | 0.9591           |
| 0.0358        | 96.0  | 10176 | 0.1743          | 0.775              | 0.8493          | 0.8105      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7848            | 0.8832         | 0.8311     | 0.9589           |
| 0.0363        | 97.0  | 10282 | 0.1726          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.7125                 | 0.8769              | 0.7862          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7899            | 0.8889         | 0.8365     | 0.9599           |
| 0.0354        | 98.0  | 10388 | 0.1751          | 0.775              | 0.8493          | 0.8105      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7848            | 0.8832         | 0.8311     | 0.9587           |
| 0.0347        | 99.0  | 10494 | 0.1746          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7143             | 0.8621          | 0.7813      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7879            | 0.8889         | 0.8353     | 0.9591           |
| 0.0355        | 100.0 | 10600 | 0.1743          | 0.7778             | 0.8630          | 0.8182      | 73              | 0.7037                 | 0.8769              | 0.7808          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6857             | 0.8276          | 0.75        | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7854            | 0.8860         | 0.8327     | 0.9589           |


### Framework versions

- Transformers 4.40.2
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1