File size: 49,484 Bytes
a3a2494
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e19778b
 
 
 
6c07654
e19778b
 
 
6c07654
e19778b
 
 
6c07654
 
 
 
 
e19778b
 
 
6c07654
e19778b
 
 
 
a3a2494
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6c07654
a3a2494
 
 
6c07654
 
e19778b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
a3a2494
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
---
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-lora-r8-4
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-lora-r8-4

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1361
- Location Precision: 0.7470
- Location Recall: 0.8493
- Location F1: 0.7949
- Location Number: 73
- Organization Precision: 0.6667
- Organization Recall: 0.8308
- Organization F1: 0.7397
- Organization Number: 65
- Person Precision: 0.8466
- Person Recall: 0.92
- Person F1: 0.8818
- Person Number: 150
- Quantity Precision: 0.6111
- Quantity Recall: 0.7586
- Quantity F1: 0.6769
- Quantity Number: 29
- Time Precision: 0.7317
- Time Recall: 0.8824
- Time F1: 0.8
- Time Number: 34
- Overall Precision: 0.7574
- Overall Recall: 0.8718
- Overall F1: 0.8106
- Overall Accuracy: 0.9564

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.2587        | 1.0   | 106   | 0.7307          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.0              | 0.0           | 0.0       | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.0               | 0.0            | 0.0        | 0.8366           |
| 0.7063        | 2.0   | 212   | 0.6230          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.1667           | 0.0067        | 0.0128    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.1429            | 0.0028         | 0.0056     | 0.8376           |
| 0.612         | 3.0   | 318   | 0.5286          | 0.3333             | 0.0137          | 0.0263      | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.3158           | 0.04          | 0.0710    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.2121            | 0.0199         | 0.0365     | 0.8437           |
| 0.5187        | 4.0   | 424   | 0.4289          | 0.5833             | 0.0959          | 0.1647      | 73              | 0.0769                 | 0.0154              | 0.0256          | 65                  | 0.3542           | 0.2267        | 0.2764    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.3889         | 0.2059      | 0.2692  | 34          | 0.3525            | 0.1396         | 0.2        | 0.8700           |
| 0.4206        | 5.0   | 530   | 0.3427          | 0.5                | 0.3425          | 0.4065      | 73              | 0.3590                 | 0.2154              | 0.2692          | 65                  | 0.6626           | 0.72          | 0.6901    | 150           | 0.125              | 0.0345          | 0.0541      | 29              | 0.6061         | 0.5882      | 0.5970  | 34          | 0.5734            | 0.4786         | 0.5217     | 0.9094           |
| 0.3388        | 6.0   | 636   | 0.2868          | 0.5366             | 0.6027          | 0.5677      | 73              | 0.4091                 | 0.4154              | 0.4122          | 65                  | 0.7181           | 0.9           | 0.7988    | 150           | 0.375              | 0.4138          | 0.3934      | 29              | 0.6842         | 0.7647      | 0.7222  | 34          | 0.6010            | 0.6952         | 0.6446     | 0.9271           |
| 0.2819        | 7.0   | 742   | 0.2395          | 0.5333             | 0.6575          | 0.5890      | 73              | 0.3867                 | 0.4462              | 0.4143          | 65                  | 0.7514           | 0.9067        | 0.8218    | 150           | 0.4                | 0.4828          | 0.4375      | 29              | 0.6923         | 0.7941      | 0.7397  | 34          | 0.6048            | 0.7236         | 0.6589     | 0.9308           |
| 0.2487        | 8.0   | 848   | 0.2158          | 0.5851             | 0.7534          | 0.6587      | 73              | 0.4375                 | 0.5385              | 0.4828          | 65                  | 0.7640           | 0.9067        | 0.8293    | 150           | 0.3824             | 0.4483          | 0.4127      | 29              | 0.675          | 0.7941      | 0.7297  | 34          | 0.6244            | 0.7578         | 0.6847     | 0.9363           |
| 0.2255        | 9.0   | 954   | 0.2009          | 0.6211             | 0.8082          | 0.7024      | 73              | 0.4667                 | 0.6462              | 0.5419          | 65                  | 0.7816           | 0.9067        | 0.8395    | 150           | 0.4062             | 0.4483          | 0.4262      | 29              | 0.6341         | 0.7647      | 0.6933  | 34          | 0.6389            | 0.7863         | 0.7050     | 0.9375           |
| 0.2062        | 10.0  | 1060  | 0.1921          | 0.6630             | 0.8356          | 0.7394      | 73              | 0.4946                 | 0.7077              | 0.5823          | 65                  | 0.7667           | 0.92          | 0.8364    | 150           | 0.5                | 0.5517          | 0.5246      | 29              | 0.7            | 0.8235      | 0.7568  | 34          | 0.6613            | 0.8234         | 0.7335     | 0.9419           |
| 0.1965        | 11.0  | 1166  | 0.1852          | 0.625              | 0.8219          | 0.7101      | 73              | 0.4898                 | 0.7385              | 0.5890          | 65                  | 0.7697           | 0.9133        | 0.8354    | 150           | 0.5                | 0.6207          | 0.5538      | 29              | 0.6512         | 0.8235      | 0.7273  | 34          | 0.6452            | 0.8291         | 0.7257     | 0.9397           |
| 0.1818        | 12.0  | 1272  | 0.1794          | 0.6598             | 0.8767          | 0.7529      | 73              | 0.4848                 | 0.7385              | 0.5854          | 65                  | 0.7861           | 0.9067        | 0.8421    | 150           | 0.4474             | 0.5862          | 0.5075      | 29              | 0.6444         | 0.8529      | 0.7342  | 34          | 0.6504            | 0.8376         | 0.7323     | 0.9419           |
| 0.1747        | 13.0  | 1378  | 0.1656          | 0.6813             | 0.8493          | 0.7561      | 73              | 0.5393                 | 0.7385              | 0.6234          | 65                  | 0.7771           | 0.9067        | 0.8369    | 150           | 0.5588             | 0.6552          | 0.6032      | 29              | 0.7179         | 0.8235      | 0.7671  | 34          | 0.6846            | 0.8348         | 0.7522     | 0.9468           |
| 0.1723        | 14.0  | 1484  | 0.1645          | 0.7045             | 0.8493          | 0.7702      | 73              | 0.5                    | 0.7538              | 0.6012          | 65                  | 0.8              | 0.9067        | 0.8500    | 150           | 0.5                | 0.6207          | 0.5538      | 29              | 0.6364         | 0.8235      | 0.7179  | 34          | 0.6720            | 0.8348         | 0.7446     | 0.9456           |
| 0.1626        | 15.0  | 1590  | 0.1666          | 0.6632             | 0.8630          | 0.75        | 73              | 0.5053                 | 0.7385              | 0.6             | 65                  | 0.7953           | 0.9067        | 0.8474    | 150           | 0.5                | 0.6552          | 0.5672      | 29              | 0.6818         | 0.8824      | 0.7692  | 34          | 0.6682            | 0.8433         | 0.7456     | 0.9441           |
| 0.1582        | 16.0  | 1696  | 0.1590          | 0.6630             | 0.8356          | 0.7394      | 73              | 0.5455                 | 0.7385              | 0.6275          | 65                  | 0.8047           | 0.9067        | 0.8527    | 150           | 0.5789             | 0.7586          | 0.6567      | 29              | 0.6591         | 0.8529      | 0.7436  | 34          | 0.6868            | 0.8433         | 0.7570     | 0.9473           |
| 0.1556        | 17.0  | 1802  | 0.1609          | 0.6889             | 0.8493          | 0.7607      | 73              | 0.5161                 | 0.7385              | 0.6076          | 65                  | 0.8              | 0.9067        | 0.8500    | 150           | 0.5526             | 0.7241          | 0.6269      | 29              | 0.6818         | 0.8824      | 0.7692  | 34          | 0.6828            | 0.8462         | 0.7557     | 0.9471           |
| 0.1521        | 18.0  | 1908  | 0.1528          | 0.7045             | 0.8493          | 0.7702      | 73              | 0.5333                 | 0.7385              | 0.6194          | 65                  | 0.8155           | 0.9133        | 0.8616    | 150           | 0.5676             | 0.7241          | 0.6364      | 29              | 0.7209         | 0.9118      | 0.8052  | 34          | 0.7019            | 0.8519         | 0.7696     | 0.9498           |
| 0.1507        | 19.0  | 2014  | 0.1536          | 0.7126             | 0.8493          | 0.7750      | 73              | 0.5319                 | 0.7692              | 0.6289          | 65                  | 0.8036           | 0.9           | 0.8491    | 150           | 0.5405             | 0.6897          | 0.6061      | 29              | 0.7209         | 0.9118      | 0.8052  | 34          | 0.6946            | 0.8490         | 0.7641     | 0.9491           |
| 0.1426        | 20.0  | 2120  | 0.1492          | 0.7126             | 0.8493          | 0.7750      | 73              | 0.5542                 | 0.7077              | 0.6216          | 65                  | 0.8133           | 0.9           | 0.8544    | 150           | 0.5135             | 0.6552          | 0.5758      | 29              | 0.7209         | 0.9118      | 0.8052  | 34          | 0.7043            | 0.8348         | 0.7640     | 0.9500           |
| 0.1406        | 21.0  | 2226  | 0.1474          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5595                 | 0.7231              | 0.6309          | 65                  | 0.8024           | 0.8933        | 0.8454    | 150           | 0.5405             | 0.6897          | 0.6061      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7074            | 0.8405         | 0.7682     | 0.9525           |
| 0.1375        | 22.0  | 2332  | 0.1531          | 0.6923             | 0.8630          | 0.7683      | 73              | 0.5213                 | 0.7538              | 0.6164          | 65                  | 0.8              | 0.9067        | 0.8500    | 150           | 0.5676             | 0.7241          | 0.6364      | 29              | 0.7209         | 0.9118      | 0.8052  | 34          | 0.6897            | 0.8547         | 0.7634     | 0.9478           |
| 0.1359        | 23.0  | 2438  | 0.1470          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.5484                 | 0.7846              | 0.6456          | 65                  | 0.8144           | 0.9067        | 0.8580    | 150           | 0.5676             | 0.7241          | 0.6364      | 29              | 0.7442         | 0.9412      | 0.8312  | 34          | 0.7106            | 0.8604         | 0.7784     | 0.9527           |
| 0.1326        | 24.0  | 2544  | 0.1508          | 0.7191             | 0.8767          | 0.7901      | 73              | 0.5506                 | 0.7538              | 0.6364          | 65                  | 0.8242           | 0.9067        | 0.8635    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7209         | 0.9118      | 0.8052  | 34          | 0.7139            | 0.8604         | 0.7804     | 0.9518           |
| 0.1278        | 25.0  | 2650  | 0.1543          | 0.7                | 0.8630          | 0.7730      | 73              | 0.5319                 | 0.7692              | 0.6289          | 65                  | 0.8242           | 0.9067        | 0.8635    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7209         | 0.9118      | 0.8052  | 34          | 0.7047            | 0.8632         | 0.7759     | 0.9493           |
| 0.1302        | 26.0  | 2756  | 0.1448          | 0.7176             | 0.8356          | 0.7722      | 73              | 0.5357                 | 0.6923              | 0.6040          | 65                  | 0.8133           | 0.9           | 0.8544    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7209         | 0.9118      | 0.8052  | 34          | 0.7077            | 0.8348         | 0.7660     | 0.9505           |
| 0.1266        | 27.0  | 2862  | 0.1450          | 0.7093             | 0.8356          | 0.7673      | 73              | 0.5595                 | 0.7231              | 0.6309          | 65                  | 0.8354           | 0.9133        | 0.8726    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7215            | 0.8490         | 0.7801     | 0.9527           |
| 0.1244        | 28.0  | 2968  | 0.1475          | 0.6889             | 0.8493          | 0.7607      | 73              | 0.5698                 | 0.7538              | 0.6490          | 65                  | 0.8354           | 0.9133        | 0.8726    | 150           | 0.5789             | 0.7586          | 0.6567      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.7126            | 0.8547         | 0.7772     | 0.9520           |
| 0.1223        | 29.0  | 3074  | 0.1505          | 0.7111             | 0.8767          | 0.7853      | 73              | 0.5506                 | 0.7538              | 0.6364          | 65                  | 0.8354           | 0.9133        | 0.8726    | 150           | 0.5676             | 0.7241          | 0.6364      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.7116            | 0.8575         | 0.7778     | 0.9508           |
| 0.1216        | 30.0  | 3180  | 0.1403          | 0.7176             | 0.8356          | 0.7722      | 73              | 0.5823                 | 0.7077              | 0.6389          | 65                  | 0.8242           | 0.9067        | 0.8635    | 150           | 0.5882             | 0.6897          | 0.6349      | 29              | 0.8205         | 0.9412      | 0.8767  | 34          | 0.7338            | 0.8405         | 0.7835     | 0.9537           |
| 0.1197        | 31.0  | 3286  | 0.1418          | 0.7093             | 0.8356          | 0.7673      | 73              | 0.5732                 | 0.7231              | 0.6395          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6286             | 0.7586          | 0.6875      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7328            | 0.8519         | 0.7879     | 0.9535           |
| 0.1175        | 32.0  | 3392  | 0.1450          | 0.7126             | 0.8493          | 0.7750      | 73              | 0.5682                 | 0.7692              | 0.6536          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7225            | 0.8604         | 0.7854     | 0.9527           |
| 0.1178        | 33.0  | 3498  | 0.1420          | 0.7126             | 0.8493          | 0.7750      | 73              | 0.5529                 | 0.7231              | 0.6267          | 65                  | 0.8242           | 0.9067        | 0.8635    | 150           | 0.6571             | 0.7931          | 0.7188      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7222            | 0.8519         | 0.7817     | 0.9520           |
| 0.1142        | 34.0  | 3604  | 0.1420          | 0.7126             | 0.8493          | 0.7750      | 73              | 0.5663                 | 0.7231              | 0.6351          | 65                  | 0.8354           | 0.9133        | 0.8726    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7257            | 0.8519         | 0.7837     | 0.9532           |
| 0.1159        | 35.0  | 3710  | 0.1450          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5647                 | 0.7385              | 0.64            | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6154             | 0.8276          | 0.7059      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7266            | 0.8632         | 0.7891     | 0.9532           |
| 0.1131        | 36.0  | 3816  | 0.1435          | 0.7079             | 0.8630          | 0.7778      | 73              | 0.5698                 | 0.7538              | 0.6490          | 65                  | 0.8405           | 0.9133        | 0.8754    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7260            | 0.8604         | 0.7875     | 0.9540           |
| 0.113         | 37.0  | 3922  | 0.1523          | 0.7045             | 0.8493          | 0.7702      | 73              | 0.5306                 | 0.8                 | 0.6380          | 65                  | 0.8155           | 0.9133        | 0.8616    | 150           | 0.5641             | 0.7586          | 0.6471      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.6950            | 0.8632         | 0.7700     | 0.9493           |
| 0.1122        | 38.0  | 4028  | 0.1412          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.5949                 | 0.7231              | 0.6528          | 65                  | 0.8204           | 0.9133        | 0.8644    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7268            | 0.8490         | 0.7832     | 0.9535           |
| 0.1097        | 39.0  | 4134  | 0.1437          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5495                 | 0.7692              | 0.6410          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7187            | 0.8661         | 0.7855     | 0.9532           |
| 0.1098        | 40.0  | 4240  | 0.1413          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.5698                 | 0.7538              | 0.6490          | 65                  | 0.8354           | 0.9133        | 0.8726    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7236            | 0.8575         | 0.7849     | 0.9540           |
| 0.1078        | 41.0  | 4346  | 0.1426          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.5765                 | 0.7538              | 0.6533          | 65                  | 0.8232           | 0.9           | 0.8599    | 150           | 0.5789             | 0.7586          | 0.6567      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7222            | 0.8519         | 0.7817     | 0.9535           |
| 0.1095        | 42.0  | 4452  | 0.1465          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5435                 | 0.7692              | 0.6369          | 65                  | 0.8282           | 0.9           | 0.8626    | 150           | 0.525              | 0.7241          | 0.6087      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7052            | 0.8519         | 0.7716     | 0.9525           |
| 0.1082        | 43.0  | 4558  | 0.1410          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.5854                 | 0.7385              | 0.6531          | 65                  | 0.8253           | 0.9133        | 0.8671    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7246            | 0.8547         | 0.7843     | 0.9542           |
| 0.1065        | 44.0  | 4664  | 0.1387          | 0.7326             | 0.8630          | 0.7925      | 73              | 0.5854                 | 0.7385              | 0.6531          | 65                  | 0.8193           | 0.9067        | 0.8608    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7257            | 0.8519         | 0.7837     | 0.9542           |
| 0.1058        | 45.0  | 4770  | 0.1392          | 0.7442             | 0.8767          | 0.8050      | 73              | 0.5976                 | 0.7538              | 0.6667          | 65                  | 0.8263           | 0.92          | 0.8707    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7354            | 0.8632         | 0.7942     | 0.9555           |
| 0.1033        | 46.0  | 4876  | 0.1364          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.5854                 | 0.7385              | 0.6531          | 65                  | 0.8395           | 0.9067        | 0.8718    | 150           | 0.6                | 0.7241          | 0.6562      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7333            | 0.8462         | 0.7857     | 0.9542           |
| 0.1057        | 47.0  | 4982  | 0.1411          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5765                 | 0.7538              | 0.6533          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7249            | 0.8632         | 0.7880     | 0.9547           |
| 0.1062        | 48.0  | 5088  | 0.1432          | 0.7442             | 0.8767          | 0.8050      | 73              | 0.6049                 | 0.7538              | 0.6712          | 65                  | 0.8323           | 0.9267        | 0.8770    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7367            | 0.8689         | 0.7974     | 0.9547           |
| 0.1006        | 49.0  | 5194  | 0.1407          | 0.7326             | 0.8630          | 0.7925      | 73              | 0.5976                 | 0.7538              | 0.6667          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7348            | 0.8604         | 0.7927     | 0.9552           |
| 0.1004        | 50.0  | 5300  | 0.1403          | 0.7442             | 0.8767          | 0.8050      | 73              | 0.5814                 | 0.7692              | 0.6623          | 65                  | 0.8373           | 0.9267        | 0.8797    | 150           | 0.5676             | 0.7241          | 0.6364      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7290            | 0.8661         | 0.7917     | 0.9545           |
| 0.1004        | 51.0  | 5406  | 0.1399          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.5833                 | 0.7538              | 0.6577          | 65                  | 0.8313           | 0.92          | 0.8734    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7246            | 0.8547         | 0.7843     | 0.9545           |
| 0.1           | 52.0  | 5512  | 0.1423          | 0.7326             | 0.8630          | 0.7925      | 73              | 0.5904                 | 0.7538              | 0.6622          | 65                  | 0.8313           | 0.92          | 0.8734    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7284            | 0.8632         | 0.7901     | 0.9542           |
| 0.099         | 53.0  | 5618  | 0.1469          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.5368                 | 0.7846              | 0.6375          | 65                  | 0.8303           | 0.9133        | 0.8698    | 150           | 0.575              | 0.7931          | 0.6667      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.7063            | 0.8632         | 0.7769     | 0.9525           |
| 0.0966        | 54.0  | 5724  | 0.1407          | 0.7093             | 0.8356          | 0.7673      | 73              | 0.5667                 | 0.7846              | 0.6581          | 65                  | 0.8293           | 0.9067        | 0.8662    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7177            | 0.8547         | 0.7802     | 0.9527           |
| 0.0993        | 55.0  | 5830  | 0.1426          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.5532                 | 0.8                 | 0.6541          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.5641             | 0.7586          | 0.6471      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7170            | 0.8661         | 0.7845     | 0.9540           |
| 0.0987        | 56.0  | 5936  | 0.1403          | 0.7126             | 0.8493          | 0.7750      | 73              | 0.5862                 | 0.7846              | 0.6711          | 65                  | 0.8373           | 0.9267        | 0.8797    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7290            | 0.8661         | 0.7917     | 0.9547           |
| 0.0994        | 57.0  | 6042  | 0.1433          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.5474                 | 0.8                 | 0.65            | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7238            | 0.8661         | 0.7886     | 0.9530           |
| 0.0975        | 58.0  | 6148  | 0.1404          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.5714                 | 0.8                 | 0.6667          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7308            | 0.8661         | 0.7927     | 0.9540           |
| 0.0976        | 59.0  | 6254  | 0.1359          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6145                 | 0.7846              | 0.6892          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7445            | 0.8632         | 0.7995     | 0.9562           |
| 0.0964        | 60.0  | 6360  | 0.1385          | 0.7176             | 0.8356          | 0.7722      | 73              | 0.6190                 | 0.8                 | 0.6980          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7372            | 0.8632         | 0.7953     | 0.9557           |
| 0.0954        | 61.0  | 6466  | 0.1355          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6190                 | 0.8                 | 0.6980          | 65                  | 0.8395           | 0.9067        | 0.8718    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7420            | 0.8604         | 0.7968     | 0.9555           |
| 0.0938        | 62.0  | 6572  | 0.1392          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8405           | 0.9133        | 0.8754    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7481            | 0.8632         | 0.8016     | 0.9559           |
| 0.0935        | 63.0  | 6678  | 0.1419          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6023                 | 0.8154              | 0.6928          | 65                  | 0.8303           | 0.9133        | 0.8698    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7325            | 0.8661         | 0.7937     | 0.9542           |
| 0.0943        | 64.0  | 6784  | 0.1351          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8373           | 0.9267        | 0.8797    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7537            | 0.8718         | 0.8085     | 0.9572           |
| 0.093         | 65.0  | 6890  | 0.1373          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.6463                 | 0.8154              | 0.7211          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7457            | 0.8689         | 0.8026     | 0.9555           |
| 0.0922        | 66.0  | 6996  | 0.1363          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6341                 | 0.8                 | 0.7075          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7518            | 0.8718         | 0.8074     | 0.9569           |
| 0.0912        | 67.0  | 7102  | 0.1376          | 0.75               | 0.8630          | 0.8025      | 73              | 0.6463                 | 0.8154              | 0.7211          | 65                  | 0.8405           | 0.9133        | 0.8754    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7494            | 0.8689         | 0.8047     | 0.9557           |
| 0.0908        | 68.0  | 7208  | 0.1389          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6386                 | 0.8154              | 0.7162          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7488            | 0.8661         | 0.8032     | 0.9559           |
| 0.0905        | 69.0  | 7314  | 0.1376          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.75              | 0.8718         | 0.8063     | 0.9564           |
| 0.0913        | 70.0  | 7420  | 0.1340          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.6296                 | 0.7846              | 0.6986          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7481            | 0.8632         | 0.8016     | 0.9564           |
| 0.0916        | 71.0  | 7526  | 0.1396          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6136                 | 0.8308              | 0.7059          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7458            | 0.8775         | 0.8063     | 0.9552           |
| 0.0902        | 72.0  | 7632  | 0.1355          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7556            | 0.8718         | 0.8095     | 0.9569           |
| 0.0912        | 73.0  | 7738  | 0.1356          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7556            | 0.8718         | 0.8095     | 0.9567           |
| 0.0892        | 74.0  | 7844  | 0.1321          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6364                 | 0.7538              | 0.6901          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7569            | 0.8604         | 0.8053     | 0.9567           |
| 0.0895        | 75.0  | 7950  | 0.1352          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6456                 | 0.7846              | 0.7083          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7587            | 0.8689         | 0.8101     | 0.9562           |
| 0.0905        | 76.0  | 8056  | 0.1348          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7543            | 0.8661         | 0.8064     | 0.9562           |
| 0.0895        | 77.0  | 8162  | 0.1344          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7612            | 0.8718         | 0.8127     | 0.9572           |
| 0.0882        | 78.0  | 8268  | 0.1357          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7618            | 0.8746         | 0.8143     | 0.9574           |
| 0.0877        | 79.0  | 8374  | 0.1407          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6364                 | 0.8615              | 0.7320          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7464            | 0.8803         | 0.8078     | 0.9562           |
| 0.0876        | 80.0  | 8480  | 0.1383          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7543            | 0.8746         | 0.8100     | 0.9562           |
| 0.0865        | 81.0  | 8586  | 0.1364          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7624            | 0.8775         | 0.8159     | 0.9572           |
| 0.0882        | 82.0  | 8692  | 0.1346          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7605            | 0.8775         | 0.8148     | 0.9572           |
| 0.0868        | 83.0  | 8798  | 0.1371          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7568            | 0.8775         | 0.8127     | 0.9569           |
| 0.0884        | 84.0  | 8904  | 0.1361          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7605            | 0.8775         | 0.8148     | 0.9574           |
| 0.088         | 85.0  | 9010  | 0.1368          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7580            | 0.8746         | 0.8122     | 0.9572           |
| 0.0869        | 86.0  | 9116  | 0.1348          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7599            | 0.8746         | 0.8132     | 0.9574           |
| 0.0861        | 87.0  | 9222  | 0.1350          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7624            | 0.8775         | 0.8159     | 0.9577           |
| 0.0853        | 88.0  | 9328  | 0.1359          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7624            | 0.8775         | 0.8159     | 0.9572           |
| 0.0873        | 89.0  | 9434  | 0.1357          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7643            | 0.8775         | 0.8170     | 0.9574           |
| 0.0869        | 90.0  | 9540  | 0.1345          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7643            | 0.8775         | 0.8170     | 0.9577           |
| 0.0855        | 91.0  | 9646  | 0.1360          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6429                 | 0.8308              | 0.7248          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7586            | 0.8775         | 0.8137     | 0.9567           |
| 0.0863        | 92.0  | 9752  | 0.1356          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7624            | 0.8775         | 0.8159     | 0.9572           |
| 0.0858        | 93.0  | 9858  | 0.1360          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7624            | 0.8775         | 0.8159     | 0.9572           |
| 0.0857        | 94.0  | 9964  | 0.1353          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7643            | 0.8775         | 0.8170     | 0.9574           |
| 0.0862        | 95.0  | 10070 | 0.1362          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7599            | 0.8746         | 0.8132     | 0.9569           |
| 0.0864        | 96.0  | 10176 | 0.1357          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7599            | 0.8746         | 0.8132     | 0.9567           |
| 0.0849        | 97.0  | 10282 | 0.1357          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7599            | 0.8746         | 0.8132     | 0.9567           |
| 0.0836        | 98.0  | 10388 | 0.1361          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7574            | 0.8718         | 0.8106     | 0.9564           |
| 0.0831        | 99.0  | 10494 | 0.1360          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7574            | 0.8718         | 0.8106     | 0.9567           |
| 0.085         | 100.0 | 10600 | 0.1361          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7574            | 0.8718         | 0.8106     | 0.9564           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2