File size: 49,503 Bytes
a3a2494
e31c03e
 
a3a2494
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6c07654
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
a3a2494
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6c07654
a3a2494
 
 
6c07654
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
a3a2494
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-lora-r8-4
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-lora-r8-4

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1318
- Location Precision: 0.7349
- Location Recall: 0.8356
- Location F1: 0.7821
- Location Number: 73
- Organization Precision: 0.6623
- Organization Recall: 0.7846
- Organization F1: 0.7183
- Organization Number: 65
- Person Precision: 0.8634
- Person Recall: 0.9267
- Person F1: 0.8939
- Person Number: 150
- Quantity Precision: 0.6111
- Quantity Recall: 0.7586
- Quantity F1: 0.6769
- Quantity Number: 29
- Time Precision: 0.775
- Time Recall: 0.9118
- Time F1: 0.8378
- Time Number: 34
- Overall Precision: 0.7657
- Overall Recall: 0.8661
- Overall F1: 0.8128
- Overall Accuracy: 0.9587

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.2491        | 1.0   | 106   | 0.7289          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.0              | 0.0           | 0.0       | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.0               | 0.0            | 0.0        | 0.8366           |
| 0.7042        | 2.0   | 212   | 0.6215          | 0.0                | 0.0             | 0.0         | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.1667           | 0.0067        | 0.0128    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.1429            | 0.0028         | 0.0056     | 0.8376           |
| 0.6157        | 3.0   | 318   | 0.5324          | 0.3333             | 0.0137          | 0.0263      | 73              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.25             | 0.0333        | 0.0588    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.0            | 0.0         | 0.0     | 34          | 0.1714            | 0.0171         | 0.0311     | 0.8437           |
| 0.5215        | 4.0   | 424   | 0.4347          | 0.6364             | 0.0959          | 0.1667      | 73              | 0.0667                 | 0.0154              | 0.025           | 65                  | 0.4              | 0.2533        | 0.3102    | 150           | 0.0                | 0.0             | 0.0         | 29              | 0.3889         | 0.2059      | 0.2692  | 34          | 0.3813            | 0.1510         | 0.2163     | 0.8708           |
| 0.4311        | 5.0   | 530   | 0.3518          | 0.5238             | 0.3014          | 0.3826      | 73              | 0.2759                 | 0.1231              | 0.1702          | 65                  | 0.6              | 0.62          | 0.6098    | 150           | 0.125              | 0.0345          | 0.0541      | 29              | 0.6364         | 0.6176      | 0.6269  | 34          | 0.5431            | 0.4131         | 0.4693     | 0.9048           |
| 0.3468        | 6.0   | 636   | 0.2931          | 0.5                | 0.5342          | 0.5166      | 73              | 0.3968                 | 0.3846              | 0.3906          | 65                  | 0.7              | 0.8867        | 0.7824    | 150           | 0.3871             | 0.4138          | 0.4000      | 29              | 0.625          | 0.7353      | 0.6757  | 34          | 0.5821            | 0.6667         | 0.6215     | 0.9237           |
| 0.2867        | 7.0   | 742   | 0.2470          | 0.5730             | 0.6986          | 0.6296      | 73              | 0.4051                 | 0.4923              | 0.4444          | 65                  | 0.7405           | 0.9133        | 0.8179    | 150           | 0.3889             | 0.4828          | 0.4308      | 29              | 0.65           | 0.7647      | 0.7027  | 34          | 0.6061            | 0.7407         | 0.6667     | 0.9328           |
| 0.2534        | 8.0   | 848   | 0.2196          | 0.5778             | 0.7123          | 0.6380      | 73              | 0.4675                 | 0.5538              | 0.5070          | 65                  | 0.7598           | 0.9067        | 0.8267    | 150           | 0.4118             | 0.4828          | 0.4444      | 29              | 0.6341         | 0.7647      | 0.6933  | 34          | 0.6271            | 0.7521         | 0.6839     | 0.9355           |
| 0.225         | 9.0   | 954   | 0.1991          | 0.6556             | 0.8082          | 0.7239      | 73              | 0.4824                 | 0.6308              | 0.5467          | 65                  | 0.7740           | 0.9133        | 0.8379    | 150           | 0.4118             | 0.4828          | 0.4444      | 29              | 0.675          | 0.7941      | 0.7297  | 34          | 0.6526            | 0.7920         | 0.7156     | 0.9404           |
| 0.2073        | 10.0  | 1060  | 0.1878          | 0.6667             | 0.8219          | 0.7362      | 73              | 0.5119                 | 0.6615              | 0.5772          | 65                  | 0.7727           | 0.9067        | 0.8344    | 150           | 0.4545             | 0.5172          | 0.4839      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.6690            | 0.8063         | 0.7313     | 0.9422           |
| 0.1928        | 11.0  | 1166  | 0.1793          | 0.6526             | 0.8493          | 0.7381      | 73              | 0.5114                 | 0.6923              | 0.5882          | 65                  | 0.7697           | 0.9133        | 0.8354    | 150           | 0.4474             | 0.5862          | 0.5075      | 29              | 0.6905         | 0.8529      | 0.7632  | 34          | 0.6576            | 0.8262         | 0.7323     | 0.9427           |
| 0.1834        | 12.0  | 1272  | 0.1778          | 0.6526             | 0.8493          | 0.7381      | 73              | 0.5217                 | 0.7385              | 0.6115          | 65                  | 0.7771           | 0.9067        | 0.8369    | 150           | 0.4737             | 0.6207          | 0.5373      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.6652            | 0.8376         | 0.7415     | 0.9429           |
| 0.172         | 13.0  | 1378  | 0.1679          | 0.6667             | 0.8493          | 0.7470      | 73              | 0.5341                 | 0.7231              | 0.6144          | 65                  | 0.7861           | 0.9067        | 0.8421    | 150           | 0.4872             | 0.6552          | 0.5588      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.6759            | 0.8376         | 0.7481     | 0.9459           |
| 0.171         | 14.0  | 1484  | 0.1659          | 0.6966             | 0.8493          | 0.7654      | 73              | 0.5543                 | 0.7846              | 0.6497          | 65                  | 0.7895           | 0.9           | 0.8411    | 150           | 0.4872             | 0.6552          | 0.5588      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.6843            | 0.8462         | 0.7567     | 0.9456           |
| 0.1631        | 15.0  | 1590  | 0.1693          | 0.6495             | 0.8630          | 0.7412      | 73              | 0.5455                 | 0.7385              | 0.6275          | 65                  | 0.7965           | 0.9133        | 0.8509    | 150           | 0.5526             | 0.7241          | 0.6269      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.6826            | 0.8519         | 0.7579     | 0.9451           |
| 0.1579        | 16.0  | 1696  | 0.1637          | 0.6632             | 0.8630          | 0.75        | 73              | 0.5393                 | 0.7385              | 0.6234          | 65                  | 0.8095           | 0.9067        | 0.8553    | 150           | 0.525              | 0.7241          | 0.6087      | 29              | 0.6818         | 0.8824      | 0.7692  | 34          | 0.6835            | 0.8490         | 0.7573     | 0.9476           |
| 0.1558        | 17.0  | 1802  | 0.1595          | 0.7                | 0.8630          | 0.7730      | 73              | 0.5319                 | 0.7692              | 0.6289          | 65                  | 0.8              | 0.9067        | 0.8500    | 150           | 0.5                | 0.6897          | 0.5797      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.6842            | 0.8519         | 0.7589     | 0.9486           |
| 0.15          | 18.0  | 1908  | 0.1526          | 0.7191             | 0.8767          | 0.7901      | 73              | 0.5882                 | 0.7692              | 0.6667          | 65                  | 0.8133           | 0.9           | 0.8544    | 150           | 0.5405             | 0.6897          | 0.6061      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7136            | 0.8519         | 0.7766     | 0.9508           |
| 0.1469        | 19.0  | 2014  | 0.1538          | 0.7191             | 0.8767          | 0.7901      | 73              | 0.5306                 | 0.8                 | 0.6380          | 65                  | 0.8133           | 0.9           | 0.8544    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7014            | 0.8632         | 0.7739     | 0.9503           |
| 0.1429        | 20.0  | 2120  | 0.1472          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5904                 | 0.7538              | 0.6622          | 65                  | 0.8133           | 0.9           | 0.8544    | 150           | 0.5526             | 0.7241          | 0.6269      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7181            | 0.8490         | 0.7781     | 0.9525           |
| 0.1419        | 21.0  | 2226  | 0.1474          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5882                 | 0.7692              | 0.6667          | 65                  | 0.8232           | 0.9           | 0.8599    | 150           | 0.5789             | 0.7586          | 0.6567      | 29              | 0.6818         | 0.8824      | 0.7692  | 34          | 0.7177            | 0.8547         | 0.7802     | 0.9525           |
| 0.1365        | 22.0  | 2332  | 0.1541          | 0.7143             | 0.8904          | 0.7927      | 73              | 0.5484                 | 0.7846              | 0.6456          | 65                  | 0.8434           | 0.9333        | 0.8861    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.6667         | 0.8824      | 0.7595  | 34          | 0.7136            | 0.8803         | 0.7883     | 0.9518           |
| 0.1356        | 23.0  | 2438  | 0.1455          | 0.7273             | 0.8767          | 0.7950      | 73              | 0.5618                 | 0.7692              | 0.6494          | 65                  | 0.8242           | 0.9067        | 0.8635    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7214            | 0.8632         | 0.7860     | 0.9535           |
| 0.1326        | 24.0  | 2544  | 0.1505          | 0.7065             | 0.8904          | 0.7879      | 73              | 0.5543                 | 0.7846              | 0.6497          | 65                  | 0.8364           | 0.92          | 0.8762    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.6818         | 0.8824      | 0.7692  | 34          | 0.7106            | 0.8746         | 0.7842     | 0.9523           |
| 0.13          | 25.0  | 2650  | 0.1473          | 0.7143             | 0.8904          | 0.7927      | 73              | 0.5698                 | 0.7538              | 0.6490          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5897             | 0.7931          | 0.6765      | 29              | 0.6818         | 0.8824      | 0.7692  | 34          | 0.7193            | 0.8689         | 0.7871     | 0.9530           |
| 0.1321        | 26.0  | 2756  | 0.1409          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6104                 | 0.7231              | 0.6620          | 65                  | 0.8405           | 0.9133        | 0.8754    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7438            | 0.8519         | 0.7942     | 0.9552           |
| 0.1272        | 27.0  | 2862  | 0.1427          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.5802                 | 0.7231              | 0.6438          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.6818         | 0.8824      | 0.7692  | 34          | 0.7330            | 0.8604         | 0.7916     | 0.9547           |
| 0.1278        | 28.0  | 2968  | 0.1453          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5854                 | 0.7385              | 0.6531          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.5526             | 0.7241          | 0.6269      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.7288            | 0.8575         | 0.7880     | 0.9527           |
| 0.1242        | 29.0  | 3074  | 0.1453          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.5795                 | 0.7846              | 0.6667          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.5385             | 0.7241          | 0.6176      | 29              | 0.6977         | 0.8824      | 0.7792  | 34          | 0.7208            | 0.8604         | 0.7844     | 0.9540           |
| 0.1208        | 30.0  | 3180  | 0.1393          | 0.75               | 0.8630          | 0.8025      | 73              | 0.6154                 | 0.7385              | 0.6713          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.5676             | 0.7241          | 0.6364      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7456            | 0.8519         | 0.7952     | 0.9562           |
| 0.1213        | 31.0  | 3286  | 0.1461          | 0.7442             | 0.8767          | 0.8050      | 73              | 0.5484                 | 0.7846              | 0.6456          | 65                  | 0.8447           | 0.9067        | 0.8746    | 150           | 0.5641             | 0.7586          | 0.6471      | 29              | 0.6591         | 0.8529      | 0.7436  | 34          | 0.7139            | 0.8604         | 0.7804     | 0.9532           |
| 0.1181        | 32.0  | 3392  | 0.1417          | 0.7442             | 0.8767          | 0.8050      | 73              | 0.5730                 | 0.7846              | 0.6623          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.5526             | 0.7241          | 0.6269      | 29              | 0.725          | 0.8529      | 0.7838  | 34          | 0.7301            | 0.8632         | 0.7911     | 0.9557           |
| 0.1191        | 33.0  | 3498  | 0.1410          | 0.7529             | 0.8767          | 0.8101      | 73              | 0.5618                 | 0.7692              | 0.6494          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5789             | 0.7586          | 0.6567      | 29              | 0.6905         | 0.8529      | 0.7632  | 34          | 0.7249            | 0.8632         | 0.7880     | 0.9555           |
| 0.1156        | 34.0  | 3604  | 0.1408          | 0.7356             | 0.8767          | 0.8         | 73              | 0.5833                 | 0.7538              | 0.6577          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.5641             | 0.7586          | 0.6471      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7312            | 0.8604         | 0.7906     | 0.9557           |
| 0.1159        | 35.0  | 3710  | 0.1430          | 0.7356             | 0.8767          | 0.8         | 73              | 0.5814                 | 0.7692              | 0.6623          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.5641             | 0.7586          | 0.6471      | 29              | 0.6744         | 0.8529      | 0.7532  | 34          | 0.7255            | 0.8661         | 0.7896     | 0.9542           |
| 0.1133        | 36.0  | 3816  | 0.1378          | 0.75               | 0.8630          | 0.8025      | 73              | 0.5833                 | 0.7538              | 0.6577          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7143         | 0.8824      | 0.7895  | 34          | 0.7359            | 0.8575         | 0.7921     | 0.9559           |
| 0.1141        | 37.0  | 3922  | 0.1476          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5591                 | 0.8                 | 0.6582          | 65                  | 0.8485           | 0.9333        | 0.8889    | 150           | 0.55               | 0.7586          | 0.6377      | 29              | 0.6591         | 0.8529      | 0.7436  | 34          | 0.7133            | 0.8718         | 0.7846     | 0.9530           |
| 0.1131        | 38.0  | 4028  | 0.1364          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6104                 | 0.7231              | 0.6620          | 65                  | 0.8537           | 0.9333        | 0.8917    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7531            | 0.8604         | 0.8032     | 0.9572           |
| 0.1107        | 39.0  | 4134  | 0.1446          | 0.7273             | 0.8767          | 0.7950      | 73              | 0.5652                 | 0.8                 | 0.6624          | 65                  | 0.8485           | 0.9333        | 0.8889    | 150           | 0.5641             | 0.7586          | 0.6471      | 29              | 0.6744         | 0.8529      | 0.7532  | 34          | 0.7190            | 0.8746         | 0.7892     | 0.9542           |
| 0.1096        | 40.0  | 4240  | 0.1409          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5795                 | 0.7846              | 0.6667          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7361            | 0.8661         | 0.7958     | 0.9555           |
| 0.1076        | 41.0  | 4346  | 0.1396          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6                    | 0.7846              | 0.6800          | 65                  | 0.8589           | 0.9333        | 0.8946    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7073         | 0.8529      | 0.7733  | 34          | 0.7439            | 0.8689         | 0.8016     | 0.9569           |
| 0.1074        | 42.0  | 4452  | 0.1412          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.5930                 | 0.7846              | 0.6755          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.55               | 0.7586          | 0.6377      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7332            | 0.8689         | 0.7953     | 0.9562           |
| 0.1068        | 43.0  | 4558  | 0.1361          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6267                 | 0.7231              | 0.6714          | 65                  | 0.8424           | 0.9267        | 0.8825    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7512            | 0.8604         | 0.8021     | 0.9584           |
| 0.1067        | 44.0  | 4664  | 0.1334          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.6282                 | 0.7538              | 0.6853          | 65                  | 0.8373           | 0.9267        | 0.8797    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7949         | 0.9118      | 0.8493  | 34          | 0.7537            | 0.8632         | 0.8048     | 0.9584           |
| 0.1053        | 45.0  | 4770  | 0.1370          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6                    | 0.7846              | 0.6800          | 65                  | 0.8537           | 0.9333        | 0.8917    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7488            | 0.8746         | 0.8068     | 0.9579           |
| 0.1028        | 46.0  | 4876  | 0.1316          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.6098                 | 0.7692              | 0.6803          | 65                  | 0.8589           | 0.9333        | 0.8946    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.7949         | 0.9118      | 0.8493  | 34          | 0.7637            | 0.8746         | 0.8154     | 0.9589           |
| 0.1061        | 47.0  | 4982  | 0.1331          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6076                 | 0.7385              | 0.6667          | 65                  | 0.8485           | 0.9333        | 0.8889    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7506            | 0.8661         | 0.8042     | 0.9582           |
| 0.104         | 48.0  | 5088  | 0.1344          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6071                 | 0.7846              | 0.6846          | 65                  | 0.8537           | 0.9333        | 0.8917    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7482            | 0.8718         | 0.8053     | 0.9579           |
| 0.1025        | 49.0  | 5194  | 0.1350          | 0.75               | 0.8630          | 0.8025      | 73              | 0.5882                 | 0.7692              | 0.6667          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7451            | 0.8661         | 0.8011     | 0.9569           |
| 0.1032        | 50.0  | 5300  | 0.1372          | 0.75               | 0.8630          | 0.8025      | 73              | 0.6125                 | 0.7538              | 0.6759          | 65                  | 0.8485           | 0.9333        | 0.8889    | 150           | 0.5789             | 0.7586          | 0.6567      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7451            | 0.8661         | 0.8011     | 0.9569           |
| 0.0993        | 51.0  | 5406  | 0.1356          | 0.7326             | 0.8630          | 0.7925      | 73              | 0.5714                 | 0.7385              | 0.6443          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7324            | 0.8575         | 0.7900     | 0.9557           |
| 0.0992        | 52.0  | 5512  | 0.1370          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6486                 | 0.7385              | 0.6906          | 65                  | 0.8485           | 0.9333        | 0.8889    | 150           | 0.5789             | 0.7586          | 0.6567      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7519            | 0.8632         | 0.8037     | 0.9577           |
| 0.0994        | 53.0  | 5618  | 0.1401          | 0.7241             | 0.8630          | 0.7875      | 73              | 0.5843                 | 0.8                 | 0.6753          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7338            | 0.8718         | 0.7969     | 0.9572           |
| 0.0993        | 54.0  | 5724  | 0.1364          | 0.75               | 0.8630          | 0.8025      | 73              | 0.5795                 | 0.7846              | 0.6667          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7409            | 0.8718         | 0.8010     | 0.9567           |
| 0.0971        | 55.0  | 5830  | 0.1400          | 0.7529             | 0.8767          | 0.8101      | 73              | 0.5444                 | 0.7538              | 0.6323          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7308            | 0.8661         | 0.7927     | 0.9562           |
| 0.1           | 56.0  | 5936  | 0.1349          | 0.75               | 0.8630          | 0.8025      | 73              | 0.5698                 | 0.7538              | 0.6490          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7379            | 0.8661         | 0.7969     | 0.9567           |
| 0.0987        | 57.0  | 6042  | 0.1363          | 0.7326             | 0.8630          | 0.7925      | 73              | 0.6049                 | 0.7538              | 0.6712          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7426            | 0.8632         | 0.7984     | 0.9562           |
| 0.0976        | 58.0  | 6148  | 0.1328          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6267                 | 0.7231              | 0.6714          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7607            | 0.8604         | 0.8075     | 0.9584           |
| 0.0957        | 59.0  | 6254  | 0.1330          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6184                 | 0.7231              | 0.6667          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7519            | 0.8547         | 0.8        | 0.9577           |
| 0.0953        | 60.0  | 6360  | 0.1346          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.6                    | 0.7846              | 0.6800          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7518            | 0.8718         | 0.8074     | 0.9582           |
| 0.0961        | 61.0  | 6466  | 0.1299          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6494                 | 0.7692              | 0.7042          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7688            | 0.8718         | 0.8171     | 0.9591           |
| 0.0951        | 62.0  | 6572  | 0.1375          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.6456                 | 0.7846              | 0.7083          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.5789             | 0.7586          | 0.6567      | 29              | 0.7317         | 0.8824      | 0.8     | 34          | 0.7445            | 0.8632         | 0.7995     | 0.9567           |
| 0.0935        | 63.0  | 6678  | 0.1345          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6220                 | 0.7846              | 0.6939          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7525            | 0.8746         | 0.8090     | 0.9567           |
| 0.0932        | 64.0  | 6784  | 0.1302          | 0.775              | 0.8493          | 0.8105      | 73              | 0.64                   | 0.7385              | 0.6857          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7646            | 0.8604         | 0.8097     | 0.9584           |
| 0.0941        | 65.0  | 6890  | 0.1338          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6494                 | 0.7692              | 0.7042          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7612            | 0.8718         | 0.8127     | 0.9572           |
| 0.0909        | 66.0  | 6996  | 0.1357          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6190                 | 0.8                 | 0.6980          | 65                  | 0.8528           | 0.9267        | 0.8882    | 150           | 0.6053             | 0.7931          | 0.6866      | 29              | 0.7561         | 0.9118      | 0.8267  | 34          | 0.7488            | 0.8746         | 0.8068     | 0.9569           |
| 0.0912        | 67.0  | 7102  | 0.1353          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6420                 | 0.8                 | 0.7123          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7592            | 0.8803         | 0.8153     | 0.9567           |
| 0.0903        | 68.0  | 7208  | 0.1336          | 0.7262             | 0.8356          | 0.7771      | 73              | 0.6711                 | 0.7846              | 0.7234          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7619         | 0.9412      | 0.8421  | 34          | 0.7644            | 0.8689         | 0.8133     | 0.9577           |
| 0.0912        | 69.0  | 7314  | 0.1328          | 0.7683             | 0.8630          | 0.8129      | 73              | 0.6118                 | 0.8                 | 0.6933          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7630            | 0.8803         | 0.8175     | 0.9579           |
| 0.0902        | 70.0  | 7420  | 0.1315          | 0.7561             | 0.8493          | 0.8000      | 73              | 0.6447                 | 0.7538              | 0.6950          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7702            | 0.8689         | 0.8166     | 0.9582           |
| 0.0908        | 71.0  | 7526  | 0.1357          | 0.7209             | 0.8493          | 0.7799      | 73              | 0.6341                 | 0.8                 | 0.7075          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.75              | 0.8718         | 0.8063     | 0.9567           |
| 0.0897        | 72.0  | 7632  | 0.1334          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6494                 | 0.7692              | 0.7042          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.7805         | 0.9412      | 0.8533  | 34          | 0.7619            | 0.8661         | 0.8107     | 0.9574           |
| 0.0896        | 73.0  | 7738  | 0.1333          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6375                 | 0.7846              | 0.7034          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7618            | 0.8746         | 0.8143     | 0.9582           |
| 0.0882        | 74.0  | 7844  | 0.1297          | 0.7590             | 0.8630          | 0.8077      | 73              | 0.6486                 | 0.7385              | 0.6906          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7696            | 0.8661         | 0.8150     | 0.9587           |
| 0.0895        | 75.0  | 7950  | 0.1331          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7694            | 0.8746         | 0.8187     | 0.9591           |
| 0.0888        | 76.0  | 8056  | 0.1329          | 0.7531             | 0.8356          | 0.7922      | 73              | 0.6456                 | 0.7846              | 0.7083          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.5833             | 0.7241          | 0.6462      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7657            | 0.8661         | 0.8128     | 0.9589           |
| 0.0879        | 77.0  | 8162  | 0.1320          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6494                 | 0.7692              | 0.7042          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7683            | 0.8689         | 0.8155     | 0.9589           |
| 0.0869        | 78.0  | 8268  | 0.1333          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6494                 | 0.7692              | 0.7042          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7638            | 0.8661         | 0.8117     | 0.9584           |
| 0.0901        | 79.0  | 8374  | 0.1383          | 0.7412             | 0.8630          | 0.7975      | 73              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.7381         | 0.9118      | 0.8158  | 34          | 0.7555            | 0.8803         | 0.8132     | 0.9574           |
| 0.0871        | 80.0  | 8480  | 0.1347          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6753                 | 0.8                 | 0.7324          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7669            | 0.8718         | 0.8160     | 0.9584           |
| 0.0851        | 81.0  | 8586  | 0.1324          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6753                 | 0.8                 | 0.7324          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7714            | 0.8746         | 0.8198     | 0.9589           |
| 0.0861        | 82.0  | 8692  | 0.1333          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6753                 | 0.8                 | 0.7324          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7714            | 0.8746         | 0.8198     | 0.9589           |
| 0.0877        | 83.0  | 8798  | 0.1340          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6795                 | 0.8154              | 0.7413          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.7949         | 0.9118      | 0.8493  | 34          | 0.7714            | 0.8746         | 0.8198     | 0.9589           |
| 0.0873        | 84.0  | 8904  | 0.1332          | 0.7470             | 0.8493          | 0.7949      | 73              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7714            | 0.8746         | 0.8198     | 0.9591           |
| 0.0878        | 85.0  | 9010  | 0.1356          | 0.7294             | 0.8493          | 0.7848      | 73              | 0.6795                 | 0.8154              | 0.7413          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.5946             | 0.7586          | 0.6667      | 29              | 0.75           | 0.8824      | 0.8108  | 34          | 0.7631            | 0.8718         | 0.8138     | 0.9582           |
| 0.0854        | 86.0  | 9116  | 0.1318          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6389             | 0.7931          | 0.7077      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7727            | 0.8718         | 0.8193     | 0.9591           |
| 0.0848        | 87.0  | 9222  | 0.1333          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6216             | 0.7931          | 0.6970      | 29              | 0.8            | 0.9412      | 0.8649  | 34          | 0.7694            | 0.8746         | 0.8187     | 0.9587           |
| 0.0841        | 88.0  | 9328  | 0.1320          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7663            | 0.8689         | 0.8144     | 0.9584           |
| 0.0868        | 89.0  | 9434  | 0.1321          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7663            | 0.8689         | 0.8144     | 0.9589           |
| 0.0844        | 90.0  | 9540  | 0.1318          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7657            | 0.8661         | 0.8128     | 0.9587           |
| 0.0838        | 91.0  | 9646  | 0.1326          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7669            | 0.8718         | 0.8160     | 0.9591           |
| 0.0866        | 92.0  | 9752  | 0.1332          | 0.7381             | 0.8493          | 0.7898      | 73              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7669            | 0.8718         | 0.8160     | 0.9589           |
| 0.085         | 93.0  | 9858  | 0.1317          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7677            | 0.8661         | 0.8139     | 0.9589           |
| 0.084         | 94.0  | 9964  | 0.1322          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7663            | 0.8689         | 0.8144     | 0.9589           |
| 0.0838        | 95.0  | 10070 | 0.1319          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7663            | 0.8689         | 0.8144     | 0.9587           |
| 0.087         | 96.0  | 10176 | 0.1328          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7663            | 0.8689         | 0.8144     | 0.9584           |
| 0.0832        | 97.0  | 10282 | 0.1314          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7677            | 0.8661         | 0.8139     | 0.9587           |
| 0.0859        | 98.0  | 10388 | 0.1315          | 0.7439             | 0.8356          | 0.7871      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7677            | 0.8661         | 0.8139     | 0.9587           |
| 0.0838        | 99.0  | 10494 | 0.1318          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7657            | 0.8661         | 0.8128     | 0.9587           |
| 0.0849        | 100.0 | 10600 | 0.1318          | 0.7349             | 0.8356          | 0.7821      | 73              | 0.6623                 | 0.7846              | 0.7183          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6111             | 0.7586          | 0.6769      | 29              | 0.775          | 0.9118      | 0.8378  | 34          | 0.7657            | 0.8661         | 0.8128     | 0.9587           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2