---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-pt-pl50-3
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-pt-pl50-3

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1897
- Location Precision: 0.7683
- Location Recall: 0.8873
- Location F1: 0.8235
- Location Number: 71
- Organization Precision: 0.6154
- Organization Recall: 0.8615
- Organization F1: 0.7179
- Organization Number: 65
- Person Precision: 0.8457
- Person Recall: 0.9133
- Person F1: 0.8782
- Person Number: 150
- Quantity Precision: 0.6585
- Quantity Recall: 0.8182
- Quantity F1: 0.7297
- Quantity Number: 33
- Time Precision: 0.8065
- Time Recall: 0.8929
- Time F1: 0.8475
- Time Number: 28
- Overall Precision: 0.7568
- Overall Recall: 0.8876
- Overall F1: 0.8170
- Overall Accuracy: 0.9573

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.0045        | 1.0   | 106   | 0.5767          | 0.0                | 0.0             | 0.0         | 71              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.0667           | 0.0067        | 0.0121    | 150           | 0.0                | 0.0             | 0.0         | 33              | 0.0            | 0.0         | 0.0     | 28          | 0.0476            | 0.0029         | 0.0054     | 0.8434           |
| 0.4985        | 2.0   | 212   | 0.3479          | 0.5116             | 0.3099          | 0.3860      | 71              | 0.1316                 | 0.1538              | 0.1418          | 65                  | 0.6561           | 0.8267        | 0.7316    | 150           | 0.1613             | 0.1515          | 0.1562      | 33              | 0.6562         | 0.75        | 0.7     | 28          | 0.4906            | 0.5245         | 0.5070     | 0.9083           |
| 0.2936        | 3.0   | 318   | 0.2019          | 0.6508             | 0.5775          | 0.6119      | 71              | 0.3947                 | 0.4615              | 0.4255          | 65                  | 0.7798           | 0.8733        | 0.8239    | 150           | 0.5238             | 0.6667          | 0.5867      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.6578            | 0.7147         | 0.6851     | 0.9340           |
| 0.2113        | 4.0   | 424   | 0.1663          | 0.6118             | 0.7324          | 0.6667      | 71              | 0.5521                 | 0.8154              | 0.6584          | 65                  | 0.7953           | 0.9067        | 0.8474    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.6887            | 0.8415         | 0.7575     | 0.9459           |
| 0.1824        | 5.0   | 530   | 0.1596          | 0.6129             | 0.8028          | 0.6951      | 71              | 0.5667                 | 0.7846              | 0.6581          | 65                  | 0.8193           | 0.9067        | 0.8608    | 150           | 0.6087             | 0.8485          | 0.7089      | 33              | 0.6667         | 0.8571      | 0.75    | 28          | 0.6868            | 0.8530         | 0.7609     | 0.9447           |
| 0.1647        | 6.0   | 636   | 0.1714          | 0.6042             | 0.8169          | 0.6946      | 71              | 0.5133                 | 0.8923              | 0.6517          | 65                  | 0.7784           | 0.9133        | 0.8405    | 150           | 0.5385             | 0.8485          | 0.6588      | 33              | 0.6154         | 0.8571      | 0.7164  | 28          | 0.6408            | 0.8790         | 0.7412     | 0.9370           |
| 0.1533        | 7.0   | 742   | 0.1462          | 0.6196             | 0.8028          | 0.6994      | 71              | 0.5670                 | 0.8462              | 0.6790          | 65                  | 0.8070           | 0.92          | 0.8598    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.7353         | 0.8929      | 0.8065  | 28          | 0.6911            | 0.8703         | 0.7704     | 0.9510           |
| 0.1405        | 8.0   | 848   | 0.1381          | 0.6593             | 0.8451          | 0.7407      | 71              | 0.5472                 | 0.8923              | 0.6784          | 65                  | 0.8395           | 0.9067        | 0.8718    | 150           | 0.6512             | 0.8485          | 0.7368      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7074            | 0.8847         | 0.7862     | 0.9505           |
| 0.1341        | 9.0   | 954   | 0.1326          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.5534                 | 0.8769              | 0.6786          | 65                  | 0.8397           | 0.8733        | 0.8562    | 150           | 0.6667             | 0.8485          | 0.7467      | 33              | 0.7576         | 0.8929      | 0.8197  | 28          | 0.7201            | 0.8674         | 0.7869     | 0.9496           |
| 0.1274        | 10.0  | 1060  | 0.1223          | 0.7561             | 0.8732          | 0.8105      | 71              | 0.6111                 | 0.8462              | 0.7097          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7605            | 0.8876         | 0.8191     | 0.9590           |
| 0.1232        | 11.0  | 1166  | 0.1300          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.6042                 | 0.8923              | 0.7205          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7422            | 0.8876         | 0.8084     | 0.9530           |
| 0.1195        | 12.0  | 1272  | 0.1411          | 0.6484             | 0.8310          | 0.7284      | 71              | 0.57                   | 0.8769              | 0.6909          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.75           | 0.8571      | 0.8000  | 28          | 0.7183            | 0.8818         | 0.7917     | 0.9522           |
| 0.1138        | 13.0  | 1378  | 0.1257          | 0.7654             | 0.8732          | 0.8158      | 71              | 0.6020                 | 0.9077              | 0.7239          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6829             | 0.8485          | 0.7568      | 33              | 0.9615         | 0.8929      | 0.9259  | 28          | 0.7660            | 0.8963         | 0.8260     | 0.9571           |
| 0.1106        | 14.0  | 1484  | 0.1278          | 0.7439             | 0.8592          | 0.7974      | 71              | 0.5979                 | 0.8923              | 0.7160          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6087             | 0.8485          | 0.7089      | 33              | 0.7576         | 0.8929      | 0.8197  | 28          | 0.7416            | 0.8934         | 0.8105     | 0.9542           |
| 0.1037        | 15.0  | 1590  | 0.1332          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6211                 | 0.9077              | 0.7375          | 65                  | 0.8642           | 0.9333        | 0.8974    | 150           | 0.5833             | 0.8485          | 0.6914      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7476            | 0.9049         | 0.8188     | 0.9534           |
| 0.1015        | 16.0  | 1696  | 0.1396          | 0.7262             | 0.8592          | 0.7871      | 71              | 0.625                  | 0.9231              | 0.7453          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.54               | 0.8182          | 0.6506      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7393            | 0.8991         | 0.8114     | 0.9539           |
| 0.0958        | 17.0  | 1802  | 0.1272          | 0.7561             | 0.8732          | 0.8105      | 71              | 0.6082                 | 0.9077              | 0.7284          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7621            | 0.9049         | 0.8274     | 0.9581           |
| 0.0957        | 18.0  | 1908  | 0.1487          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.5660                 | 0.9231              | 0.7018          | 65                  | 0.8589           | 0.9333        | 0.8946    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7296            | 0.9020         | 0.8067     | 0.9527           |
| 0.0943        | 19.0  | 2014  | 0.1254          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.5960                 | 0.9077              | 0.7195          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.6829             | 0.8485          | 0.7568      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7616            | 0.9020         | 0.8259     | 0.9578           |
| 0.0915        | 20.0  | 2120  | 0.1267          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.6277                 | 0.9077              | 0.7421          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.6667             | 0.8485          | 0.7467      | 33              | 0.9615         | 0.8929      | 0.9259  | 28          | 0.7748            | 0.9020         | 0.8336     | 0.9590           |
| 0.0834        | 21.0  | 2226  | 0.1433          | 0.6932             | 0.8592          | 0.7673      | 71              | 0.6020                 | 0.9077              | 0.7239          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.5556             | 0.7576          | 0.6410      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7357            | 0.8905         | 0.8057     | 0.9534           |
| 0.0839        | 22.0  | 2332  | 0.1434          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.6146                 | 0.9077              | 0.7329          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.5652             | 0.7879          | 0.6582      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7530            | 0.8963         | 0.8184     | 0.9547           |
| 0.0807        | 23.0  | 2438  | 0.1360          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.5960                 | 0.9077              | 0.7195          | 65                  | 0.8868           | 0.94          | 0.9126    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7585            | 0.9049         | 0.8252     | 0.9585           |
| 0.0771        | 24.0  | 2544  | 0.1434          | 0.7262             | 0.8592          | 0.7871      | 71              | 0.6129                 | 0.8769              | 0.7215          | 65                  | 0.8773           | 0.9533        | 0.9137    | 150           | 0.5417             | 0.7879          | 0.6420      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7476            | 0.8963         | 0.8152     | 0.9539           |
| 0.0772        | 25.0  | 2650  | 0.1520          | 0.7093             | 0.8592          | 0.7771      | 71              | 0.5784                 | 0.9077              | 0.7066          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.5294             | 0.8182          | 0.6429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7222            | 0.8991         | 0.8010     | 0.9503           |
| 0.0732        | 26.0  | 2756  | 0.1422          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.6316                 | 0.9231              | 0.7500          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.6                | 0.8182          | 0.6923      | 33              | 0.9615         | 0.8929      | 0.9259  | 28          | 0.7610            | 0.8991         | 0.8243     | 0.9571           |
| 0.0731        | 27.0  | 2862  | 0.1367          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.6484                 | 0.9077              | 0.7564          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.5532             | 0.7879          | 0.65        | 33              | 0.7879         | 0.9286      | 0.8525  | 28          | 0.7530            | 0.8963         | 0.8184     | 0.9556           |
| 0.0697        | 28.0  | 2968  | 0.1450          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.5979                 | 0.8923              | 0.7160          | 65                  | 0.8727           | 0.96          | 0.9143    | 150           | 0.5435             | 0.7576          | 0.6329      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7435            | 0.9020         | 0.8151     | 0.9549           |
| 0.0689        | 29.0  | 3074  | 0.1529          | 0.7412             | 0.8873          | 0.8077      | 71              | 0.5636                 | 0.9538              | 0.7086          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.7143         | 0.8929      | 0.7937  | 28          | 0.7309            | 0.9078         | 0.8098     | 0.9554           |
| 0.0669        | 30.0  | 3180  | 0.1412          | 0.7262             | 0.8592          | 0.7871      | 71              | 0.6277                 | 0.9077              | 0.7421          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6512             | 0.8485          | 0.7368      | 33              | 0.7742         | 0.8571      | 0.8136  | 28          | 0.7506            | 0.8934         | 0.8158     | 0.9571           |
| 0.0654        | 31.0  | 3286  | 0.1370          | 0.7045             | 0.8732          | 0.7799      | 71              | 0.6667                 | 0.9231              | 0.7742          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7604            | 0.8963         | 0.8228     | 0.9614           |
| 0.0639        | 32.0  | 3392  | 0.1497          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.5842                 | 0.9077              | 0.7108          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7434            | 0.8934         | 0.8115     | 0.9561           |
| 0.0637        | 33.0  | 3498  | 0.1378          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8650           | 0.94          | 0.9010    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.7273         | 0.8571      | 0.7869  | 28          | 0.7643            | 0.8876         | 0.8213     | 0.9597           |
| 0.0625        | 34.0  | 3604  | 0.1449          | 0.7590             | 0.8873          | 0.8182      | 71              | 0.6452                 | 0.9231              | 0.7595          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.8125         | 0.9286      | 0.8667  | 28          | 0.7702            | 0.9078         | 0.8333     | 0.9588           |
| 0.0634        | 35.0  | 3710  | 0.1454          | 0.7209             | 0.8732          | 0.7898      | 71              | 0.6444                 | 0.8923              | 0.7484          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7585            | 0.8963         | 0.8217     | 0.9573           |
| 0.0592        | 36.0  | 3816  | 0.1612          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6489                 | 0.9385              | 0.7673          | 65                  | 0.8758           | 0.94          | 0.9068    | 150           | 0.6                | 0.8182          | 0.6923      | 33              | 0.7647         | 0.9286      | 0.8387  | 28          | 0.7602            | 0.9135         | 0.8298     | 0.9561           |
| 0.0597        | 37.0  | 3922  | 0.1626          | 0.6977             | 0.8451          | 0.7643      | 71              | 0.6162                 | 0.9385              | 0.7439          | 65                  | 0.8642           | 0.9333        | 0.8974    | 150           | 0.5778             | 0.7879          | 0.6667      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7358            | 0.8991         | 0.8093     | 0.9534           |
| 0.0573        | 38.0  | 4028  | 0.1448          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8662           | 0.9067        | 0.8860    | 150           | 0.6341             | 0.7879          | 0.7027      | 33              | 0.7879         | 0.9286      | 0.8525  | 28          | 0.7657            | 0.8761         | 0.8172     | 0.9571           |
| 0.0561        | 39.0  | 4134  | 0.1475          | 0.7262             | 0.8592          | 0.7871      | 71              | 0.6522                 | 0.9231              | 0.7643          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7610            | 0.8991         | 0.8243     | 0.9583           |
| 0.0521        | 40.0  | 4240  | 0.1486          | 0.7561             | 0.8732          | 0.8105      | 71              | 0.6064                 | 0.8769              | 0.7170          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6667             | 0.7879          | 0.7222      | 33              | 0.7353         | 0.8929      | 0.8065  | 28          | 0.7549            | 0.8876         | 0.8159     | 0.9588           |
| 0.0526        | 41.0  | 4346  | 0.1594          | 0.7229             | 0.8451          | 0.7792      | 71              | 0.6                    | 0.9231              | 0.7273          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6364             | 0.8485          | 0.7273      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7429            | 0.8991         | 0.8136     | 0.9561           |
| 0.0505        | 42.0  | 4452  | 0.1528          | 0.8101             | 0.9014          | 0.8533      | 71              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.7647         | 0.9286      | 0.8387  | 28          | 0.7803            | 0.8905         | 0.8318     | 0.9578           |
| 0.0497        | 43.0  | 4558  | 0.1480          | 0.7011             | 0.8592          | 0.7722      | 71              | 0.5978                 | 0.8462              | 0.7006          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.7647         | 0.9286      | 0.8387  | 28          | 0.7415            | 0.8847         | 0.8068     | 0.9573           |
| 0.0525        | 44.0  | 4664  | 0.1504          | 0.7529             | 0.9014          | 0.8205      | 71              | 0.6364                 | 0.8615              | 0.7320          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.6190             | 0.7879          | 0.6933      | 33              | 0.7647         | 0.9286      | 0.8387  | 28          | 0.7610            | 0.8991         | 0.8243     | 0.9602           |
| 0.0486        | 45.0  | 4770  | 0.1478          | 0.7778             | 0.8873          | 0.8289      | 71              | 0.6322                 | 0.8462              | 0.7237          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7834            | 0.8963         | 0.8360     | 0.9614           |
| 0.0454        | 46.0  | 4876  | 0.1454          | 0.7711             | 0.9014          | 0.8312      | 71              | 0.6292                 | 0.8615              | 0.7273          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.6842             | 0.7879          | 0.7324      | 33              | 0.7576         | 0.8929      | 0.8197  | 28          | 0.7781            | 0.8991         | 0.8342     | 0.9627           |
| 0.049         | 47.0  | 4982  | 0.1595          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.5842                 | 0.9077              | 0.7108          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8125         | 0.9286      | 0.8667  | 28          | 0.7518            | 0.8991         | 0.8189     | 0.9551           |
| 0.0467        | 48.0  | 5088  | 0.1481          | 0.7412             | 0.8873          | 0.8077      | 71              | 0.6292                 | 0.8615              | 0.7273          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7673            | 0.8934         | 0.8256     | 0.9588           |
| 0.0458        | 49.0  | 5194  | 0.1565          | 0.7561             | 0.8732          | 0.8105      | 71              | 0.6477                 | 0.8769              | 0.7451          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.6341             | 0.7879          | 0.7027      | 33              | 0.8125         | 0.9286      | 0.8667  | 28          | 0.7717            | 0.8963         | 0.8293     | 0.9593           |
| 0.0435        | 50.0  | 5300  | 0.1588          | 0.7619             | 0.9014          | 0.8258      | 71              | 0.6207                 | 0.8308              | 0.7105          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7692            | 0.8934         | 0.8267     | 0.9583           |
| 0.0461        | 51.0  | 5406  | 0.1631          | 0.7241             | 0.8873          | 0.7975      | 71              | 0.5957                 | 0.8615              | 0.7044          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.7879         | 0.9286      | 0.8525  | 28          | 0.7452            | 0.8934         | 0.8126     | 0.9559           |
| 0.0424        | 52.0  | 5512  | 0.1720          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6129                 | 0.8769              | 0.7215          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7690            | 0.9020         | 0.8302     | 0.9566           |
| 0.0436        | 53.0  | 5618  | 0.1815          | 0.7326             | 0.8873          | 0.8025      | 71              | 0.5825                 | 0.9231              | 0.7143          | 65                  | 0.8765           | 0.9467        | 0.9103    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.7647         | 0.9286      | 0.8387  | 28          | 0.7413            | 0.9164         | 0.8196     | 0.9530           |
| 0.0414        | 54.0  | 5724  | 0.1522          | 0.7683             | 0.8873          | 0.8235      | 71              | 0.6333                 | 0.8769              | 0.7355          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7756            | 0.8963         | 0.8316     | 0.9602           |
| 0.0413        | 55.0  | 5830  | 0.1548          | 0.775              | 0.8732          | 0.8212      | 71              | 0.6477                 | 0.8769              | 0.7451          | 65                  | 0.8846           | 0.92          | 0.9020    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7843            | 0.8905         | 0.8340     | 0.9585           |
| 0.04          | 56.0  | 5936  | 0.1626          | 0.7927             | 0.9155          | 0.8497      | 71              | 0.6395                 | 0.8462              | 0.7285          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7794            | 0.8963         | 0.8338     | 0.9593           |
| 0.0416        | 57.0  | 6042  | 0.1643          | 0.7683             | 0.8873          | 0.8235      | 71              | 0.6627                 | 0.8462              | 0.7432          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6                | 0.8182          | 0.6923      | 33              | 0.8966         | 0.9286      | 0.9123  | 28          | 0.775             | 0.8934         | 0.8300     | 0.9581           |
| 0.0409        | 58.0  | 6148  | 0.1600          | 0.7901             | 0.9014          | 0.8421      | 71              | 0.6292                 | 0.8615              | 0.7273          | 65                  | 0.8537           | 0.9333        | 0.8917    | 150           | 0.5870             | 0.8182          | 0.6835      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7634            | 0.9020         | 0.8269     | 0.9581           |
| 0.0392        | 59.0  | 6254  | 0.1548          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8608           | 0.9067        | 0.8831    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8966         | 0.9286      | 0.9123  | 28          | 0.7741            | 0.8790         | 0.8232     | 0.9600           |
| 0.0374        | 60.0  | 6360  | 0.1581          | 0.8                | 0.9014          | 0.8477      | 71              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6829             | 0.8485          | 0.7568      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7893            | 0.8963         | 0.8394     | 0.9610           |
| 0.0365        | 61.0  | 6466  | 0.1699          | 0.7901             | 0.9014          | 0.8421      | 71              | 0.6413                 | 0.9077              | 0.7516          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8966         | 0.9286      | 0.9123  | 28          | 0.7836            | 0.9078         | 0.8411     | 0.9612           |
| 0.0367        | 62.0  | 6572  | 0.1724          | 0.7831             | 0.9155          | 0.8442      | 71              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8662           | 0.9067        | 0.8860    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7803            | 0.8905         | 0.8318     | 0.9581           |
| 0.0365        | 63.0  | 6678  | 0.1616          | 0.7778             | 0.8873          | 0.8289      | 71              | 0.6064                 | 0.8769              | 0.7170          | 65                  | 0.8553           | 0.9067        | 0.8803    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7654            | 0.8934         | 0.8245     | 0.9585           |
| 0.0355        | 64.0  | 6784  | 0.1717          | 0.75               | 0.8873          | 0.8129      | 71              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7667            | 0.8905         | 0.824      | 0.9583           |
| 0.0372        | 65.0  | 6890  | 0.1686          | 0.7619             | 0.9014          | 0.8258      | 71              | 0.6364                 | 0.8615              | 0.7320          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8125         | 0.9286      | 0.8667  | 28          | 0.7723            | 0.8991         | 0.8309     | 0.9590           |
| 0.0362        | 66.0  | 6996  | 0.1829          | 0.7561             | 0.8732          | 0.8105      | 71              | 0.6082                 | 0.9077              | 0.7284          | 65                  | 0.8589           | 0.9333        | 0.8946    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7566            | 0.9049         | 0.8241     | 0.9561           |
| 0.0333        | 67.0  | 7102  | 0.1720          | 0.7683             | 0.8873          | 0.8235      | 71              | 0.6304                 | 0.8923              | 0.7389          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7742            | 0.8991         | 0.8320     | 0.9593           |
| 0.033         | 68.0  | 7208  | 0.1668          | 0.7619             | 0.9014          | 0.8258      | 71              | 0.6264                 | 0.8769              | 0.7308          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8966         | 0.9286      | 0.9123  | 28          | 0.7709            | 0.9020         | 0.8313     | 0.9585           |
| 0.0333        | 69.0  | 7314  | 0.1638          | 0.7831             | 0.9155          | 0.8442      | 71              | 0.6196                 | 0.8769              | 0.7261          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7753            | 0.9049         | 0.8351     | 0.9605           |
| 0.0335        | 70.0  | 7420  | 0.1705          | 0.7927             | 0.9155          | 0.8497      | 71              | 0.6552                 | 0.8769              | 0.75            | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7825            | 0.9020         | 0.8380     | 0.9593           |
| 0.0353        | 71.0  | 7526  | 0.1908          | 0.75               | 0.8873          | 0.8129      | 71              | 0.5938                 | 0.8769              | 0.7081          | 65                  | 0.8537           | 0.9333        | 0.8917    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7446            | 0.8991         | 0.8146     | 0.9544           |
| 0.0324        | 72.0  | 7632  | 0.1728          | 0.75               | 0.8873          | 0.8129      | 71              | 0.6322                 | 0.8462              | 0.7237          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.725              | 0.8788          | 0.7945      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7711            | 0.8934         | 0.8278     | 0.9602           |
| 0.0323        | 73.0  | 7738  | 0.1799          | 0.7654             | 0.8732          | 0.8158      | 71              | 0.6304                 | 0.8923              | 0.7389          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7660            | 0.8963         | 0.8260     | 0.9573           |
| 0.0321        | 74.0  | 7844  | 0.1788          | 0.7875             | 0.8873          | 0.8344      | 71              | 0.6364                 | 0.8615              | 0.7320          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7711            | 0.8934         | 0.8278     | 0.9585           |
| 0.0296        | 75.0  | 7950  | 0.1813          | 0.7412             | 0.8873          | 0.8077      | 71              | 0.6364                 | 0.8615              | 0.7320          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7073             | 0.8788          | 0.7838      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7679            | 0.8963         | 0.8271     | 0.9583           |
| 0.0308        | 76.0  | 8056  | 0.1778          | 0.7875             | 0.8873          | 0.8344      | 71              | 0.6064                 | 0.8769              | 0.7170          | 65                  | 0.8718           | 0.9067        | 0.8889    | 150           | 0.6829             | 0.8485          | 0.7568      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7711            | 0.8934         | 0.8278     | 0.9583           |
| 0.0305        | 77.0  | 8162  | 0.1823          | 0.75               | 0.8873          | 0.8129      | 71              | 0.6353                 | 0.8308              | 0.7200          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6829             | 0.8485          | 0.7568      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7706            | 0.8905         | 0.8262     | 0.9576           |
| 0.0298        | 78.0  | 8268  | 0.1802          | 0.7738             | 0.9155          | 0.8387      | 71              | 0.6322                 | 0.8462              | 0.7237          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8966         | 0.9286      | 0.9123  | 28          | 0.7756            | 0.8963         | 0.8316     | 0.9576           |
| 0.0302        | 79.0  | 8374  | 0.1899          | 0.7529             | 0.9014          | 0.8205      | 71              | 0.6395                 | 0.8462              | 0.7285          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7685            | 0.8991         | 0.8287     | 0.9585           |
| 0.0307        | 80.0  | 8480  | 0.1814          | 0.8101             | 0.9014          | 0.8533      | 71              | 0.6235                 | 0.8154              | 0.7067          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6047             | 0.7879          | 0.6842      | 33              | 0.7879         | 0.9286      | 0.8525  | 28          | 0.7694            | 0.8847         | 0.8231     | 0.9578           |
| 0.0275        | 81.0  | 8586  | 0.1840          | 0.7805             | 0.9014          | 0.8366      | 71              | 0.6136                 | 0.8308              | 0.7059          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7706            | 0.8905         | 0.8262     | 0.9585           |
| 0.0285        | 82.0  | 8692  | 0.1892          | 0.7927             | 0.9155          | 0.8497      | 71              | 0.6180                 | 0.8462              | 0.7143          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7673            | 0.8934         | 0.8256     | 0.9571           |
| 0.0303        | 83.0  | 8798  | 0.1822          | 0.7805             | 0.9014          | 0.8366      | 71              | 0.6044                 | 0.8462              | 0.7051          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7611            | 0.8905         | 0.8207     | 0.9573           |
| 0.0291        | 84.0  | 8904  | 0.1842          | 0.7412             | 0.8873          | 0.8077      | 71              | 0.6092                 | 0.8154              | 0.6974          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7580            | 0.8847         | 0.8165     | 0.9564           |
| 0.0275        | 85.0  | 9010  | 0.1876          | 0.7711             | 0.9014          | 0.8312      | 71              | 0.5955                 | 0.8154              | 0.6883          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7605            | 0.8876         | 0.8191     | 0.9573           |
| 0.0286        | 86.0  | 9116  | 0.1853          | 0.7711             | 0.9014          | 0.8312      | 71              | 0.6304                 | 0.8923              | 0.7389          | 65                  | 0.8782           | 0.9133        | 0.8954    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7698            | 0.8963         | 0.8282     | 0.9583           |
| 0.0283        | 87.0  | 9222  | 0.1860          | 0.7778             | 0.8873          | 0.8289      | 71              | 0.6170                 | 0.8923              | 0.7296          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7654            | 0.8934         | 0.8245     | 0.9581           |
| 0.0278        | 88.0  | 9328  | 0.1810          | 0.7778             | 0.8873          | 0.8289      | 71              | 0.6333                 | 0.8769              | 0.7355          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7756            | 0.8963         | 0.8316     | 0.9593           |
| 0.0277        | 89.0  | 9434  | 0.1893          | 0.7901             | 0.9014          | 0.8421      | 71              | 0.6                    | 0.8769              | 0.7125          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7567            | 0.8963         | 0.8206     | 0.9564           |
| 0.0274        | 90.0  | 9540  | 0.1806          | 0.7654             | 0.8732          | 0.8158      | 71              | 0.6180                 | 0.8462              | 0.7143          | 65                  | 0.8726           | 0.9133        | 0.8925    | 150           | 0.65               | 0.7879          | 0.7123      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7644            | 0.8790         | 0.8177     | 0.9583           |
| 0.0262        | 91.0  | 9646  | 0.1893          | 0.7561             | 0.8732          | 0.8105      | 71              | 0.6022                 | 0.8615              | 0.7089          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7470            | 0.8847         | 0.8100     | 0.9564           |
| 0.0263        | 92.0  | 9752  | 0.1854          | 0.7654             | 0.8732          | 0.8158      | 71              | 0.6588                 | 0.8615              | 0.7467          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.65               | 0.7879          | 0.7123      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7669            | 0.8818         | 0.8204     | 0.9588           |
| 0.0253        | 93.0  | 9858  | 0.1896          | 0.7683             | 0.8873          | 0.8235      | 71              | 0.6087                 | 0.8615              | 0.7134          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7549            | 0.8876         | 0.8159     | 0.9578           |
| 0.0246        | 94.0  | 9964  | 0.1866          | 0.7654             | 0.8732          | 0.8158      | 71              | 0.6087                 | 0.8615              | 0.7134          | 65                  | 0.8544           | 0.9           | 0.8766    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7587            | 0.8790         | 0.8144     | 0.9578           |
| 0.0277        | 95.0  | 10070 | 0.1892          | 0.7561             | 0.8732          | 0.8105      | 71              | 0.6437                 | 0.8615              | 0.7368          | 65                  | 0.8491           | 0.9           | 0.8738    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7606            | 0.8790         | 0.8155     | 0.9573           |
| 0.0261        | 96.0  | 10176 | 0.1879          | 0.7654             | 0.8732          | 0.8158      | 71              | 0.6154                 | 0.8615              | 0.7179          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7599            | 0.8847         | 0.8176     | 0.9576           |
| 0.025         | 97.0  | 10282 | 0.1894          | 0.7654             | 0.8732          | 0.8158      | 71              | 0.625                  | 0.8462              | 0.7190          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7593            | 0.8818         | 0.816      | 0.9576           |
| 0.0257        | 98.0  | 10388 | 0.1914          | 0.7683             | 0.8873          | 0.8235      | 71              | 0.6087                 | 0.8615              | 0.7134          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7531            | 0.8876         | 0.8148     | 0.9571           |
| 0.0274        | 99.0  | 10494 | 0.1901          | 0.7683             | 0.8873          | 0.8235      | 71              | 0.6087                 | 0.8615              | 0.7134          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7549            | 0.8876         | 0.8159     | 0.9568           |
| 0.0256        | 100.0 | 10600 | 0.1897          | 0.7683             | 0.8873          | 0.8235      | 71              | 0.6154                 | 0.8615              | 0.7179          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7568            | 0.8876         | 0.8170     | 0.9573           |


### Framework versions

- Transformers 4.40.2
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1