---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-pt-pl30-3
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-pt-pl30-3

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2023
- Location Precision: 0.7381
- Location Recall: 0.8732
- Location F1: 0.8
- Location Number: 71
- Organization Precision: 0.6747
- Organization Recall: 0.8615
- Organization F1: 0.7568
- Organization Number: 65
- Person Precision: 0.8634
- Person Recall: 0.9267
- Person F1: 0.8939
- Person Number: 150
- Quantity Precision: 0.7027
- Quantity Recall: 0.7879
- Quantity F1: 0.7429
- Quantity Number: 33
- Time Precision: 0.7812
- Time Recall: 0.8929
- Time F1: 0.8333
- Time Number: 28
- Overall Precision: 0.7758
- Overall Recall: 0.8876
- Overall F1: 0.8280
- Overall Accuracy: 0.9576

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9922        | 1.0   | 106   | 0.5610          | 0.0                | 0.0             | 0.0         | 71              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.0625           | 0.0067        | 0.0120    | 150           | 0.0                | 0.0             | 0.0         | 33              | 0.0            | 0.0         | 0.0     | 28          | 0.0370            | 0.0029         | 0.0053     | 0.8436           |
| 0.4811        | 2.0   | 212   | 0.3263          | 0.4815             | 0.3662          | 0.416       | 71              | 0.1475                 | 0.1385              | 0.1429          | 65                  | 0.5869           | 0.8333        | 0.6887    | 150           | 0.375              | 0.3636          | 0.3692      | 33              | 0.7333         | 0.7857      | 0.7586  | 28          | 0.4974            | 0.5591         | 0.5265     | 0.9093           |
| 0.2923        | 3.0   | 318   | 0.1902          | 0.5663             | 0.6620          | 0.6104      | 71              | 0.4268                 | 0.5385              | 0.4762          | 65                  | 0.7836           | 0.8933        | 0.8349    | 150           | 0.5476             | 0.6970          | 0.6133      | 33              | 0.75           | 0.8571      | 0.8000  | 28          | 0.6415            | 0.7579         | 0.6948     | 0.9338           |
| 0.2082        | 4.0   | 424   | 0.1540          | 0.6744             | 0.8169          | 0.7389      | 71              | 0.5306                 | 0.8                 | 0.6380          | 65                  | 0.8107           | 0.9133        | 0.8589    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.6979            | 0.8588         | 0.7700     | 0.9459           |
| 0.1772        | 5.0   | 530   | 0.1444          | 0.7024             | 0.8310          | 0.7613      | 71              | 0.6024                 | 0.7692              | 0.6757          | 65                  | 0.8303           | 0.9133        | 0.8698    | 150           | 0.5870             | 0.8182          | 0.6835      | 33              | 0.7879         | 0.9286      | 0.8525  | 28          | 0.7275            | 0.8617         | 0.7889     | 0.9513           |
| 0.1576        | 6.0   | 636   | 0.1680          | 0.6277             | 0.8310          | 0.7152      | 71              | 0.5545                 | 0.8615              | 0.6747          | 65                  | 0.8129           | 0.9267        | 0.8660    | 150           | 0.5091             | 0.8485          | 0.6364      | 33              | 0.6944         | 0.8929      | 0.7812  | 28          | 0.6718            | 0.8847         | 0.7637     | 0.9413           |
| 0.147         | 7.0   | 742   | 0.1446          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.6                    | 0.8769              | 0.7125          | 65                  | 0.8035           | 0.9267        | 0.8607    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.7353         | 0.8929      | 0.8065  | 28          | 0.7163            | 0.8876         | 0.7928     | 0.9520           |
| 0.1329        | 8.0   | 848   | 0.1405          | 0.6667             | 0.8451          | 0.7453      | 71              | 0.5816                 | 0.8769              | 0.6994          | 65                  | 0.8204           | 0.9133        | 0.8644    | 150           | 0.6829             | 0.8485          | 0.7568      | 33              | 0.8125         | 0.9286      | 0.8667  | 28          | 0.7196            | 0.8876         | 0.7948     | 0.9517           |
| 0.1309        | 9.0   | 954   | 0.1400          | 0.7375             | 0.8310          | 0.7815      | 71              | 0.5273                 | 0.8923              | 0.6629          | 65                  | 0.8395           | 0.9067        | 0.8718    | 150           | 0.5417             | 0.7879          | 0.6420      | 33              | 0.7143         | 0.8929      | 0.7937  | 28          | 0.6989            | 0.8761         | 0.7775     | 0.9471           |
| 0.1247        | 10.0  | 1060  | 0.1291          | 0.7436             | 0.8169          | 0.7785      | 71              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8333           | 0.9           | 0.8654    | 150           | 0.5778             | 0.7879          | 0.6667      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7469            | 0.8588         | 0.7989     | 0.9534           |
| 0.1149        | 11.0  | 1166  | 0.1423          | 0.7284             | 0.8310          | 0.7763      | 71              | 0.6022                 | 0.8615              | 0.7089          | 65                  | 0.8438           | 0.9           | 0.8710    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.6486         | 0.8571      | 0.7385  | 28          | 0.7253            | 0.8674         | 0.7900     | 0.9493           |
| 0.1118        | 12.0  | 1272  | 0.1524          | 0.6413             | 0.8310          | 0.7239      | 71              | 0.6                    | 0.8769              | 0.7125          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.7222         | 0.9286      | 0.8125  | 28          | 0.7140            | 0.8847         | 0.7902     | 0.9493           |
| 0.1051        | 13.0  | 1378  | 0.1298          | 0.7595             | 0.8451          | 0.8         | 71              | 0.6264                 | 0.8769              | 0.7308          | 65                  | 0.8395           | 0.9067        | 0.8718    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.9259         | 0.8929      | 0.9091  | 28          | 0.7625            | 0.8790         | 0.8166     | 0.9573           |
| 0.1071        | 14.0  | 1484  | 0.1388          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8272           | 0.8933        | 0.8590    | 150           | 0.6136             | 0.8182          | 0.7013      | 33              | 0.6667         | 0.8571      | 0.75    | 28          | 0.7396            | 0.8674         | 0.7984     | 0.9525           |
| 0.1001        | 15.0  | 1590  | 0.1400          | 0.7294             | 0.8732          | 0.7949      | 71              | 0.6196                 | 0.8769              | 0.7261          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.7576         | 0.8929      | 0.8197  | 28          | 0.7518            | 0.8905         | 0.8153     | 0.9556           |
| 0.0955        | 16.0  | 1696  | 0.1420          | 0.7326             | 0.8873          | 0.8025      | 71              | 0.5938                 | 0.8769              | 0.7081          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.5909             | 0.7879          | 0.6753      | 33              | 0.7742         | 0.8571      | 0.8136  | 28          | 0.7386            | 0.8876         | 0.8063     | 0.9542           |
| 0.0905        | 17.0  | 1802  | 0.1411          | 0.7564             | 0.8310          | 0.7919      | 71              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8447           | 0.9067        | 0.8746    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.7143         | 0.8929      | 0.7937  | 28          | 0.7519            | 0.8732         | 0.808      | 0.9566           |
| 0.0882        | 18.0  | 1908  | 0.1478          | 0.7595             | 0.8451          | 0.8         | 71              | 0.5978                 | 0.8462              | 0.7006          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.5581             | 0.7273          | 0.6316      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7457            | 0.8703         | 0.8032     | 0.9537           |
| 0.0867        | 19.0  | 2014  | 0.1366          | 0.75               | 0.8028          | 0.7755      | 71              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.85             | 0.9067        | 0.8774    | 150           | 0.6341             | 0.7879          | 0.7027      | 33              | 0.7742         | 0.8571      | 0.8136  | 28          | 0.7642            | 0.8501         | 0.8049     | 0.9581           |
| 0.083         | 20.0  | 2120  | 0.1402          | 0.7692             | 0.8451          | 0.8054      | 71              | 0.6111                 | 0.8462              | 0.7097          | 65                  | 0.8544           | 0.9           | 0.8766    | 150           | 0.6842             | 0.7879          | 0.7324      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7659            | 0.8674         | 0.8135     | 0.9578           |
| 0.0818        | 21.0  | 2226  | 0.1506          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.5816                 | 0.8769              | 0.6994          | 65                  | 0.8903           | 0.92          | 0.9049    | 150           | 0.5417             | 0.7879          | 0.6420      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7433            | 0.8847         | 0.8079     | 0.9525           |
| 0.0824        | 22.0  | 2332  | 0.1487          | 0.75               | 0.8873          | 0.8129      | 71              | 0.5978                 | 0.8462              | 0.7006          | 65                  | 0.8144           | 0.9067        | 0.8580    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7338            | 0.8818         | 0.8010     | 0.9547           |
| 0.076         | 23.0  | 2438  | 0.1387          | 0.7692             | 0.8451          | 0.8054      | 71              | 0.6222                 | 0.8615              | 0.7226          | 65                  | 0.8654           | 0.9           | 0.8824    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.9231         | 0.8571      | 0.8889  | 28          | 0.7763            | 0.8703         | 0.8207     | 0.9581           |
| 0.0745        | 24.0  | 2544  | 0.1439          | 0.75               | 0.8873          | 0.8129      | 71              | 0.6129                 | 0.8769              | 0.7215          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.6341             | 0.7879          | 0.7027      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7585            | 0.8963         | 0.8217     | 0.9581           |
| 0.0731        | 25.0  | 2650  | 0.1538          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.6064                 | 0.8769              | 0.7170          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7617            | 0.8934         | 0.8223     | 0.9571           |
| 0.0713        | 26.0  | 2756  | 0.1475          | 0.7412             | 0.8873          | 0.8077      | 71              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.5682             | 0.7576          | 0.6494      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7587            | 0.8790         | 0.8144     | 0.9568           |
| 0.0712        | 27.0  | 2862  | 0.1678          | 0.7195             | 0.8310          | 0.7712      | 71              | 0.6277                 | 0.9077              | 0.7421          | 65                  | 0.8415           | 0.92          | 0.8790    | 150           | 0.5778             | 0.7879          | 0.6667      | 33              | 0.9259         | 0.8929      | 0.9091  | 28          | 0.7451            | 0.8847         | 0.8090     | 0.9517           |
| 0.07          | 28.0  | 2968  | 0.1559          | 0.7595             | 0.8451          | 0.8         | 71              | 0.6517                 | 0.8923              | 0.7532          | 65                  | 0.85             | 0.9067        | 0.8774    | 150           | 0.5854             | 0.7273          | 0.6486      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7632            | 0.8732         | 0.8145     | 0.9544           |
| 0.0687        | 29.0  | 3074  | 0.1431          | 0.7763             | 0.8310          | 0.8027      | 71              | 0.6082                 | 0.9077              | 0.7284          | 65                  | 0.8491           | 0.9           | 0.8738    | 150           | 0.6842             | 0.7879          | 0.7324      | 33              | 0.7879         | 0.9286      | 0.8525  | 28          | 0.7568            | 0.8790         | 0.8133     | 0.9583           |
| 0.0665        | 30.0  | 3180  | 0.1464          | 0.7692             | 0.8451          | 0.8054      | 71              | 0.6629                 | 0.9077              | 0.7662          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7797            | 0.8876         | 0.8302     | 0.9595           |
| 0.0634        | 31.0  | 3286  | 0.1599          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6824                 | 0.8923              | 0.7733          | 65                  | 0.8485           | 0.9333        | 0.8889    | 150           | 0.6667             | 0.7879          | 0.7222      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7742            | 0.8991         | 0.8320     | 0.9568           |
| 0.0602        | 32.0  | 3392  | 0.1717          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.6304                 | 0.8923              | 0.7389          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.5952             | 0.7576          | 0.6667      | 33              | 0.8125         | 0.9286      | 0.8667  | 28          | 0.7476            | 0.8876         | 0.8116     | 0.9530           |
| 0.0633        | 33.0  | 3498  | 0.1526          | 0.7468             | 0.8310          | 0.7867      | 71              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6667             | 0.7879          | 0.7222      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7804            | 0.8703         | 0.8229     | 0.9556           |
| 0.0596        | 34.0  | 3604  | 0.1560          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6196                 | 0.8769              | 0.7261          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.65               | 0.7879          | 0.7123      | 33              | 0.7931         | 0.8214      | 0.8070  | 28          | 0.7562            | 0.8847         | 0.8154     | 0.9564           |
| 0.0591        | 35.0  | 3710  | 0.1562          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6196                 | 0.8769              | 0.7261          | 65                  | 0.8671           | 0.9133        | 0.8896    | 150           | 0.6667             | 0.7879          | 0.7222      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7618            | 0.8847         | 0.8187     | 0.9556           |
| 0.0582        | 36.0  | 3816  | 0.1699          | 0.7294             | 0.8732          | 0.7949      | 71              | 0.5979                 | 0.8923              | 0.7160          | 65                  | 0.8679           | 0.92          | 0.8932    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7530            | 0.8963         | 0.8184     | 0.9525           |
| 0.0567        | 37.0  | 3922  | 0.1780          | 0.6966             | 0.8732          | 0.775       | 71              | 0.6064                 | 0.8769              | 0.7170          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7404            | 0.8876         | 0.8073     | 0.9498           |
| 0.0568        | 38.0  | 4028  | 0.1589          | 0.7692             | 0.8451          | 0.8054      | 71              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6190             | 0.7879          | 0.6933      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7735            | 0.8761         | 0.8216     | 0.9568           |
| 0.0553        | 39.0  | 4134  | 0.1794          | 0.6897             | 0.8451          | 0.7595      | 71              | 0.5960                 | 0.9077              | 0.7195          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7422            | 0.8963         | 0.8120     | 0.9500           |
| 0.0522        | 40.0  | 4240  | 0.1695          | 0.7159             | 0.8873          | 0.7925      | 71              | 0.6667                 | 0.8615              | 0.7517          | 65                  | 0.8424           | 0.9267        | 0.8825    | 150           | 0.6842             | 0.7879          | 0.7324      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7592            | 0.8905         | 0.8196     | 0.9551           |
| 0.0535        | 41.0  | 4346  | 0.1679          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8405           | 0.9133        | 0.8754    | 150           | 0.6047             | 0.7879          | 0.6842      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7494            | 0.8790         | 0.8090     | 0.9517           |
| 0.0507        | 42.0  | 4452  | 0.1573          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.6429                 | 0.8308              | 0.7248          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7722            | 0.8790         | 0.8221     | 0.9561           |
| 0.0501        | 43.0  | 4558  | 0.1804          | 0.7241             | 0.8873          | 0.7975      | 71              | 0.6                    | 0.8308              | 0.6968          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7470            | 0.8847         | 0.8100     | 0.9525           |
| 0.0491        | 44.0  | 4664  | 0.1681          | 0.7262             | 0.8592          | 0.7871      | 71              | 0.5851                 | 0.8462              | 0.6918          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.75              | 0.8818         | 0.8106     | 0.9534           |
| 0.0478        | 45.0  | 4770  | 0.1648          | 0.7381             | 0.8732          | 0.8         | 71              | 0.675                  | 0.8308              | 0.7448          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7812            | 0.8847         | 0.8297     | 0.9578           |
| 0.0475        | 46.0  | 4876  | 0.1551          | 0.7209             | 0.8732          | 0.7898      | 71              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.8125         | 0.9286      | 0.8667  | 28          | 0.77              | 0.8876         | 0.8246     | 0.9581           |
| 0.0462        | 47.0  | 4982  | 0.1685          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.625                  | 0.8462              | 0.7190          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.76              | 0.8761         | 0.8139     | 0.9549           |
| 0.0467        | 48.0  | 5088  | 0.1714          | 0.75               | 0.8873          | 0.8129      | 71              | 0.6471                 | 0.8462              | 0.7333          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.7783            | 0.8905         | 0.8306     | 0.9573           |
| 0.0462        | 49.0  | 5194  | 0.1641          | 0.7439             | 0.8592          | 0.7974      | 71              | 0.675                  | 0.8308              | 0.7448          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7297             | 0.8182          | 0.7714      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7841            | 0.8790         | 0.8288     | 0.9576           |
| 0.0467        | 50.0  | 5300  | 0.1693          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7677            | 0.8761         | 0.8183     | 0.9556           |
| 0.0437        | 51.0  | 5406  | 0.1759          | 0.7209             | 0.8732          | 0.7898      | 71              | 0.625                  | 0.7692              | 0.6897          | 65                  | 0.8447           | 0.9067        | 0.8746    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7576            | 0.8646         | 0.8075     | 0.9551           |
| 0.0435        | 52.0  | 5512  | 0.1834          | 0.7326             | 0.8873          | 0.8025      | 71              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7725            | 0.8905         | 0.8273     | 0.9556           |
| 0.0441        | 53.0  | 5618  | 0.1897          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6264                 | 0.8769              | 0.7308          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7641            | 0.8963         | 0.8249     | 0.9547           |
| 0.042         | 54.0  | 5724  | 0.1875          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.6404                 | 0.8769              | 0.7403          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7592            | 0.8905         | 0.8196     | 0.9539           |
| 0.0414        | 55.0  | 5830  | 0.1868          | 0.7241             | 0.8873          | 0.7975      | 71              | 0.5934                 | 0.8308              | 0.6923          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6047             | 0.7879          | 0.6842      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7373            | 0.8818         | 0.8031     | 0.9544           |
| 0.0408        | 56.0  | 5936  | 0.1721          | 0.7561             | 0.8732          | 0.8105      | 71              | 0.6279                 | 0.8308              | 0.7152          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6842             | 0.7879          | 0.7324      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7638            | 0.8761         | 0.8161     | 0.9556           |
| 0.0388        | 57.0  | 6042  | 0.1839          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6582                 | 0.8                 | 0.7222          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.65               | 0.7879          | 0.7123      | 33              | 0.7742         | 0.8571      | 0.8136  | 28          | 0.7690            | 0.8732         | 0.8178     | 0.9566           |
| 0.039         | 58.0  | 6148  | 0.1773          | 0.7407             | 0.8451          | 0.7895      | 71              | 0.5978                 | 0.8462              | 0.7006          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.65               | 0.7879          | 0.7123      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7525            | 0.8761         | 0.8096     | 0.9527           |
| 0.0414        | 59.0  | 6254  | 0.1653          | 0.7531             | 0.8592          | 0.8026      | 71              | 0.6506                 | 0.8308              | 0.7297          | 65                  | 0.85             | 0.9067        | 0.8774    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7724            | 0.8703         | 0.8184     | 0.9578           |
| 0.0379        | 60.0  | 6360  | 0.1694          | 0.76               | 0.8028          | 0.7808      | 71              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7740            | 0.8588         | 0.8142     | 0.9561           |
| 0.0391        | 61.0  | 6466  | 0.1873          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6136                 | 0.8308              | 0.7059          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.65               | 0.7879          | 0.7123      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7556            | 0.8818         | 0.8138     | 0.9551           |
| 0.0372        | 62.0  | 6572  | 0.1785          | 0.7294             | 0.8732          | 0.7949      | 71              | 0.6429                 | 0.8308              | 0.7248          | 65                  | 0.85             | 0.9067        | 0.8774    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8387         | 0.9286      | 0.8814  | 28          | 0.7644            | 0.8790         | 0.8177     | 0.9559           |
| 0.0371        | 63.0  | 6678  | 0.1751          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7741            | 0.8790         | 0.8232     | 0.9568           |
| 0.0348        | 64.0  | 6784  | 0.1811          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6429                 | 0.8308              | 0.7248          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7297             | 0.8182          | 0.7714      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7733            | 0.8847         | 0.8253     | 0.9561           |
| 0.0338        | 65.0  | 6890  | 0.1846          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7669            | 0.8818         | 0.8204     | 0.9561           |
| 0.033         | 66.0  | 6996  | 0.1917          | 0.7126             | 0.8732          | 0.7848      | 71              | 0.6395                 | 0.8462              | 0.7285          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8125         | 0.9286      | 0.8667  | 28          | 0.7611            | 0.8905         | 0.8207     | 0.9554           |
| 0.0347        | 67.0  | 7102  | 0.1807          | 0.7625             | 0.8592          | 0.8079      | 71              | 0.6163                 | 0.8154              | 0.7020          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7710            | 0.8732         | 0.8189     | 0.9571           |
| 0.034         | 68.0  | 7208  | 0.1871          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8671           | 0.9133        | 0.8896    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7625            | 0.8790         | 0.8166     | 0.9559           |
| 0.0319        | 69.0  | 7314  | 0.1862          | 0.6966             | 0.8732          | 0.775       | 71              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7631            | 0.8818         | 0.8182     | 0.9549           |
| 0.0338        | 70.0  | 7420  | 0.1895          | 0.7294             | 0.8732          | 0.7949      | 71              | 0.6353                 | 0.8308              | 0.7200          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8667         | 0.9286      | 0.8966  | 28          | 0.77              | 0.8876         | 0.8246     | 0.9571           |
| 0.0306        | 71.0  | 7526  | 0.2061          | 0.7294             | 0.8732          | 0.7949      | 71              | 0.6395                 | 0.8462              | 0.7285          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.7576         | 0.8929      | 0.8197  | 28          | 0.7624            | 0.8876         | 0.8202     | 0.9559           |
| 0.0343        | 72.0  | 7632  | 0.1982          | 0.7011             | 0.8592          | 0.7722      | 71              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7624            | 0.8876         | 0.8202     | 0.9542           |
| 0.0308        | 73.0  | 7738  | 0.1968          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.6875                 | 0.8462              | 0.7586          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6842             | 0.7879          | 0.7324      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7747            | 0.8818         | 0.8248     | 0.9573           |
| 0.0328        | 74.0  | 7844  | 0.1993          | 0.7093             | 0.8592          | 0.7771      | 71              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7657            | 0.8761         | 0.8172     | 0.9564           |
| 0.0328        | 75.0  | 7950  | 0.1925          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.6471                 | 0.8462              | 0.7333          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7632            | 0.8732         | 0.8145     | 0.9559           |
| 0.0314        | 76.0  | 8056  | 0.1910          | 0.7160             | 0.8169          | 0.7632      | 71              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.6842             | 0.7879          | 0.7324      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7665            | 0.8703         | 0.8151     | 0.9554           |
| 0.0304        | 77.0  | 8162  | 0.1982          | 0.7011             | 0.8592          | 0.7722      | 71              | 0.6265                 | 0.8                 | 0.7027          | 65                  | 0.8405           | 0.9133        | 0.8754    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7488            | 0.8674         | 0.8037     | 0.9544           |
| 0.0318        | 78.0  | 8268  | 0.2088          | 0.7011             | 0.8592          | 0.7722      | 71              | 0.6207                 | 0.8308              | 0.7105          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.5814             | 0.7576          | 0.6579      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7372            | 0.8732         | 0.7995     | 0.9527           |
| 0.0303        | 79.0  | 8374  | 0.2029          | 0.7011             | 0.8592          | 0.7722      | 71              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8466           | 0.92          | 0.8818    | 150           | 0.6579             | 0.7576          | 0.7042      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7531            | 0.8703         | 0.8075     | 0.9539           |
| 0.0289        | 80.0  | 8480  | 0.2005          | 0.725              | 0.8169          | 0.7682      | 71              | 0.6463                 | 0.8154              | 0.7211          | 65                  | 0.8457           | 0.9133        | 0.8782    | 150           | 0.6410             | 0.7576          | 0.6944      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7544            | 0.8588         | 0.8032     | 0.9539           |
| 0.0283        | 81.0  | 8586  | 0.2005          | 0.7059             | 0.8451          | 0.7692      | 71              | 0.675                  | 0.8308              | 0.7448          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6579             | 0.7576          | 0.7042      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7620            | 0.8674         | 0.8113     | 0.9559           |
| 0.0303        | 82.0  | 8692  | 0.1980          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.6471                 | 0.8462              | 0.7333          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.6757             | 0.7576          | 0.7143      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7671            | 0.8732         | 0.8167     | 0.9571           |
| 0.0281        | 83.0  | 8798  | 0.1973          | 0.7317             | 0.8451          | 0.7843      | 71              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8509           | 0.9133        | 0.8810    | 150           | 0.6579             | 0.7576          | 0.7042      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7620            | 0.8674         | 0.8113     | 0.9551           |
| 0.0281        | 84.0  | 8904  | 0.2007          | 0.7126             | 0.8732          | 0.7848      | 71              | 0.6627                 | 0.8462              | 0.7432          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6757             | 0.7576          | 0.7143      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7625            | 0.8790         | 0.8166     | 0.9571           |
| 0.0291        | 85.0  | 9010  | 0.2045          | 0.7059             | 0.8451          | 0.7692      | 71              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.6757             | 0.7576          | 0.7143      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7594            | 0.8732         | 0.8123     | 0.9554           |
| 0.0286        | 86.0  | 9116  | 0.1912          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6588                 | 0.8615              | 0.7467          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7747            | 0.8818         | 0.8248     | 0.9588           |
| 0.0267        | 87.0  | 9222  | 0.1961          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.6588                 | 0.8615              | 0.7467          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7714            | 0.8847         | 0.8242     | 0.9576           |
| 0.0282        | 88.0  | 9328  | 0.1942          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8616           | 0.9133        | 0.8867    | 150           | 0.625              | 0.7576          | 0.6849      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7619            | 0.8761         | 0.8150     | 0.9571           |
| 0.0251        | 89.0  | 9434  | 0.2024          | 0.7294             | 0.8732          | 0.7949      | 71              | 0.6829                 | 0.8615              | 0.7619          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.625              | 0.7576          | 0.6849      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7669            | 0.8818         | 0.8204     | 0.9564           |
| 0.027         | 90.0  | 9540  | 0.1965          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7297             | 0.8182          | 0.7714      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7812            | 0.8847         | 0.8297     | 0.9583           |
| 0.0268        | 91.0  | 9646  | 0.2079          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7727            | 0.8818         | 0.8237     | 0.9561           |
| 0.0256        | 92.0  | 9752  | 0.1976          | 0.7412             | 0.8873          | 0.8077      | 71              | 0.6588                 | 0.8615              | 0.7467          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7719            | 0.8876         | 0.8257     | 0.9578           |
| 0.0258        | 93.0  | 9858  | 0.1962          | 0.7470             | 0.8732          | 0.8052      | 71              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7688            | 0.8818         | 0.8215     | 0.9578           |
| 0.0233        | 94.0  | 9964  | 0.1976          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6588                 | 0.8615              | 0.7467          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7688            | 0.8818         | 0.8215     | 0.9571           |
| 0.0259        | 95.0  | 10070 | 0.1997          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6707                 | 0.8462              | 0.7483          | 65                  | 0.8562           | 0.9133        | 0.8839    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7722            | 0.8790         | 0.8221     | 0.9583           |
| 0.0253        | 96.0  | 10176 | 0.2033          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.6667                 | 0.8615              | 0.7517          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7669            | 0.8818         | 0.8204     | 0.9564           |
| 0.0251        | 97.0  | 10282 | 0.2011          | 0.7262             | 0.8592          | 0.7871      | 71              | 0.6667                 | 0.8615              | 0.7517          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7708            | 0.8818         | 0.8226     | 0.9573           |
| 0.0237        | 98.0  | 10388 | 0.2048          | 0.7294             | 0.8732          | 0.7949      | 71              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7681            | 0.8876         | 0.8235     | 0.9566           |
| 0.024         | 99.0  | 10494 | 0.2023          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6667                 | 0.8615              | 0.7517          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7739            | 0.8876         | 0.8268     | 0.9573           |
| 0.0257        | 100.0 | 10600 | 0.2023          | 0.7381             | 0.8732          | 0.8         | 71              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8634           | 0.9267        | 0.8939    | 150           | 0.7027             | 0.7879          | 0.7429      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7758            | 0.8876         | 0.8280     | 0.9576           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2