---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-unipelt-3
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-unipelt-3

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2237
- Location Precision: 0.725
- Location Recall: 0.8169
- Location F1: 0.7682
- Location Number: 71
- Organization Precision: 0.6962
- Organization Recall: 0.8462
- Organization F1: 0.7639
- Organization Number: 65
- Person Precision: 0.8924
- Person Recall: 0.94
- Person F1: 0.9156
- Person Number: 150
- Quantity Precision: 0.7179
- Quantity Recall: 0.8485
- Quantity F1: 0.7778
- Quantity Number: 33
- Time Precision: 0.8
- Time Recall: 0.8571
- Time F1: 0.8276
- Time Number: 28
- Overall Precision: 0.7927
- Overall Recall: 0.8818
- Overall F1: 0.8349
- Overall Accuracy: 0.9612

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9512        | 1.0   | 106   | 0.6040          | 0.0                | 0.0             | 0.0         | 71              | 0.0                    | 0.0                 | 0.0             | 65                  | 0.3333           | 0.0067        | 0.0131    | 150           | 0.0                | 0.0             | 0.0         | 33              | 0.0            | 0.0         | 0.0     | 28          | 0.3333            | 0.0029         | 0.0057     | 0.8412           |
| 0.5021        | 2.0   | 212   | 0.3378          | 0.5472             | 0.4085          | 0.4677      | 71              | 0.2063                 | 0.2                 | 0.2031          | 65                  | 0.6218           | 0.8           | 0.6997    | 150           | 0.2                | 0.1818          | 0.1905      | 33              | 0.4545         | 0.5357      | 0.4918  | 28          | 0.4919            | 0.5274         | 0.5090     | 0.9076           |
| 0.2912        | 3.0   | 318   | 0.1864          | 0.5682             | 0.7042          | 0.6289      | 71              | 0.5797                 | 0.6154              | 0.5970          | 65                  | 0.7892           | 0.8733        | 0.8291    | 150           | 0.4878             | 0.6061          | 0.5405      | 33              | 0.88           | 0.7857      | 0.8302  | 28          | 0.6761            | 0.7579         | 0.7147     | 0.9377           |
| 0.1943        | 4.0   | 424   | 0.1580          | 0.6186             | 0.8451          | 0.7143      | 71              | 0.5670                 | 0.8462              | 0.6790          | 65                  | 0.8059           | 0.9133        | 0.8562    | 150           | 0.5714             | 0.8485          | 0.6829      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.6893            | 0.8761         | 0.7716     | 0.9479           |
| 0.1653        | 5.0   | 530   | 0.1364          | 0.6316             | 0.8451          | 0.7229      | 71              | 0.6049                 | 0.7538              | 0.6712          | 65                  | 0.8282           | 0.9           | 0.8626    | 150           | 0.7143             | 0.9091          | 0.8         | 33              | 0.75           | 0.8571      | 0.8000  | 28          | 0.7215            | 0.8588         | 0.7842     | 0.9525           |
| 0.152         | 6.0   | 636   | 0.1579          | 0.6383             | 0.8451          | 0.7273      | 71              | 0.5567                 | 0.8308              | 0.6667          | 65                  | 0.7943           | 0.9267        | 0.8554    | 150           | 0.6087             | 0.8485          | 0.7089      | 33              | 0.6053         | 0.8214      | 0.6970  | 28          | 0.6756            | 0.8761         | 0.7629     | 0.9447           |
| 0.1379        | 7.0   | 742   | 0.1532          | 0.6559             | 0.8592          | 0.7439      | 71              | 0.6067                 | 0.8308              | 0.7013          | 65                  | 0.7943           | 0.9267        | 0.8554    | 150           | 0.5306             | 0.7879          | 0.6341      | 33              | 0.6216         | 0.8214      | 0.7077  | 28          | 0.6840            | 0.8732         | 0.7671     | 0.9464           |
| 0.125         | 8.0   | 848   | 0.1271          | 0.6458             | 0.8732          | 0.7425      | 71              | 0.5914                 | 0.8462              | 0.6962          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.75           | 0.8571      | 0.8000  | 28          | 0.7286            | 0.8818         | 0.7979     | 0.9561           |
| 0.1161        | 9.0   | 954   | 0.1268          | 0.6829             | 0.7887          | 0.7320      | 71              | 0.5556                 | 0.8462              | 0.6707          | 65                  | 0.8519           | 0.92          | 0.8846    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7306            | 0.8674         | 0.7931     | 0.9549           |
| 0.1124        | 10.0  | 1060  | 0.1231          | 0.6988             | 0.8169          | 0.7532      | 71              | 0.6667                 | 0.8                 | 0.7273          | 65                  | 0.8434           | 0.9333        | 0.8861    | 150           | 0.6829             | 0.8485          | 0.7568      | 33              | 0.7273         | 0.8571      | 0.7869  | 28          | 0.7531            | 0.8703         | 0.8075     | 0.9593           |
| 0.1059        | 11.0  | 1166  | 0.1203          | 0.6988             | 0.8169          | 0.7532      | 71              | 0.6667                 | 0.7692              | 0.7143          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.7273         | 0.8571      | 0.7869  | 28          | 0.7596            | 0.8559         | 0.8049     | 0.9593           |
| 0.0975        | 12.0  | 1272  | 0.1371          | 0.6667             | 0.8169          | 0.7342      | 71              | 0.5833                 | 0.8615              | 0.6957          | 65                  | 0.8176           | 0.9267        | 0.8688    | 150           | 0.7368             | 0.8485          | 0.7887      | 33              | 0.6944         | 0.8929      | 0.7812  | 28          | 0.7166            | 0.8818         | 0.7907     | 0.9527           |
| 0.0915        | 13.0  | 1378  | 0.1216          | 0.7195             | 0.8310          | 0.7712      | 71              | 0.6353                 | 0.8308              | 0.7200          | 65                  | 0.8545           | 0.94          | 0.8952    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.9259         | 0.8929      | 0.9091  | 28          | 0.7708            | 0.8818         | 0.8226     | 0.9610           |
| 0.0913        | 14.0  | 1484  | 0.1168          | 0.7215             | 0.8028          | 0.76        | 71              | 0.6883                 | 0.8154              | 0.7465          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.7632             | 0.8788          | 0.8169      | 33              | 0.9231         | 0.8571      | 0.8889  | 28          | 0.7974            | 0.8732         | 0.8336     | 0.9629           |
| 0.0853        | 15.0  | 1590  | 0.1217          | 0.75               | 0.8451          | 0.7947      | 71              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8571           | 0.92          | 0.8875    | 150           | 0.7073             | 0.8788          | 0.7838      | 33              | 0.7812         | 0.8929      | 0.8333  | 28          | 0.7714            | 0.8847         | 0.8242     | 0.9605           |
| 0.0809        | 16.0  | 1696  | 0.1305          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.6667                 | 0.8615              | 0.7517          | 65                  | 0.8476           | 0.9267        | 0.8854    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7586            | 0.8876         | 0.8181     | 0.9590           |
| 0.0773        | 17.0  | 1802  | 0.1276          | 0.7059             | 0.8451          | 0.7692      | 71              | 0.6136                 | 0.8308              | 0.7059          | 65                  | 0.8598           | 0.94          | 0.8981    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.7576         | 0.8929      | 0.8197  | 28          | 0.7531            | 0.8876         | 0.8148     | 0.9590           |
| 0.0737        | 18.0  | 1908  | 0.1533          | 0.6593             | 0.8451          | 0.7407      | 71              | 0.6                    | 0.8308              | 0.6968          | 65                  | 0.8343           | 0.94          | 0.8840    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.7419         | 0.8214      | 0.7797  | 28          | 0.7193            | 0.8790         | 0.7912     | 0.9493           |
| 0.0703        | 19.0  | 2014  | 0.1193          | 0.7436             | 0.8169          | 0.7785      | 71              | 0.6790                 | 0.8462              | 0.7534          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7891            | 0.8732         | 0.8290     | 0.9631           |
| 0.0713        | 20.0  | 2120  | 0.1247          | 0.7349             | 0.8592          | 0.7922      | 71              | 0.6322                 | 0.8462              | 0.7237          | 65                  | 0.8868           | 0.94          | 0.9126    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.9615         | 0.8929      | 0.9259  | 28          | 0.7764            | 0.8905         | 0.8295     | 0.9624           |
| 0.0649        | 21.0  | 2226  | 0.1380          | 0.7093             | 0.8592          | 0.7771      | 71              | 0.5895                 | 0.8615              | 0.7             | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6667             | 0.8485          | 0.7467      | 33              | 0.7742         | 0.8571      | 0.8136  | 28          | 0.7440            | 0.8876         | 0.8095     | 0.9564           |
| 0.0645        | 22.0  | 2332  | 0.1445          | 0.7037             | 0.8028          | 0.75        | 71              | 0.6548                 | 0.8462              | 0.7383          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.6429             | 0.8182          | 0.7200      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7722            | 0.8790         | 0.8221     | 0.9588           |
| 0.0595        | 23.0  | 2438  | 0.1374          | 0.6897             | 0.8451          | 0.7595      | 71              | 0.6136                 | 0.8308              | 0.7059          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.9259         | 0.8929      | 0.9091  | 28          | 0.7744            | 0.8905         | 0.8284     | 0.9622           |
| 0.0576        | 24.0  | 2544  | 0.1402          | 0.7059             | 0.8451          | 0.7692      | 71              | 0.65                   | 0.8                 | 0.7172          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.7568             | 0.8485          | 0.8000      | 33              | 0.9259         | 0.8929      | 0.9091  | 28          | 0.7821            | 0.8790         | 0.8277     | 0.9590           |
| 0.0562        | 25.0  | 2650  | 0.1584          | 0.7059             | 0.8451          | 0.7692      | 71              | 0.6022                 | 0.8615              | 0.7089          | 65                  | 0.875            | 0.9333        | 0.9032    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.7576         | 0.8929      | 0.8197  | 28          | 0.7440            | 0.8876         | 0.8095     | 0.9554           |
| 0.0533        | 26.0  | 2756  | 0.1501          | 0.7089             | 0.7887          | 0.7467      | 71              | 0.6429                 | 0.8308              | 0.7248          | 65                  | 0.8485           | 0.9333        | 0.8889    | 150           | 0.6047             | 0.7879          | 0.6842      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7525            | 0.8674         | 0.8059     | 0.9539           |
| 0.0529        | 27.0  | 2862  | 0.1519          | 0.7093             | 0.8592          | 0.7771      | 71              | 0.6364                 | 0.8615              | 0.7320          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.6667             | 0.8485          | 0.7467      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7649            | 0.8905         | 0.8229     | 0.9576           |
| 0.0531        | 28.0  | 2968  | 0.1364          | 0.7763             | 0.8310          | 0.8027      | 71              | 0.6867                 | 0.8769              | 0.7703          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7105             | 0.8182          | 0.7606      | 33              | 0.9259         | 0.8929      | 0.9091  | 28          | 0.7969            | 0.8818         | 0.8372     | 0.9641           |
| 0.0463        | 29.0  | 3074  | 0.1396          | 0.7403             | 0.8028          | 0.7703      | 71              | 0.6552                 | 0.8769              | 0.75            | 65                  | 0.8704           | 0.94          | 0.9038    | 150           | 0.8056             | 0.8788          | 0.8406      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7897            | 0.8876         | 0.8358     | 0.9624           |
| 0.0466        | 30.0  | 3180  | 0.1535          | 0.7564             | 0.8310          | 0.7919      | 71              | 0.6196                 | 0.8769              | 0.7261          | 65                  | 0.8696           | 0.9333        | 0.9003    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.77              | 0.8876         | 0.8246     | 0.9585           |
| 0.0449        | 31.0  | 3286  | 0.1608          | 0.7093             | 0.8592          | 0.7771      | 71              | 0.6835                 | 0.8308              | 0.75            | 65                  | 0.8765           | 0.9467        | 0.9103    | 150           | 0.6829             | 0.8485          | 0.7568      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7783            | 0.8905         | 0.8306     | 0.9593           |
| 0.043         | 32.0  | 3392  | 0.1635          | 0.6860             | 0.8310          | 0.7516      | 71              | 0.6136                 | 0.8308              | 0.7059          | 65                  | 0.8765           | 0.9467        | 0.9103    | 150           | 0.6190             | 0.7879          | 0.6933      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7482            | 0.8818         | 0.8095     | 0.9556           |
| 0.0394        | 33.0  | 3498  | 0.1503          | 0.75               | 0.8028          | 0.7755      | 71              | 0.6543                 | 0.8154              | 0.7260          | 65                  | 0.8987           | 0.9467        | 0.9221    | 150           | 0.7838             | 0.8788          | 0.8286      | 33              | 0.8889         | 0.8571      | 0.8727  | 28          | 0.8047            | 0.8790         | 0.8402     | 0.9641           |
| 0.0412        | 34.0  | 3604  | 0.1466          | 0.7662             | 0.8310          | 0.7973      | 71              | 0.6951                 | 0.8769              | 0.7755          | 65                  | 0.8987           | 0.9467        | 0.9221    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.8889         | 0.8571      | 0.8727  | 28          | 0.8073            | 0.8934         | 0.8482     | 0.9646           |
| 0.0403        | 35.0  | 3710  | 0.1525          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.675                  | 0.8308              | 0.7448          | 65                  | 0.8765           | 0.9467        | 0.9103    | 150           | 0.6585             | 0.8182          | 0.7297      | 33              | 0.8065         | 0.8929      | 0.8475  | 28          | 0.7739            | 0.8876         | 0.8268     | 0.9619           |
| 0.0385        | 36.0  | 3816  | 0.1817          | 0.7564             | 0.8310          | 0.7919      | 71              | 0.6333                 | 0.8769              | 0.7355          | 65                  | 0.8503           | 0.9467        | 0.8959    | 150           | 0.6279             | 0.8182          | 0.7105      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7635            | 0.8934         | 0.8234     | 0.9551           |
| 0.037         | 37.0  | 3922  | 0.2012          | 0.6824             | 0.8169          | 0.7436      | 71              | 0.6279                 | 0.8308              | 0.7152          | 65                  | 0.8512           | 0.9533        | 0.8994    | 150           | 0.5652             | 0.7879          | 0.6582      | 33              | 0.7742         | 0.8571      | 0.8136  | 28          | 0.7332            | 0.8790         | 0.7995     | 0.9517           |
| 0.037         | 38.0  | 4028  | 0.1582          | 0.7532             | 0.8169          | 0.7838      | 71              | 0.7260                 | 0.8154              | 0.7681          | 65                  | 0.8688           | 0.9267        | 0.8968    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.9615         | 0.8929      | 0.9259  | 28          | 0.8059            | 0.8732         | 0.8382     | 0.9607           |
| 0.0332        | 39.0  | 4134  | 0.1699          | 0.75               | 0.8451          | 0.7947      | 71              | 0.6706                 | 0.8769              | 0.76            | 65                  | 0.8720           | 0.9533        | 0.9108    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7834            | 0.8963         | 0.8360     | 0.9610           |
| 0.0354        | 40.0  | 4240  | 0.1586          | 0.75               | 0.8451          | 0.7947      | 71              | 0.6795                 | 0.8154              | 0.7413          | 65                  | 0.8712           | 0.9467        | 0.9073    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.7059         | 0.8571      | 0.7742  | 28          | 0.7772            | 0.8847         | 0.8275     | 0.9612           |
| 0.0331        | 41.0  | 4346  | 0.1633          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.6829                 | 0.8615              | 0.7619          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7792            | 0.8847         | 0.8286     | 0.9607           |
| 0.0312        | 42.0  | 4452  | 0.1706          | 0.7436             | 0.8169          | 0.7785      | 71              | 0.675                  | 0.8308              | 0.7448          | 65                  | 0.8650           | 0.94          | 0.9010    | 150           | 0.65               | 0.7879          | 0.7123      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7795            | 0.8761         | 0.8250     | 0.9595           |
| 0.031         | 43.0  | 4558  | 0.1645          | 0.7176             | 0.8592          | 0.7821      | 71              | 0.7027                 | 0.8                 | 0.7482          | 65                  | 0.8712           | 0.9467        | 0.9073    | 150           | 0.75               | 0.9091          | 0.8219      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7883            | 0.8905         | 0.8363     | 0.9619           |
| 0.0305        | 44.0  | 4664  | 0.1853          | 0.7317             | 0.8451          | 0.7843      | 71              | 0.6628                 | 0.8769              | 0.7550          | 65                  | 0.8659           | 0.9467        | 0.9045    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7775            | 0.8963         | 0.8327     | 0.9610           |
| 0.0284        | 45.0  | 4770  | 0.1658          | 0.7468             | 0.8310          | 0.7867      | 71              | 0.7067                 | 0.8154              | 0.7571          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7947            | 0.8703         | 0.8308     | 0.9634           |
| 0.028         | 46.0  | 4876  | 0.1733          | 0.7073             | 0.8169          | 0.7582      | 71              | 0.6463                 | 0.8154              | 0.7211          | 65                  | 0.8868           | 0.94          | 0.9126    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7775            | 0.8761         | 0.8238     | 0.9600           |
| 0.0257        | 47.0  | 4982  | 0.1833          | 0.7763             | 0.8310          | 0.8027      | 71              | 0.6437                 | 0.8615              | 0.7368          | 65                  | 0.8712           | 0.9467        | 0.9073    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7843            | 0.8905         | 0.8340     | 0.9590           |
| 0.0281        | 48.0  | 5088  | 0.1702          | 0.7532             | 0.8169          | 0.7838      | 71              | 0.6625                 | 0.8154              | 0.7310          | 65                  | 0.8580           | 0.9267        | 0.8910    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8846         | 0.8214      | 0.8519  | 28          | 0.7839            | 0.8674         | 0.8235     | 0.9607           |
| 0.0245        | 49.0  | 5194  | 0.1863          | 0.7143             | 0.8451          | 0.7742      | 71              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8820           | 0.9467        | 0.9132    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7758            | 0.8876         | 0.8280     | 0.9614           |
| 0.0251        | 50.0  | 5300  | 0.1628          | 0.7468             | 0.8310          | 0.7867      | 71              | 0.7123                 | 0.8                 | 0.7536          | 65                  | 0.8910           | 0.9267        | 0.9085    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.808             | 0.8732         | 0.8393     | 0.9639           |
| 0.0251        | 51.0  | 5406  | 0.1653          | 0.7284             | 0.8310          | 0.7763      | 71              | 0.7647                 | 0.8                 | 0.7820          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8889         | 0.8571      | 0.8727  | 28          | 0.8150            | 0.8761         | 0.8444     | 0.9663           |
| 0.0245        | 52.0  | 5512  | 0.1833          | 0.7468             | 0.8310          | 0.7867      | 71              | 0.6706                 | 0.8769              | 0.76            | 65                  | 0.8659           | 0.9467        | 0.9045    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7783            | 0.8905         | 0.8306     | 0.9602           |
| 0.0222        | 53.0  | 5618  | 0.1887          | 0.6897             | 0.8451          | 0.7595      | 71              | 0.6585                 | 0.8308              | 0.7347          | 65                  | 0.8765           | 0.9467        | 0.9103    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.77              | 0.8876         | 0.8246     | 0.9595           |
| 0.024         | 54.0  | 5724  | 0.1765          | 0.7564             | 0.8310          | 0.7919      | 71              | 0.6744                 | 0.8923              | 0.7682          | 65                  | 0.8820           | 0.9467        | 0.9132    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7964            | 0.9020         | 0.8459     | 0.9634           |
| 0.0238        | 55.0  | 5830  | 0.1749          | 0.7468             | 0.8310          | 0.7867      | 71              | 0.6951                 | 0.8769              | 0.7755          | 65                  | 0.8931           | 0.9467        | 0.9191    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.9615         | 0.8929      | 0.9259  | 28          | 0.8057            | 0.8963         | 0.8486     | 0.9646           |
| 0.021         | 56.0  | 5936  | 0.1799          | 0.6905             | 0.8169          | 0.7484      | 71              | 0.6667                 | 0.8308              | 0.7397          | 65                  | 0.8812           | 0.94          | 0.9097    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8333         | 0.8929      | 0.8621  | 28          | 0.7766            | 0.8818         | 0.8259     | 0.9602           |
| 0.0199        | 57.0  | 6042  | 0.1942          | 0.7284             | 0.8310          | 0.7763      | 71              | 0.7123                 | 0.8                 | 0.7536          | 65                  | 0.8765           | 0.9467        | 0.9103    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.9259         | 0.8929      | 0.9091  | 28          | 0.8037            | 0.8847         | 0.8422     | 0.9619           |
| 0.0187        | 58.0  | 6148  | 0.1905          | 0.7037             | 0.8028          | 0.75        | 71              | 0.7123                 | 0.8                 | 0.7536          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7916            | 0.8646         | 0.8264     | 0.9610           |
| 0.0199        | 59.0  | 6254  | 0.1940          | 0.7073             | 0.8169          | 0.7582      | 71              | 0.6883                 | 0.8154              | 0.7465          | 65                  | 0.8846           | 0.92          | 0.9020    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.7931         | 0.8214      | 0.8070  | 28          | 0.7859            | 0.8674         | 0.8247     | 0.9593           |
| 0.0183        | 60.0  | 6360  | 0.1952          | 0.7436             | 0.8169          | 0.7785      | 71              | 0.6512                 | 0.8615              | 0.7417          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7821            | 0.8790         | 0.8277     | 0.9600           |
| 0.0178        | 61.0  | 6466  | 0.1902          | 0.7534             | 0.7746          | 0.7639      | 71              | 0.7                    | 0.8615              | 0.7724          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.7895             | 0.9091          | 0.8451      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.8042            | 0.8761         | 0.8386     | 0.9622           |
| 0.0196        | 62.0  | 6572  | 0.1832          | 0.7436             | 0.8169          | 0.7785      | 71              | 0.6835                 | 0.8308              | 0.75            | 65                  | 0.8726           | 0.9133        | 0.8925    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8214         | 0.8214      | 0.8214  | 28          | 0.7900            | 0.8674         | 0.8269     | 0.9622           |
| 0.0182        | 63.0  | 6678  | 0.1880          | 0.7308             | 0.8028          | 0.7651      | 71              | 0.6829                 | 0.8615              | 0.7619          | 65                  | 0.8726           | 0.9133        | 0.8925    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7818            | 0.8674         | 0.8224     | 0.9617           |
| 0.0181        | 64.0  | 6784  | 0.1929          | 0.725              | 0.8169          | 0.7682      | 71              | 0.6875                 | 0.8462              | 0.7586          | 65                  | 0.8625           | 0.92          | 0.8903    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7789            | 0.8732         | 0.8234     | 0.9590           |
| 0.0187        | 65.0  | 6890  | 0.1914          | 0.7284             | 0.8310          | 0.7763      | 71              | 0.7260                 | 0.8154              | 0.7681          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7989            | 0.8703         | 0.8331     | 0.9614           |
| 0.016         | 66.0  | 6996  | 0.2022          | 0.7195             | 0.8310          | 0.7712      | 71              | 0.6923                 | 0.8308              | 0.7552          | 65                  | 0.8797           | 0.9267        | 0.9026    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7809            | 0.8732         | 0.8245     | 0.9602           |
| 0.0153        | 67.0  | 7102  | 0.1922          | 0.7125             | 0.8028          | 0.7550      | 71              | 0.7067                 | 0.8154              | 0.7571          | 65                  | 0.8812           | 0.94          | 0.9097    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7917            | 0.8761         | 0.8317     | 0.9607           |
| 0.0165        | 68.0  | 7208  | 0.2077          | 0.7215             | 0.8028          | 0.76        | 71              | 0.6747                 | 0.8615              | 0.7568          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7829            | 0.8732         | 0.8256     | 0.9610           |
| 0.0159        | 69.0  | 7314  | 0.2018          | 0.7125             | 0.8028          | 0.7550      | 71              | 0.6835                 | 0.8308              | 0.75            | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.725              | 0.8788          | 0.7945      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7902            | 0.8790         | 0.8322     | 0.9619           |
| 0.0151        | 70.0  | 7420  | 0.2193          | 0.6867             | 0.8028          | 0.7403      | 71              | 0.7013                 | 0.8308              | 0.7606          | 65                  | 0.8910           | 0.9267        | 0.9085    | 150           | 0.675              | 0.8182          | 0.7397      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7798            | 0.8674         | 0.8213     | 0.9588           |
| 0.0149        | 71.0  | 7526  | 0.2117          | 0.7284             | 0.8310          | 0.7763      | 71              | 0.6914                 | 0.8615              | 0.7671          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7912            | 0.8847         | 0.8354     | 0.9614           |
| 0.0152        | 72.0  | 7632  | 0.1995          | 0.7342             | 0.8169          | 0.7733      | 71              | 0.7143                 | 0.8462              | 0.7746          | 65                  | 0.8846           | 0.92          | 0.9020    | 150           | 0.7632             | 0.8788          | 0.8169      | 33              | 0.8519         | 0.8214      | 0.8364  | 28          | 0.8037            | 0.8732         | 0.8370     | 0.9624           |
| 0.0149        | 73.0  | 7738  | 0.2208          | 0.7024             | 0.8310          | 0.7613      | 71              | 0.6829                 | 0.8615              | 0.7619          | 65                  | 0.8868           | 0.94          | 0.9126    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7837            | 0.8876         | 0.8324     | 0.9610           |
| 0.0141        | 74.0  | 7844  | 0.2141          | 0.7273             | 0.7887          | 0.7568      | 71              | 0.7297                 | 0.8308              | 0.7770          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.8037            | 0.8732         | 0.8370     | 0.9624           |
| 0.0142        | 75.0  | 7950  | 0.2097          | 0.7108             | 0.8310          | 0.7662      | 71              | 0.6582                 | 0.8                 | 0.7222          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7855            | 0.8761         | 0.8283     | 0.9610           |
| 0.0132        | 76.0  | 8056  | 0.2149          | 0.7160             | 0.8169          | 0.7632      | 71              | 0.6974                 | 0.8154              | 0.7518          | 65                  | 0.8812           | 0.94          | 0.9097    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7922            | 0.8790         | 0.8333     | 0.9619           |
| 0.0132        | 77.0  | 8162  | 0.2158          | 0.6905             | 0.8169          | 0.7484      | 71              | 0.7105                 | 0.8308              | 0.7660          | 65                  | 0.8868           | 0.94          | 0.9126    | 150           | 0.6923             | 0.8182          | 0.7500      | 33              | 0.8929         | 0.8929      | 0.8929  | 28          | 0.7902            | 0.8790         | 0.8322     | 0.9607           |
| 0.0141        | 78.0  | 8268  | 0.2088          | 0.7125             | 0.8028          | 0.7550      | 71              | 0.7013                 | 0.8308              | 0.7606          | 65                  | 0.8846           | 0.92          | 0.9020    | 150           | 0.7                | 0.8485          | 0.7671      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7880            | 0.8674         | 0.8258     | 0.9607           |
| 0.0117        | 79.0  | 8374  | 0.2092          | 0.7125             | 0.8028          | 0.7550      | 71              | 0.7361                 | 0.8154              | 0.7737          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.8016            | 0.8732         | 0.8359     | 0.9614           |
| 0.0127        | 80.0  | 8480  | 0.2205          | 0.7                | 0.7887          | 0.7417      | 71              | 0.6835                 | 0.8308              | 0.75            | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8889         | 0.8571      | 0.8727  | 28          | 0.7885            | 0.8703         | 0.8274     | 0.9588           |
| 0.0134        | 81.0  | 8586  | 0.2093          | 0.7215             | 0.8028          | 0.76        | 71              | 0.7361                 | 0.8154              | 0.7737          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.8037            | 0.8732         | 0.8370     | 0.9631           |
| 0.0138        | 82.0  | 8692  | 0.2078          | 0.725              | 0.8169          | 0.7682      | 71              | 0.7105                 | 0.8308              | 0.7660          | 65                  | 0.8854           | 0.9267        | 0.9055    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7979            | 0.8761         | 0.8352     | 0.9612           |
| 0.0129        | 83.0  | 8798  | 0.2170          | 0.7                | 0.7887          | 0.7417      | 71              | 0.7051                 | 0.8462              | 0.7692          | 65                  | 0.8742           | 0.9267        | 0.8997    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7844            | 0.8703         | 0.8251     | 0.9600           |
| 0.0119        | 84.0  | 8904  | 0.2103          | 0.7195             | 0.8310          | 0.7712      | 71              | 0.7067                 | 0.8154              | 0.7571          | 65                  | 0.8734           | 0.92          | 0.8961    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7911            | 0.8732         | 0.8301     | 0.9612           |
| 0.0117        | 85.0  | 9010  | 0.2209          | 0.7160             | 0.8169          | 0.7632      | 71              | 0.6951                 | 0.8769              | 0.7755          | 65                  | 0.8868           | 0.94          | 0.9126    | 150           | 0.725              | 0.8788          | 0.7945      | 33              | 0.7931         | 0.8214      | 0.8070  | 28          | 0.7877            | 0.8876         | 0.8347     | 0.9597           |
| 0.0129        | 86.0  | 9116  | 0.2100          | 0.7160             | 0.8169          | 0.7632      | 71              | 0.7105                 | 0.8308              | 0.7660          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7969            | 0.8818         | 0.8372     | 0.9619           |
| 0.0107        | 87.0  | 9222  | 0.2151          | 0.7125             | 0.8028          | 0.7550      | 71              | 0.7051                 | 0.8462              | 0.7692          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7969            | 0.8818         | 0.8372     | 0.9617           |
| 0.0121        | 88.0  | 9328  | 0.2126          | 0.7342             | 0.8169          | 0.7733      | 71              | 0.7105                 | 0.8308              | 0.7660          | 65                  | 0.8790           | 0.92          | 0.8990    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.7968            | 0.8703         | 0.8320     | 0.9614           |
| 0.0104        | 89.0  | 9434  | 0.2102          | 0.7342             | 0.8169          | 0.7733      | 71              | 0.7333                 | 0.8462              | 0.7857          | 65                  | 0.8861           | 0.9333        | 0.9091    | 150           | 0.7368             | 0.8485          | 0.7887      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.8047            | 0.8790         | 0.8402     | 0.9631           |
| 0.0114        | 90.0  | 9540  | 0.2103          | 0.725              | 0.8169          | 0.7682      | 71              | 0.7397                 | 0.8308              | 0.7826          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8571         | 0.8571      | 0.8571  | 28          | 0.8021            | 0.8761         | 0.8375     | 0.9629           |
| 0.0105        | 91.0  | 9646  | 0.2144          | 0.7160             | 0.8169          | 0.7632      | 71              | 0.7297                 | 0.8308              | 0.7770          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8276         | 0.8571      | 0.8421  | 28          | 0.7984            | 0.8790         | 0.8368     | 0.9629           |
| 0.011         | 92.0  | 9752  | 0.2228          | 0.7037             | 0.8028          | 0.75        | 71              | 0.7051                 | 0.8462              | 0.7692          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7927            | 0.8818         | 0.8349     | 0.9607           |
| 0.0107        | 93.0  | 9858  | 0.2212          | 0.7160             | 0.8169          | 0.7632      | 71              | 0.6923                 | 0.8308              | 0.7552          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7927            | 0.8818         | 0.8349     | 0.9610           |
| 0.009         | 94.0  | 9964  | 0.2232          | 0.7160             | 0.8169          | 0.7632      | 71              | 0.6875                 | 0.8462              | 0.7586          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7436             | 0.8788          | 0.8056      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7912            | 0.8847         | 0.8354     | 0.9619           |
| 0.0109        | 95.0  | 10070 | 0.2274          | 0.6951             | 0.8028          | 0.7451      | 71              | 0.6923                 | 0.8308              | 0.7552          | 65                  | 0.8917           | 0.9333        | 0.9121    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7896            | 0.8761         | 0.8306     | 0.9593           |
| 0.0098        | 96.0  | 10176 | 0.2233          | 0.7160             | 0.8169          | 0.7632      | 71              | 0.7051                 | 0.8462              | 0.7692          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8621         | 0.8929      | 0.8772  | 28          | 0.7974            | 0.8847         | 0.8388     | 0.9614           |
| 0.0103        | 97.0  | 10282 | 0.2204          | 0.7125             | 0.8028          | 0.7550      | 71              | 0.6962                 | 0.8462              | 0.7639          | 65                  | 0.8805           | 0.9333        | 0.9061    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7855            | 0.8761         | 0.8283     | 0.9610           |
| 0.0102        | 98.0  | 10388 | 0.2219          | 0.725              | 0.8169          | 0.7682      | 71              | 0.6962                 | 0.8462              | 0.7639          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7927            | 0.8818         | 0.8349     | 0.9612           |
| 0.0094        | 99.0  | 10494 | 0.2234          | 0.7125             | 0.8028          | 0.7550      | 71              | 0.6962                 | 0.8462              | 0.7639          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7902            | 0.8790         | 0.8322     | 0.9610           |
| 0.0098        | 100.0 | 10600 | 0.2237          | 0.725              | 0.8169          | 0.7682      | 71              | 0.6962                 | 0.8462              | 0.7639          | 65                  | 0.8924           | 0.94          | 0.9156    | 150           | 0.7179             | 0.8485          | 0.7778      | 33              | 0.8            | 0.8571      | 0.8276  | 28          | 0.7927            | 0.8818         | 0.8349     | 0.9612           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2