---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-lora-r8-2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-lora-r8-2

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1373
- Location Precision: 0.7229
- Location Recall: 0.8333
- Location F1: 0.7742
- Location Number: 72
- Organization Precision: 0.7111
- Organization Recall: 0.8533
- Organization F1: 0.7758
- Organization Number: 75
- Person Precision: 0.8323
- Person Recall: 0.9371
- Person F1: 0.8816
- Person Number: 143
- Quantity Precision: 0.5
- Quantity Recall: 0.6957
- Quantity F1: 0.5818
- Quantity Number: 23
- Time Precision: 0.7333
- Time Recall: 0.8462
- Time F1: 0.7857
- Time Number: 26
- Overall Precision: 0.7475
- Overall Recall: 0.8732
- Overall F1: 0.8054
- Overall Accuracy: 0.9567

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.2425        | 1.0   | 106   | 0.7045          | 0.0                | 0.0             | 0.0         | 72              | 0.0                    | 0.0                 | 0.0             | 75                  | 0.0              | 0.0           | 0.0       | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.0            | 0.0         | 0.0     | 26          | 0.0               | 0.0            | 0.0        | 0.8449           |
| 0.7049        | 2.0   | 212   | 0.5984          | 0.0                | 0.0             | 0.0         | 72              | 0.0                    | 0.0                 | 0.0             | 75                  | 0.0              | 0.0           | 0.0       | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.0            | 0.0         | 0.0     | 26          | 0.0               | 0.0            | 0.0        | 0.8456           |
| 0.6175        | 3.0   | 318   | 0.5003          | 0.0                | 0.0             | 0.0         | 72              | 0.0                    | 0.0                 | 0.0             | 75                  | 0.25             | 0.0280        | 0.0503    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.0            | 0.0         | 0.0     | 26          | 0.1481            | 0.0118         | 0.0219     | 0.8511           |
| 0.5236        | 4.0   | 424   | 0.4111          | 0.6667             | 0.0833          | 0.1481      | 72              | 0.0556                 | 0.0133              | 0.0215          | 75                  | 0.4043           | 0.2657        | 0.3207    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.4706         | 0.3077      | 0.3721  | 26          | 0.3841            | 0.1563         | 0.2222     | 0.8799           |
| 0.4275        | 5.0   | 530   | 0.3293          | 0.5652             | 0.3611          | 0.4407      | 72              | 0.3864                 | 0.2267              | 0.2857          | 75                  | 0.6323           | 0.6853        | 0.6577    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.7273         | 0.6154      | 0.6667  | 26          | 0.5607            | 0.4631         | 0.5073     | 0.9134           |
| 0.3439        | 6.0   | 636   | 0.2720          | 0.5833             | 0.5833          | 0.5833      | 72              | 0.4429                 | 0.4133              | 0.4276          | 75                  | 0.7029           | 0.8601        | 0.7736    | 143           | 0.1923             | 0.2174          | 0.2041      | 23              | 0.6552         | 0.7308      | 0.6909  | 26          | 0.5914            | 0.6490         | 0.6188     | 0.9282           |
| 0.2863        | 7.0   | 742   | 0.2361          | 0.6386             | 0.7361          | 0.6839      | 72              | 0.5065                 | 0.52                | 0.5132          | 75                  | 0.7399           | 0.8951        | 0.8101    | 143           | 0.2667             | 0.3478          | 0.3019      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.6327            | 0.7316         | 0.6785     | 0.9332           |
| 0.2491        | 8.0   | 848   | 0.2097          | 0.6951             | 0.7917          | 0.7403      | 72              | 0.5269                 | 0.6533              | 0.5833          | 75                  | 0.7588           | 0.9021        | 0.8243    | 143           | 0.2667             | 0.3478          | 0.3019      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.6510            | 0.7758         | 0.7079     | 0.9377           |
| 0.2268        | 9.0   | 954   | 0.1984          | 0.7176             | 0.8472          | 0.7771      | 72              | 0.5052                 | 0.6533              | 0.5698          | 75                  | 0.7602           | 0.9091        | 0.8280    | 143           | 0.3704             | 0.4348          | 0.4000      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.6610            | 0.7994         | 0.7236     | 0.9390           |
| 0.2079        | 10.0  | 1060  | 0.1859          | 0.7126             | 0.8611          | 0.7799      | 72              | 0.5104                 | 0.6533              | 0.5731          | 75                  | 0.7616           | 0.9161        | 0.8317    | 143           | 0.3939             | 0.5652          | 0.4643      | 23              | 0.6774         | 0.8077      | 0.7368  | 26          | 0.6587            | 0.8142         | 0.7282     | 0.9402           |
| 0.196         | 11.0  | 1166  | 0.1741          | 0.7381             | 0.8611          | 0.7949      | 72              | 0.5294                 | 0.72                | 0.6102          | 75                  | 0.7588           | 0.9021        | 0.8243    | 143           | 0.3714             | 0.5652          | 0.4483      | 23              | 0.6562         | 0.8077      | 0.7241  | 26          | 0.6596            | 0.8230         | 0.7323     | 0.9425           |
| 0.1883        | 12.0  | 1272  | 0.1675          | 0.7317             | 0.8333          | 0.7792      | 72              | 0.5591                 | 0.6933              | 0.6190          | 75                  | 0.7692           | 0.9091        | 0.8333    | 143           | 0.4828             | 0.6087          | 0.5385      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.6873            | 0.8171         | 0.7466     | 0.9445           |
| 0.1791        | 13.0  | 1378  | 0.1607          | 0.7692             | 0.8333          | 0.8         | 72              | 0.5545                 | 0.7467              | 0.6364          | 75                  | 0.7811           | 0.9231        | 0.8462    | 143           | 0.4333             | 0.5652          | 0.4906      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.6912            | 0.8319         | 0.7550     | 0.9475           |
| 0.1739        | 14.0  | 1484  | 0.1563          | 0.7733             | 0.8056          | 0.7891      | 72              | 0.5481                 | 0.76                | 0.6369          | 75                  | 0.8137           | 0.9161        | 0.8618    | 143           | 0.4286             | 0.5217          | 0.4706      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7028            | 0.8230         | 0.7582     | 0.9482           |
| 0.1715        | 15.0  | 1590  | 0.1506          | 0.7692             | 0.8333          | 0.8         | 72              | 0.5670                 | 0.7333              | 0.6395          | 75                  | 0.8199           | 0.9231        | 0.8684    | 143           | 0.5                | 0.6087          | 0.5490      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7157            | 0.8319         | 0.7694     | 0.9510           |
| 0.164         | 16.0  | 1696  | 0.1555          | 0.7375             | 0.8194          | 0.7763      | 72              | 0.5648                 | 0.8133              | 0.6667          | 75                  | 0.8049           | 0.9231        | 0.8599    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7087            | 0.8614         | 0.7776     | 0.9507           |
| 0.1562        | 17.0  | 1802  | 0.1546          | 0.7381             | 0.8611          | 0.7949      | 72              | 0.5882                 | 0.8                 | 0.6780          | 75                  | 0.8049           | 0.9231        | 0.8599    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.6774         | 0.8077      | 0.7368  | 26          | 0.7101            | 0.8673         | 0.7809     | 0.9517           |
| 0.1566        | 18.0  | 1908  | 0.1545          | 0.7349             | 0.8472          | 0.7871      | 72              | 0.5556                 | 0.8                 | 0.6557          | 75                  | 0.7927           | 0.9091        | 0.8469    | 143           | 0.6129             | 0.8261          | 0.7037      | 23              | 0.7097         | 0.8462      | 0.7719  | 26          | 0.7002            | 0.8614         | 0.7725     | 0.9507           |
| 0.1515        | 19.0  | 2014  | 0.1474          | 0.7195             | 0.8194          | 0.7662      | 72              | 0.6129                 | 0.76                | 0.6786          | 75                  | 0.7904           | 0.9231        | 0.8516    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.7419         | 0.8846      | 0.8070  | 26          | 0.7143            | 0.8555         | 0.7785     | 0.9527           |
| 0.1462        | 20.0  | 2120  | 0.1590          | 0.7093             | 0.8472          | 0.7722      | 72              | 0.5439                 | 0.8267              | 0.6561          | 75                  | 0.7844           | 0.9161        | 0.8452    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.6875         | 0.8462      | 0.7586  | 26          | 0.6829            | 0.8702         | 0.7652     | 0.9477           |
| 0.147         | 21.0  | 2226  | 0.1474          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6289                 | 0.8133              | 0.7093          | 75                  | 0.8061           | 0.9301        | 0.8636    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7284            | 0.8702         | 0.7930     | 0.9552           |
| 0.1439        | 22.0  | 2332  | 0.1480          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.5962                 | 0.8267              | 0.6927          | 75                  | 0.8110           | 0.9301        | 0.8664    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7251            | 0.8791         | 0.7947     | 0.9537           |
| 0.1409        | 23.0  | 2438  | 0.1461          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.5905                 | 0.8267              | 0.6889          | 75                  | 0.8110           | 0.9301        | 0.8664    | 143           | 0.6129             | 0.8261          | 0.7037      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7251            | 0.8791         | 0.7947     | 0.9545           |
| 0.1404        | 24.0  | 2544  | 0.1476          | 0.7262             | 0.8472          | 0.7821      | 72              | 0.6019                 | 0.8267              | 0.6966          | 75                  | 0.8272           | 0.9371        | 0.8787    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7275            | 0.8820         | 0.7973     | 0.9545           |
| 0.1389        | 25.0  | 2650  | 0.1446          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6196                 | 0.76                | 0.6826          | 75                  | 0.8272           | 0.9371        | 0.8787    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7419         | 0.8846      | 0.8070  | 26          | 0.7362            | 0.8643         | 0.7951     | 0.9552           |
| 0.1364        | 26.0  | 2756  | 0.1441          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6263                 | 0.8267              | 0.7126          | 75                  | 0.8221           | 0.9371        | 0.8758    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7279            | 0.8761         | 0.7952     | 0.9547           |
| 0.1312        | 27.0  | 2862  | 0.1471          | 0.7262             | 0.8472          | 0.7821      | 72              | 0.6705                 | 0.7867              | 0.7239          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.75              | 0.8761         | 0.8082     | 0.9562           |
| 0.1322        | 28.0  | 2968  | 0.1390          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6593                 | 0.8                 | 0.7229          | 75                  | 0.8199           | 0.9231        | 0.8684    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7462            | 0.8673         | 0.8022     | 0.9565           |
| 0.132         | 29.0  | 3074  | 0.1382          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6105                 | 0.7733              | 0.6824          | 75                  | 0.8438           | 0.9441        | 0.8911    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7431            | 0.8702         | 0.8016     | 0.9562           |
| 0.1343        | 30.0  | 3180  | 0.1431          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6224                 | 0.8133              | 0.7052          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7431            | 0.8791         | 0.8054     | 0.9560           |
| 0.1269        | 31.0  | 3286  | 0.1384          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6452                 | 0.8                 | 0.7143          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7481            | 0.8761         | 0.8071     | 0.9565           |
| 0.1254        | 32.0  | 3392  | 0.1354          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6186                 | 0.8                 | 0.6977          | 75                  | 0.8438           | 0.9441        | 0.8911    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7425            | 0.8761         | 0.8038     | 0.9565           |
| 0.1235        | 33.0  | 3498  | 0.1374          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6452                 | 0.8                 | 0.7143          | 75                  | 0.8438           | 0.9441        | 0.8911    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7437            | 0.8732         | 0.8033     | 0.9562           |
| 0.1209        | 34.0  | 3604  | 0.1420          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6186                 | 0.8                 | 0.6977          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7368            | 0.8673         | 0.7967     | 0.9552           |
| 0.1259        | 35.0  | 3710  | 0.1349          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.625                  | 0.8                 | 0.7018          | 75                  | 0.8418           | 0.9301        | 0.8837    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7424            | 0.8673         | 0.8000     | 0.9565           |
| 0.1202        | 36.0  | 3816  | 0.1339          | 0.75               | 0.8333          | 0.7895      | 72              | 0.6782                 | 0.7867              | 0.7284          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7552            | 0.8643         | 0.8061     | 0.9580           |
| 0.1196        | 37.0  | 3922  | 0.1388          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6040                 | 0.8133              | 0.6932          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7302            | 0.8702         | 0.7941     | 0.9547           |
| 0.1162        | 38.0  | 4028  | 0.1404          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.5980                 | 0.8133              | 0.6893          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7284            | 0.8702         | 0.7930     | 0.9540           |
| 0.1151        | 39.0  | 4134  | 0.1357          | 0.7625             | 0.8472          | 0.8026      | 72              | 0.6522                 | 0.8                 | 0.7186          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7487            | 0.8702         | 0.8049     | 0.9570           |
| 0.1168        | 40.0  | 4240  | 0.1354          | 0.75               | 0.8333          | 0.7895      | 72              | 0.6667                 | 0.8                 | 0.7273          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.75              | 0.8673         | 0.8044     | 0.9570           |
| 0.1155        | 41.0  | 4346  | 0.1387          | 0.75               | 0.8333          | 0.7895      | 72              | 0.6289                 | 0.8133              | 0.7093          | 75                  | 0.8261           | 0.9301        | 0.8750    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7325            | 0.8643         | 0.7930     | 0.9545           |
| 0.1154        | 42.0  | 4452  | 0.1389          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6316                 | 0.8                 | 0.7059          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7282            | 0.8614         | 0.7892     | 0.9542           |
| 0.1122        | 43.0  | 4558  | 0.1368          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6596                 | 0.8267              | 0.7337          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7456            | 0.8732         | 0.8043     | 0.9567           |
| 0.1136        | 44.0  | 4664  | 0.1360          | 0.7625             | 0.8472          | 0.8026      | 72              | 0.6522                 | 0.8                 | 0.7186          | 75                  | 0.8438           | 0.9441        | 0.8911    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7462            | 0.8673         | 0.8022     | 0.9557           |
| 0.1114        | 45.0  | 4770  | 0.1414          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6289                 | 0.8133              | 0.7093          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7363            | 0.8732         | 0.7989     | 0.9542           |
| 0.1108        | 46.0  | 4876  | 0.1366          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6630                 | 0.8133              | 0.7305          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7412            | 0.8702         | 0.8005     | 0.9557           |
| 0.1106        | 47.0  | 4982  | 0.1407          | 0.7625             | 0.8472          | 0.8026      | 72              | 0.6040                 | 0.8133              | 0.6932          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7259            | 0.8673         | 0.7903     | 0.9532           |
| 0.1101        | 48.0  | 5088  | 0.1329          | 0.75               | 0.8333          | 0.7895      | 72              | 0.6344                 | 0.7867              | 0.7024          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5161             | 0.6957          | 0.5926      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7386            | 0.8584         | 0.7940     | 0.9565           |
| 0.1085        | 49.0  | 5194  | 0.1372          | 0.7470             | 0.8611          | 0.8         | 72              | 0.6327                 | 0.8267              | 0.7168          | 75                  | 0.8365           | 0.9301        | 0.8808    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7363            | 0.8732         | 0.7989     | 0.9555           |
| 0.1072        | 50.0  | 5300  | 0.1309          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6629                 | 0.7867              | 0.7195          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7417            | 0.8555         | 0.7945     | 0.9567           |
| 0.1058        | 51.0  | 5406  | 0.1300          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6484                 | 0.7867              | 0.7108          | 75                  | 0.8481           | 0.9371        | 0.8904    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7423            | 0.8584         | 0.7962     | 0.9567           |
| 0.1059        | 52.0  | 5512  | 0.1321          | 0.75               | 0.8333          | 0.7895      | 72              | 0.6593                 | 0.8                 | 0.7229          | 75                  | 0.8354           | 0.9231        | 0.8771    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7417            | 0.8555         | 0.7945     | 0.9560           |
| 0.1041        | 53.0  | 5618  | 0.1347          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6489                 | 0.8133              | 0.7219          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7406            | 0.8673         | 0.7989     | 0.9560           |
| 0.105         | 54.0  | 5724  | 0.1324          | 0.75               | 0.8333          | 0.7895      | 72              | 0.6383                 | 0.8                 | 0.7101          | 75                  | 0.8471           | 0.9301        | 0.8867    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7379            | 0.8555         | 0.7923     | 0.9552           |
| 0.1079        | 55.0  | 5830  | 0.1412          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6364                 | 0.84                | 0.7241          | 75                  | 0.8261           | 0.9301        | 0.8750    | 143           | 0.5                | 0.7391          | 0.5965      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7259            | 0.8673         | 0.7903     | 0.9547           |
| 0.106         | 56.0  | 5936  | 0.1348          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6316                 | 0.8                 | 0.7059          | 75                  | 0.8408           | 0.9231        | 0.8800    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7348            | 0.8584         | 0.7918     | 0.9557           |
| 0.1052        | 57.0  | 6042  | 0.1323          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6667                 | 0.8                 | 0.7273          | 75                  | 0.8408           | 0.9231        | 0.8800    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7468            | 0.8614         | 0.8000     | 0.9562           |
| 0.1027        | 58.0  | 6148  | 0.1358          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6526                 | 0.8267              | 0.7294          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7456            | 0.8732         | 0.8043     | 0.9560           |
| 0.1015        | 59.0  | 6254  | 0.1332          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6489                 | 0.8133              | 0.7219          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7424            | 0.8673         | 0.8000     | 0.9562           |
| 0.104         | 60.0  | 6360  | 0.1366          | 0.7317             | 0.8333          | 0.7792      | 72              | 0.6702                 | 0.84                | 0.7456          | 75                  | 0.8365           | 0.9301        | 0.8808    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7412            | 0.8702         | 0.8005     | 0.9557           |
| 0.1032        | 61.0  | 6466  | 0.1355          | 0.7375             | 0.8194          | 0.7763      | 72              | 0.6882                 | 0.8533              | 0.7619          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7487            | 0.8702         | 0.8049     | 0.9565           |
| 0.0997        | 62.0  | 6572  | 0.1353          | 0.7595             | 0.8333          | 0.7947      | 72              | 0.6848                 | 0.84                | 0.7545          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7526            | 0.8702         | 0.8071     | 0.9572           |
| 0.1013        | 63.0  | 6678  | 0.1328          | 0.7595             | 0.8333          | 0.7947      | 72              | 0.6452                 | 0.8                 | 0.7143          | 75                  | 0.8365           | 0.9301        | 0.8808    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7468            | 0.8614         | 0.8000     | 0.9572           |
| 0.099         | 64.0  | 6784  | 0.1428          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6566                 | 0.8667              | 0.7471          | 75                  | 0.8221           | 0.9371        | 0.8758    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7279            | 0.8761         | 0.7952     | 0.9542           |
| 0.0979        | 65.0  | 6890  | 0.1324          | 0.7595             | 0.8333          | 0.7947      | 72              | 0.6889                 | 0.8267              | 0.7515          | 75                  | 0.8481           | 0.9371        | 0.8904    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7603            | 0.8702         | 0.8116     | 0.9577           |
| 0.0956        | 66.0  | 6996  | 0.1387          | 0.7317             | 0.8333          | 0.7792      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8221           | 0.9371        | 0.8758    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7425            | 0.8761         | 0.8038     | 0.9560           |
| 0.1005        | 67.0  | 7102  | 0.1353          | 0.7375             | 0.8194          | 0.7763      | 72              | 0.6848                 | 0.84                | 0.7545          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7468            | 0.8702         | 0.8038     | 0.9567           |
| 0.0985        | 68.0  | 7208  | 0.1388          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6526                 | 0.8267              | 0.7294          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7357            | 0.8702         | 0.7973     | 0.9562           |
| 0.0986        | 69.0  | 7314  | 0.1344          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6923                 | 0.84                | 0.7590          | 75                  | 0.8481           | 0.9371        | 0.8904    | 143           | 0.5333             | 0.6957          | 0.6038      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7584            | 0.8702         | 0.8104     | 0.9572           |
| 0.1004        | 70.0  | 7420  | 0.1338          | 0.7468             | 0.8194          | 0.7815      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5161             | 0.6957          | 0.5926      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7564            | 0.8702         | 0.8093     | 0.9577           |
| 0.0977        | 71.0  | 7526  | 0.1355          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7519            | 0.8761         | 0.8093     | 0.9567           |
| 0.0979        | 72.0  | 7632  | 0.1375          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7444            | 0.8761         | 0.8049     | 0.9560           |
| 0.0975        | 73.0  | 7738  | 0.1335          | 0.7375             | 0.8194          | 0.7763      | 72              | 0.6882                 | 0.8533              | 0.7619          | 75                  | 0.8481           | 0.9371        | 0.8904    | 143           | 0.5333             | 0.6957          | 0.6038      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7564            | 0.8702         | 0.8093     | 0.9575           |
| 0.0949        | 74.0  | 7844  | 0.1419          | 0.7143             | 0.8333          | 0.7692      | 72              | 0.6737                 | 0.8533              | 0.7529          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7370            | 0.8761         | 0.8005     | 0.9560           |
| 0.0963        | 75.0  | 7950  | 0.1384          | 0.7195             | 0.8194          | 0.7662      | 72              | 0.6737                 | 0.8533              | 0.7529          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7437            | 0.8732         | 0.8033     | 0.9565           |
| 0.0971        | 76.0  | 8056  | 0.1379          | 0.7317             | 0.8333          | 0.7792      | 72              | 0.6667                 | 0.8533              | 0.7485          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7444            | 0.8761         | 0.8049     | 0.9567           |
| 0.0947        | 77.0  | 8162  | 0.1363          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7538            | 0.8761         | 0.8104     | 0.9575           |
| 0.094         | 78.0  | 8268  | 0.1353          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5161             | 0.6957          | 0.5926      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7513            | 0.8732         | 0.8076     | 0.9575           |
| 0.0952        | 79.0  | 8374  | 0.1336          | 0.7195             | 0.8194          | 0.7662      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.8535           | 0.9371        | 0.8933    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7570            | 0.8732         | 0.8110     | 0.9575           |
| 0.093         | 80.0  | 8480  | 0.1440          | 0.7143             | 0.8333          | 0.7692      | 72              | 0.6735                 | 0.88                | 0.7630          | 75                  | 0.8272           | 0.9371        | 0.8787    | 143           | 0.5                | 0.7391          | 0.5965      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7328            | 0.8820         | 0.8005     | 0.9557           |
| 0.0945        | 81.0  | 8586  | 0.1354          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7538            | 0.8761         | 0.8104     | 0.9575           |
| 0.0932        | 82.0  | 8692  | 0.1381          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6809                 | 0.8533              | 0.7574          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7462            | 0.8761         | 0.8060     | 0.9567           |
| 0.0934        | 83.0  | 8798  | 0.1354          | 0.7317             | 0.8333          | 0.7792      | 72              | 0.6923                 | 0.84                | 0.7590          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5161             | 0.6957          | 0.5926      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7506            | 0.8702         | 0.8060     | 0.9572           |
| 0.0932        | 84.0  | 8904  | 0.1367          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7079                 | 0.84                | 0.7683          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7462            | 0.8673         | 0.8022     | 0.9570           |
| 0.0945        | 85.0  | 9010  | 0.1354          | 0.7195             | 0.8194          | 0.7662      | 72              | 0.7159                 | 0.84                | 0.7730          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7519            | 0.8673         | 0.8055     | 0.9572           |
| 0.0957        | 86.0  | 9116  | 0.1360          | 0.7195             | 0.8194          | 0.7662      | 72              | 0.7159                 | 0.84                | 0.7730          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7545            | 0.8702         | 0.8082     | 0.9575           |
| 0.0914        | 87.0  | 9222  | 0.1359          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6774                 | 0.84                | 0.75            | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7449            | 0.8702         | 0.8027     | 0.9572           |
| 0.0922        | 88.0  | 9328  | 0.1377          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6809                 | 0.8533              | 0.7574          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7419            | 0.8732         | 0.8022     | 0.9565           |
| 0.0929        | 89.0  | 9434  | 0.1370          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7449            | 0.8702         | 0.8027     | 0.9570           |
| 0.0921        | 90.0  | 9540  | 0.1369          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7475            | 0.8732         | 0.8054     | 0.9570           |
| 0.0932        | 91.0  | 9646  | 0.1368          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7111                 | 0.8533              | 0.7758          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7494            | 0.8732         | 0.8065     | 0.9570           |
| 0.0949        | 92.0  | 9752  | 0.1357          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7111                 | 0.8533              | 0.7758          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5161             | 0.6957          | 0.5926      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7532            | 0.8732         | 0.8087     | 0.9577           |
| 0.0914        | 93.0  | 9858  | 0.1363          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.4848             | 0.6957          | 0.5714      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7412            | 0.8702         | 0.8005     | 0.9562           |
| 0.0897        | 94.0  | 9964  | 0.1370          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.8261           | 0.9301        | 0.8750    | 143           | 0.4706             | 0.6957          | 0.5614      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7393            | 0.8702         | 0.7995     | 0.9562           |
| 0.0915        | 95.0  | 10070 | 0.1380          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6915                 | 0.8667              | 0.7692          | 75                  | 0.8261           | 0.9301        | 0.8750    | 143           | 0.4706             | 0.6957          | 0.5614      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7363            | 0.8732         | 0.7989     | 0.9565           |
| 0.0925        | 96.0  | 10176 | 0.1372          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8261           | 0.9301        | 0.8750    | 143           | 0.4848             | 0.6957          | 0.5714      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7393            | 0.8702         | 0.7995     | 0.9562           |
| 0.0921        | 97.0  | 10282 | 0.1372          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7437            | 0.8732         | 0.8033     | 0.9567           |
| 0.091         | 98.0  | 10388 | 0.1372          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7437            | 0.8732         | 0.8033     | 0.9567           |
| 0.0927        | 99.0  | 10494 | 0.1372          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7456            | 0.8732         | 0.8043     | 0.9565           |
| 0.0918        | 100.0 | 10600 | 0.1373          | 0.7229             | 0.8333          | 0.7742      | 72              | 0.7111                 | 0.8533              | 0.7758          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5                | 0.6957          | 0.5818      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7475            | 0.8732         | 0.8054     | 0.9567           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2