---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-pt-pl20-2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-pt-pl20-2

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1897
- Location Precision: 0.8052
- Location Recall: 0.8611
- Location F1: 0.8322
- Location Number: 72
- Organization Precision: 0.7294
- Organization Recall: 0.8267
- Organization F1: 0.7750
- Organization Number: 75
- Person Precision: 0.8671
- Person Recall: 0.9580
- Person F1: 0.9103
- Person Number: 143
- Quantity Precision: 0.6
- Quantity Recall: 0.7826
- Quantity F1: 0.6792
- Quantity Number: 23
- Time Precision: 0.8519
- Time Recall: 0.8846
- Time F1: 0.8679
- Time Number: 26
- Overall Precision: 0.8011
- Overall Recall: 0.8909
- Overall F1: 0.8436
- Overall Accuracy: 0.9605

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9915        | 1.0   | 106   | 0.5524          | 0.0                | 0.0             | 0.0         | 72              | 0.0                    | 0.0                 | 0.0             | 75                  | 0.125            | 0.0140        | 0.0252    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.0            | 0.0         | 0.0     | 26          | 0.0690            | 0.0059         | 0.0109     | 0.8479           |
| 0.5062        | 2.0   | 212   | 0.3516          | 0.2857             | 0.0278          | 0.0506      | 72              | 0.0370                 | 0.0133              | 0.0196          | 75                  | 0.4444           | 0.6434        | 0.5257    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.5652         | 0.5         | 0.5306  | 26          | 0.3927            | 0.3186         | 0.3518     | 0.8919           |
| 0.325         | 3.0   | 318   | 0.2219          | 0.5542             | 0.6389          | 0.5935      | 72              | 0.4848                 | 0.64                | 0.5517          | 75                  | 0.7633           | 0.9021        | 0.8269    | 143           | 0.3182             | 0.6087          | 0.4179      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.6061            | 0.7581         | 0.6737     | 0.9272           |
| 0.2281        | 4.0   | 424   | 0.2034          | 0.6627             | 0.7639          | 0.7097      | 72              | 0.5248                 | 0.7067              | 0.6023          | 75                  | 0.7870           | 0.9301        | 0.8526    | 143           | 0.24               | 0.5217          | 0.3288      | 23              | 0.6            | 0.8077      | 0.6885  | 26          | 0.6256            | 0.8083         | 0.7053     | 0.9342           |
| 0.1893        | 5.0   | 530   | 0.1611          | 0.7195             | 0.8194          | 0.7662      | 72              | 0.5446                 | 0.7333              | 0.625           | 75                  | 0.8160           | 0.9301        | 0.8693    | 143           | 0.3846             | 0.6522          | 0.4839      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.6852            | 0.8348         | 0.7527     | 0.9442           |
| 0.1709        | 6.0   | 636   | 0.1525          | 0.6383             | 0.8333          | 0.7229      | 72              | 0.5688                 | 0.8267              | 0.6739          | 75                  | 0.8438           | 0.9441        | 0.8911    | 143           | 0.4571             | 0.6957          | 0.5517      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.6893            | 0.8702         | 0.7692     | 0.9482           |
| 0.1574        | 7.0   | 742   | 0.1540          | 0.7024             | 0.8194          | 0.7564      | 72              | 0.6224                 | 0.8133              | 0.7052          | 75                  | 0.8333           | 0.9441        | 0.8852    | 143           | 0.4634             | 0.8261          | 0.5938      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7143            | 0.8702         | 0.7846     | 0.9490           |
| 0.1455        | 8.0   | 848   | 0.1488          | 0.6829             | 0.7778          | 0.7273      | 72              | 0.6117                 | 0.84                | 0.7079          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.5882         | 0.7692      | 0.6667  | 26          | 0.7094            | 0.8643         | 0.7793     | 0.9480           |
| 0.1415        | 9.0   | 954   | 0.1528          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6038                 | 0.8533              | 0.7072          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.6129             | 0.8261          | 0.7037      | 23              | 0.6452         | 0.7692      | 0.7018  | 26          | 0.7279            | 0.8761         | 0.7952     | 0.9472           |
| 0.1317        | 10.0  | 1060  | 0.1349          | 0.75               | 0.7917          | 0.7703      | 72              | 0.5882                 | 0.8                 | 0.6780          | 75                  | 0.8553           | 0.9510        | 0.9007    | 143           | 0.5294             | 0.7826          | 0.6316      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7282            | 0.8614         | 0.7892     | 0.9527           |
| 0.1258        | 11.0  | 1166  | 0.1318          | 0.7407             | 0.8333          | 0.7843      | 72              | 0.6932                 | 0.8133              | 0.7485          | 75                  | 0.8471           | 0.9301        | 0.8867    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7584            | 0.8702         | 0.8104     | 0.9572           |
| 0.1198        | 12.0  | 1272  | 0.1363          | 0.7403             | 0.7917          | 0.7651      | 72              | 0.7059                 | 0.8                 | 0.7500          | 75                  | 0.8535           | 0.9371        | 0.8933    | 143           | 0.6667             | 0.8696          | 0.7547      | 23              | 0.8148         | 0.8462      | 0.8302  | 26          | 0.7793            | 0.8643         | 0.8196     | 0.9580           |
| 0.1144        | 13.0  | 1378  | 0.1362          | 0.7125             | 0.7917          | 0.75        | 72              | 0.6321                 | 0.8933              | 0.7403          | 75                  | 0.8608           | 0.9510        | 0.9037    | 143           | 0.7037             | 0.8261          | 0.76        | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.7544            | 0.8879         | 0.8157     | 0.9570           |
| 0.1142        | 14.0  | 1484  | 0.1354          | 0.7632             | 0.8056          | 0.7838      | 72              | 0.7143                 | 0.8667              | 0.7831          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.5278             | 0.8261          | 0.6441      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7718            | 0.8879         | 0.8258     | 0.9587           |
| 0.1079        | 15.0  | 1590  | 0.1299          | 0.7568             | 0.7778          | 0.7671      | 72              | 0.7273                 | 0.8533              | 0.7853          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.7878            | 0.8761         | 0.8296     | 0.9595           |
| 0.1044        | 16.0  | 1696  | 0.1469          | 0.7595             | 0.8333          | 0.7947      | 72              | 0.6667                 | 0.9067              | 0.7684          | 75                  | 0.8544           | 0.9441        | 0.8970    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.7690            | 0.8938         | 0.8267     | 0.9547           |
| 0.099         | 17.0  | 1802  | 0.1367          | 0.7632             | 0.8056          | 0.7838      | 72              | 0.7159                 | 0.84                | 0.7730          | 75                  | 0.8526           | 0.9301        | 0.8896    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.7778            | 0.8673         | 0.8201     | 0.9570           |
| 0.095         | 18.0  | 1908  | 0.1454          | 0.7867             | 0.8194          | 0.8027      | 72              | 0.7174                 | 0.88                | 0.7904          | 75                  | 0.8516           | 0.9231        | 0.8859    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.7795            | 0.8761         | 0.825      | 0.9575           |
| 0.0926        | 19.0  | 2014  | 0.1384          | 0.7895             | 0.8333          | 0.8108      | 72              | 0.6989                 | 0.8667              | 0.7738          | 75                  | 0.8636           | 0.9301        | 0.8956    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.7822            | 0.8791         | 0.8278     | 0.9582           |
| 0.088         | 20.0  | 2120  | 0.1605          | 0.7821             | 0.8472          | 0.8133      | 72              | 0.6804                 | 0.88                | 0.7674          | 75                  | 0.8710           | 0.9441        | 0.9060    | 143           | 0.5588             | 0.8261          | 0.6667      | 23              | 0.8077         | 0.8077      | 0.8077  | 26          | 0.7744            | 0.8909         | 0.8285     | 0.9542           |
| 0.0878        | 21.0  | 2226  | 0.1483          | 0.7763             | 0.8194          | 0.7973      | 72              | 0.6476                 | 0.9067              | 0.7556          | 75                  | 0.8710           | 0.9441        | 0.9060    | 143           | 0.6129             | 0.8261          | 0.7037      | 23              | 0.88           | 0.8462      | 0.8627  | 26          | 0.7730            | 0.8938         | 0.8290     | 0.9562           |
| 0.089         | 22.0  | 2332  | 0.1543          | 0.7867             | 0.8194          | 0.8027      | 72              | 0.6422                 | 0.9333              | 0.7609          | 75                  | 0.8616           | 0.9580        | 0.9073    | 143           | 0.5278             | 0.8261          | 0.6441      | 23              | 0.7778         | 0.8077      | 0.7925  | 26          | 0.7537            | 0.9027         | 0.8215     | 0.9535           |
| 0.0835        | 23.0  | 2438  | 0.1461          | 0.8                | 0.8333          | 0.8163      | 72              | 0.6737                 | 0.8533              | 0.7529          | 75                  | 0.8758           | 0.9371        | 0.9054    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.8077         | 0.8077      | 0.8077  | 26          | 0.7775            | 0.8761         | 0.8239     | 0.9557           |
| 0.0789        | 24.0  | 2544  | 0.1454          | 0.8289             | 0.875           | 0.8514      | 72              | 0.7045                 | 0.8267              | 0.7607          | 75                  | 0.8774           | 0.9510        | 0.9128    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.84           | 0.8077      | 0.8235  | 26          | 0.7958            | 0.8850         | 0.8380     | 0.9567           |
| 0.0773        | 25.0  | 2650  | 0.1376          | 0.84               | 0.875           | 0.8571      | 72              | 0.7111                 | 0.8533              | 0.7758          | 75                  | 0.8701           | 0.9371        | 0.9024    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7921            | 0.8879         | 0.8373     | 0.9590           |
| 0.0779        | 26.0  | 2756  | 0.1367          | 0.8243             | 0.8472          | 0.8356      | 72              | 0.6702                 | 0.84                | 0.7456          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7827            | 0.8820         | 0.8294     | 0.9600           |
| 0.0735        | 27.0  | 2862  | 0.1394          | 0.8378             | 0.8611          | 0.8493      | 72              | 0.7229                 | 0.8                 | 0.7595          | 75                  | 0.8831           | 0.9510        | 0.9158    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8147            | 0.8820         | 0.8470     | 0.9630           |
| 0.0718        | 28.0  | 2968  | 0.1376          | 0.8108             | 0.8333          | 0.8219      | 72              | 0.7079                 | 0.84                | 0.7683          | 75                  | 0.8874           | 0.9371        | 0.9116    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7941            | 0.8761         | 0.8331     | 0.9605           |
| 0.071         | 29.0  | 3074  | 0.1549          | 0.7895             | 0.8333          | 0.8108      | 72              | 0.6701                 | 0.8667              | 0.7558          | 75                  | 0.8774           | 0.9510        | 0.9128    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7698            | 0.8879         | 0.8247     | 0.9572           |
| 0.0717        | 30.0  | 3180  | 0.1433          | 0.7838             | 0.8056          | 0.7945      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8896           | 0.9580        | 0.9226    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7778         | 0.8077      | 0.7925  | 26          | 0.7905            | 0.8791         | 0.8324     | 0.9605           |
| 0.071         | 31.0  | 3286  | 0.1437          | 0.8267             | 0.8611          | 0.8435      | 72              | 0.7253                 | 0.88                | 0.7952          | 75                  | 0.8831           | 0.9510        | 0.9158    | 143           | 0.6667             | 0.7826          | 0.72        | 23              | 0.8077         | 0.8077      | 0.8077  | 26          | 0.8123            | 0.8938         | 0.8511     | 0.9620           |
| 0.0652        | 32.0  | 3392  | 0.1425          | 0.8108             | 0.8333          | 0.8219      | 72              | 0.7273                 | 0.8533              | 0.7853          | 75                  | 0.8693           | 0.9301        | 0.8986    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7778         | 0.8077      | 0.7925  | 26          | 0.8               | 0.8732         | 0.8350     | 0.9605           |
| 0.0664        | 33.0  | 3498  | 0.1493          | 0.8158             | 0.8611          | 0.8378      | 72              | 0.7143                 | 0.8667              | 0.7831          | 75                  | 0.8758           | 0.9371        | 0.9054    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8048            | 0.8879         | 0.8443     | 0.9612           |
| 0.0623        | 34.0  | 3604  | 0.1654          | 0.775              | 0.8611          | 0.8158      | 72              | 0.6907                 | 0.8933              | 0.7791          | 75                  | 0.8718           | 0.9510        | 0.9097    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7716            | 0.8968         | 0.8295     | 0.9572           |
| 0.0615        | 35.0  | 3710  | 0.1494          | 0.7895             | 0.8333          | 0.8108      | 72              | 0.7111                 | 0.8533              | 0.7758          | 75                  | 0.8693           | 0.9301        | 0.8986    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7872            | 0.8732         | 0.8280     | 0.9595           |
| 0.0589        | 36.0  | 3816  | 0.1494          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.6989                 | 0.8667              | 0.7738          | 75                  | 0.8766           | 0.9441        | 0.9091    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.7989            | 0.8909         | 0.8424     | 0.9612           |
| 0.0576        | 37.0  | 3922  | 0.1579          | 0.7468             | 0.8194          | 0.7815      | 72              | 0.6947                 | 0.88                | 0.7765          | 75                  | 0.8718           | 0.9510        | 0.9097    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.7839            | 0.8879         | 0.8326     | 0.9592           |
| 0.0586        | 38.0  | 4028  | 0.1528          | 0.7973             | 0.8194          | 0.8082      | 72              | 0.7442                 | 0.8533              | 0.7950          | 75                  | 0.8608           | 0.9510        | 0.9037    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7778         | 0.8077      | 0.7925  | 26          | 0.7947            | 0.8791         | 0.8347     | 0.9590           |
| 0.0577        | 39.0  | 4134  | 0.1617          | 0.8158             | 0.8611          | 0.8378      | 72              | 0.6989                 | 0.8667              | 0.7738          | 75                  | 0.8903           | 0.9650        | 0.9262    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8069            | 0.8997         | 0.8508     | 0.9600           |
| 0.0536        | 40.0  | 4240  | 0.1580          | 0.8                | 0.8889          | 0.8421      | 72              | 0.7045                 | 0.8267              | 0.7607          | 75                  | 0.8766           | 0.9441        | 0.9091    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7895            | 0.8850         | 0.8345     | 0.9602           |
| 0.0572        | 41.0  | 4346  | 0.1550          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8734           | 0.9650        | 0.9169    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8846         | 0.8846      | 0.8846  | 26          | 0.8005            | 0.8997         | 0.8472     | 0.9597           |
| 0.0524        | 42.0  | 4452  | 0.1589          | 0.7722             | 0.8472          | 0.8079      | 72              | 0.7143                 | 0.8667              | 0.7831          | 75                  | 0.8599           | 0.9441        | 0.9       | 143           | 0.6129             | 0.8261          | 0.7037      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7804            | 0.8909         | 0.8320     | 0.9590           |
| 0.052         | 43.0  | 4558  | 0.1501          | 0.7895             | 0.8333          | 0.8108      | 72              | 0.7381                 | 0.8267              | 0.7799          | 75                  | 0.8766           | 0.9441        | 0.9091    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8071            | 0.8761         | 0.8402     | 0.9610           |
| 0.0509        | 44.0  | 4664  | 0.1587          | 0.7792             | 0.8333          | 0.8054      | 72              | 0.7412                 | 0.84                | 0.7875          | 75                  | 0.8782           | 0.9580        | 0.9164    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7778         | 0.8077      | 0.7925  | 26          | 0.7995            | 0.8820         | 0.8387     | 0.9597           |
| 0.049         | 45.0  | 4770  | 0.1580          | 0.7722             | 0.8472          | 0.8079      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8608           | 0.9510        | 0.9037    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7889            | 0.8820         | 0.8329     | 0.9607           |
| 0.0479        | 46.0  | 4876  | 0.1540          | 0.8289             | 0.875           | 0.8514      | 72              | 0.7381                 | 0.8267              | 0.7799          | 75                  | 0.8718           | 0.9510        | 0.9097    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.8097            | 0.8909         | 0.8483     | 0.9627           |
| 0.0488        | 47.0  | 4982  | 0.1686          | 0.8158             | 0.8611          | 0.8378      | 72              | 0.6932                 | 0.8133              | 0.7485          | 75                  | 0.8272           | 0.9371        | 0.8787    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8148         | 0.8462      | 0.8302  | 26          | 0.7795            | 0.8761         | 0.825      | 0.9565           |
| 0.0468        | 48.0  | 5088  | 0.1526          | 0.84               | 0.875           | 0.8571      | 72              | 0.7059                 | 0.8                 | 0.7500          | 75                  | 0.8645           | 0.9371        | 0.8993    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8054            | 0.8791         | 0.8406     | 0.9632           |
| 0.0474        | 49.0  | 5194  | 0.1667          | 0.7922             | 0.8472          | 0.8188      | 72              | 0.7045                 | 0.8267              | 0.7607          | 75                  | 0.8734           | 0.9650        | 0.9169    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.7963            | 0.8879         | 0.8396     | 0.9605           |
| 0.0485        | 50.0  | 5300  | 0.1526          | 0.8243             | 0.8472          | 0.8356      | 72              | 0.7531                 | 0.8133              | 0.7821          | 75                  | 0.8774           | 0.9510        | 0.9128    | 143           | 0.7037             | 0.8261          | 0.76        | 23              | 0.88           | 0.8462      | 0.8627  | 26          | 0.8260            | 0.8820         | 0.8531     | 0.9635           |
| 0.0443        | 51.0  | 5406  | 0.1694          | 0.8267             | 0.8611          | 0.8435      | 72              | 0.7065                 | 0.8667              | 0.7784          | 75                  | 0.8854           | 0.9720        | 0.9267    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8079            | 0.9056         | 0.8540     | 0.9612           |
| 0.0468        | 52.0  | 5512  | 0.1636          | 0.8133             | 0.8472          | 0.8299      | 72              | 0.7209                 | 0.8267              | 0.7702          | 75                  | 0.8599           | 0.9441        | 0.9       | 143           | 0.5862             | 0.7391          | 0.6538      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7872            | 0.8732         | 0.8280     | 0.9585           |
| 0.0439        | 53.0  | 5618  | 0.1686          | 0.8082             | 0.8194          | 0.8138      | 72              | 0.7273                 | 0.8533              | 0.7853          | 75                  | 0.8846           | 0.9650        | 0.9231    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8032            | 0.8909         | 0.8448     | 0.9597           |
| 0.0449        | 54.0  | 5724  | 0.1678          | 0.8077             | 0.875           | 0.8400      | 72              | 0.7326                 | 0.84                | 0.7826          | 75                  | 0.8734           | 0.9650        | 0.9169    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.8148         | 0.8462      | 0.8302  | 26          | 0.8               | 0.8968         | 0.8456     | 0.9602           |
| 0.0428        | 55.0  | 5830  | 0.1703          | 0.7922             | 0.8472          | 0.8188      | 72              | 0.7143                 | 0.8667              | 0.7831          | 75                  | 0.8790           | 0.9650        | 0.92      | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7188         | 0.8846      | 0.7931  | 26          | 0.7922            | 0.8997         | 0.8425     | 0.9602           |
| 0.043         | 56.0  | 5936  | 0.1671          | 0.7848             | 0.8611          | 0.8212      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.8968           | 0.9720        | 0.9329    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.8148         | 0.8462      | 0.8302  | 26          | 0.8005            | 0.8997         | 0.8472     | 0.9607           |
| 0.0405        | 57.0  | 6042  | 0.1589          | 0.8108             | 0.8333          | 0.8219      | 72              | 0.7470                 | 0.8267              | 0.7848          | 75                  | 0.8896           | 0.9580        | 0.9226    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8197            | 0.8850         | 0.8511     | 0.9625           |
| 0.0402        | 58.0  | 6148  | 0.1672          | 0.8026             | 0.8472          | 0.8243      | 72              | 0.7126                 | 0.8267              | 0.7654          | 75                  | 0.8726           | 0.9580        | 0.9133    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.7937            | 0.8850         | 0.8368     | 0.9610           |
| 0.0408        | 59.0  | 6254  | 0.1690          | 0.8026             | 0.8472          | 0.8243      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8726           | 0.9580        | 0.9133    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.8021            | 0.8850         | 0.8415     | 0.9627           |
| 0.0384        | 60.0  | 6360  | 0.1786          | 0.7821             | 0.8472          | 0.8133      | 72              | 0.6882                 | 0.8533              | 0.7619          | 75                  | 0.8790           | 0.9650        | 0.92      | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.6875         | 0.8462      | 0.7586  | 26          | 0.7815            | 0.8968         | 0.8352     | 0.9600           |
| 0.0381        | 61.0  | 6466  | 0.1716          | 0.8406             | 0.8056          | 0.8227      | 72              | 0.7532                 | 0.7733              | 0.7632          | 75                  | 0.8701           | 0.9371        | 0.9024    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8174            | 0.8584         | 0.8374     | 0.9617           |
| 0.0393        | 62.0  | 6572  | 0.1672          | 0.8133             | 0.8472          | 0.8299      | 72              | 0.7468                 | 0.7867              | 0.7662          | 75                  | 0.8782           | 0.9580        | 0.9164    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8159            | 0.8761         | 0.8450     | 0.9632           |
| 0.037         | 63.0  | 6678  | 0.1637          | 0.8243             | 0.8472          | 0.8356      | 72              | 0.7160                 | 0.7733              | 0.7436          | 75                  | 0.8782           | 0.9580        | 0.9164    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8093            | 0.8761         | 0.8414     | 0.9627           |
| 0.0357        | 64.0  | 6784  | 0.1763          | 0.8182             | 0.875           | 0.8456      | 72              | 0.7011                 | 0.8133              | 0.7531          | 75                  | 0.8679           | 0.9650        | 0.9139    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.7947            | 0.8909         | 0.8401     | 0.9617           |
| 0.0374        | 65.0  | 6890  | 0.1724          | 0.8158             | 0.8611          | 0.8378      | 72              | 0.7470                 | 0.8267              | 0.7848          | 75                  | 0.8903           | 0.9650        | 0.9262    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8214         | 0.8846      | 0.8519  | 26          | 0.8145            | 0.8938         | 0.8523     | 0.9622           |
| 0.0368        | 66.0  | 6996  | 0.1770          | 0.8289             | 0.875           | 0.8514      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8726           | 0.9580        | 0.9133    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.8085            | 0.8968         | 0.8503     | 0.9617           |
| 0.0374        | 67.0  | 7102  | 0.1792          | 0.8108             | 0.8333          | 0.8219      | 72              | 0.7045                 | 0.8267              | 0.7607          | 75                  | 0.8726           | 0.9580        | 0.9133    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8016            | 0.8820         | 0.8399     | 0.9620           |
| 0.034         | 68.0  | 7208  | 0.1887          | 0.8026             | 0.8472          | 0.8243      | 72              | 0.7024                 | 0.7867              | 0.7421          | 75                  | 0.8679           | 0.9650        | 0.9139    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.7905            | 0.8791         | 0.8324     | 0.9595           |
| 0.0339        | 69.0  | 7314  | 0.1792          | 0.8108             | 0.8333          | 0.8219      | 72              | 0.7262                 | 0.8133              | 0.7673          | 75                  | 0.8726           | 0.9580        | 0.9133    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8076            | 0.8791         | 0.8418     | 0.9615           |
| 0.0346        | 70.0  | 7420  | 0.1741          | 0.8                | 0.8333          | 0.8163      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8782           | 0.9580        | 0.9164    | 143           | 0.5862             | 0.7391          | 0.6538      | 23              | 0.7778         | 0.8077      | 0.7925  | 26          | 0.8               | 0.8732         | 0.8350     | 0.9612           |
| 0.0345        | 71.0  | 7526  | 0.1789          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8782           | 0.9580        | 0.9164    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.8037            | 0.8938         | 0.8464     | 0.9627           |
| 0.0339        | 72.0  | 7632  | 0.1791          | 0.8026             | 0.8472          | 0.8243      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8718           | 0.9510        | 0.9097    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.8214         | 0.8846      | 0.8519  | 26          | 0.7995            | 0.8820         | 0.8387     | 0.9610           |
| 0.0363        | 73.0  | 7738  | 0.1758          | 0.8182             | 0.875           | 0.8456      | 72              | 0.7241                 | 0.84                | 0.7778          | 75                  | 0.8782           | 0.9580        | 0.9164    | 143           | 0.6071             | 0.7391          | 0.6667      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.8075            | 0.8909         | 0.8471     | 0.9620           |
| 0.0309        | 74.0  | 7844  | 0.1865          | 0.8205             | 0.8889          | 0.8533      | 72              | 0.7093                 | 0.8133              | 0.7578          | 75                  | 0.8679           | 0.9650        | 0.9139    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.8005            | 0.8997         | 0.8472     | 0.9600           |
| 0.0337        | 75.0  | 7950  | 0.1806          | 0.8182             | 0.875           | 0.8456      | 72              | 0.7176                 | 0.8133              | 0.7625          | 75                  | 0.8734           | 0.9650        | 0.9169    | 143           | 0.6786             | 0.8261          | 0.7451      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.8016            | 0.8938         | 0.8452     | 0.9610           |
| 0.0329        | 76.0  | 8056  | 0.1810          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.6848                 | 0.84                | 0.7545          | 75                  | 0.8718           | 0.9510        | 0.9097    | 143           | 0.6786             | 0.8261          | 0.7451      | 23              | 0.8571         | 0.9231      | 0.8889  | 26          | 0.7979            | 0.8968         | 0.8444     | 0.9612           |
| 0.0325        | 77.0  | 8162  | 0.1784          | 0.8026             | 0.8472          | 0.8243      | 72              | 0.6897                 | 0.8                 | 0.7407          | 75                  | 0.8734           | 0.9650        | 0.9169    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.7979            | 0.8850         | 0.8392     | 0.9607           |
| 0.0313        | 78.0  | 8268  | 0.1773          | 0.8289             | 0.875           | 0.8514      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8113            | 0.8879         | 0.8479     | 0.9620           |
| 0.0313        | 79.0  | 8374  | 0.1782          | 0.8026             | 0.8472          | 0.8243      | 72              | 0.7381                 | 0.8267              | 0.7799          | 75                  | 0.8734           | 0.9650        | 0.9169    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.8032            | 0.8909         | 0.8448     | 0.9617           |
| 0.0302        | 80.0  | 8480  | 0.1889          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.6897                 | 0.8                 | 0.7407          | 75                  | 0.8734           | 0.9650        | 0.9169    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.7942            | 0.8879         | 0.8384     | 0.9600           |
| 0.0307        | 81.0  | 8586  | 0.1804          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7262                 | 0.8133              | 0.7673          | 75                  | 0.8671           | 0.9580        | 0.9103    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8011            | 0.8909         | 0.8436     | 0.9617           |
| 0.0289        | 82.0  | 8692  | 0.1857          | 0.8026             | 0.8472          | 0.8243      | 72              | 0.7262                 | 0.8133              | 0.7673          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7973            | 0.8820         | 0.8375     | 0.9610           |
| 0.0312        | 83.0  | 8798  | 0.1917          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8790           | 0.9650        | 0.92      | 143           | 0.6129             | 0.8261          | 0.7037      | 23              | 0.8148         | 0.8462      | 0.8302  | 26          | 0.8016            | 0.8938         | 0.8452     | 0.9612           |
| 0.0286        | 84.0  | 8904  | 0.1832          | 0.8158             | 0.8611          | 0.8378      | 72              | 0.7262                 | 0.8133              | 0.7673          | 75                  | 0.8654           | 0.9441        | 0.9030    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8016            | 0.8820         | 0.8399     | 0.9607           |
| 0.0295        | 85.0  | 9010  | 0.1882          | 0.8133             | 0.8472          | 0.8299      | 72              | 0.7381                 | 0.8267              | 0.7799          | 75                  | 0.8679           | 0.9650        | 0.9139    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8053            | 0.8909         | 0.8459     | 0.9607           |
| 0.0285        | 86.0  | 9116  | 0.1836          | 0.8077             | 0.875           | 0.8400      | 72              | 0.7439                 | 0.8133              | 0.7771          | 75                  | 0.8608           | 0.9510        | 0.9037    | 143           | 0.5667             | 0.7391          | 0.6415      | 23              | 0.8214         | 0.8846      | 0.8519  | 26          | 0.7979            | 0.8850         | 0.8392     | 0.9617           |
| 0.0264        | 87.0  | 9222  | 0.1859          | 0.7975             | 0.875           | 0.8344      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8599           | 0.9441        | 0.9       | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8               | 0.8850         | 0.8403     | 0.9617           |
| 0.0278        | 88.0  | 9328  | 0.1846          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8544           | 0.9441        | 0.8970    | 143           | 0.6071             | 0.7391          | 0.6667      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.7968            | 0.8791         | 0.8359     | 0.9610           |
| 0.0275        | 89.0  | 9434  | 0.1873          | 0.7821             | 0.8472          | 0.8133      | 72              | 0.7470                 | 0.8267              | 0.7848          | 75                  | 0.8544           | 0.9441        | 0.8970    | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8               | 0.8850         | 0.8403     | 0.9615           |
| 0.0274        | 90.0  | 9540  | 0.1894          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7381                 | 0.8267              | 0.7799          | 75                  | 0.8616           | 0.9580        | 0.9073    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8016            | 0.8938         | 0.8452     | 0.9610           |
| 0.0276        | 91.0  | 9646  | 0.1843          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8608           | 0.9510        | 0.9037    | 143           | 0.5862             | 0.7391          | 0.6538      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.7973            | 0.8820         | 0.8375     | 0.9617           |
| 0.029         | 92.0  | 9752  | 0.1910          | 0.8077             | 0.875           | 0.8400      | 72              | 0.7262                 | 0.8133              | 0.7673          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8032            | 0.8909         | 0.8448     | 0.9605           |
| 0.0272        | 93.0  | 9858  | 0.1884          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7011                 | 0.8133              | 0.7531          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.7916            | 0.8850         | 0.8357     | 0.9597           |
| 0.0282        | 94.0  | 9964  | 0.1882          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8734           | 0.9650        | 0.9169    | 143           | 0.5667             | 0.7391          | 0.6415      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.7989            | 0.8909         | 0.8424     | 0.9610           |
| 0.0288        | 95.0  | 10070 | 0.1896          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7176                 | 0.8133              | 0.7625          | 75                  | 0.8608           | 0.9510        | 0.9037    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.7937            | 0.8850         | 0.8368     | 0.9600           |
| 0.028         | 96.0  | 10176 | 0.1878          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8671           | 0.9580        | 0.9103    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.7989            | 0.8909         | 0.8424     | 0.9610           |
| 0.028         | 97.0  | 10282 | 0.1894          | 0.7949             | 0.8611          | 0.8267      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8671           | 0.9580        | 0.9103    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.7989            | 0.8909         | 0.8424     | 0.9605           |
| 0.0275        | 98.0  | 10388 | 0.1890          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8671           | 0.9580        | 0.9103    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8011            | 0.8909         | 0.8436     | 0.9605           |
| 0.0269        | 99.0  | 10494 | 0.1901          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8671           | 0.9580        | 0.9103    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8011            | 0.8909         | 0.8436     | 0.9605           |
| 0.0282        | 100.0 | 10600 | 0.1897          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8671           | 0.9580        | 0.9103    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.8519         | 0.8846      | 0.8679  | 26          | 0.8011            | 0.8909         | 0.8436     | 0.9605           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2