---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-pt-pl20-2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-pt-pl20-2

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2035
- Location Precision: 0.7821
- Location Recall: 0.8472
- Location F1: 0.8133
- Location Number: 72
- Organization Precision: 0.7317
- Organization Recall: 0.8
- Organization F1: 0.7643
- Organization Number: 75
- Person Precision: 0.8210
- Person Recall: 0.9301
- Person F1: 0.8721
- Person Number: 143
- Quantity Precision: 0.6207
- Quantity Recall: 0.7826
- Quantity F1: 0.6923
- Quantity Number: 23
- Time Precision: 0.7143
- Time Recall: 0.7692
- Time F1: 0.7407
- Time Number: 26
- Overall Precision: 0.7704
- Overall Recall: 0.8614
- Overall F1: 0.8134
- Overall Accuracy: 0.9555

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9861        | 1.0   | 106   | 0.5555          | 0.0                | 0.0             | 0.0         | 72              | 0.0                    | 0.0                 | 0.0             | 75                  | 0.0769           | 0.0070        | 0.0128    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.0            | 0.0         | 0.0     | 26          | 0.0435            | 0.0029         | 0.0055     | 0.8469           |
| 0.5078        | 2.0   | 212   | 0.3413          | 0.4762             | 0.1389          | 0.2151      | 72              | 0.0357                 | 0.0133              | 0.0194          | 75                  | 0.5505           | 0.7622        | 0.6393    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.5625         | 0.6923      | 0.6207  | 26          | 0.4726            | 0.4071         | 0.4374     | 0.8962           |
| 0.3115        | 3.0   | 318   | 0.2277          | 0.5054             | 0.6528          | 0.5697      | 72              | 0.4113                 | 0.68                | 0.5126          | 75                  | 0.7619           | 0.8951        | 0.8232    | 143           | 0.3684             | 0.6087          | 0.4590      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.5787            | 0.7699         | 0.6608     | 0.9257           |
| 0.2203        | 4.0   | 424   | 0.2155          | 0.6264             | 0.7917          | 0.6994      | 72              | 0.5464                 | 0.7067              | 0.6163          | 75                  | 0.7824           | 0.9301        | 0.8498    | 143           | 0.3                | 0.6522          | 0.4110      | 23              | 0.6389         | 0.8846      | 0.7419  | 26          | 0.6329            | 0.8289         | 0.7178     | 0.9317           |
| 0.1816        | 5.0   | 530   | 0.1541          | 0.7273             | 0.7778          | 0.7517      | 72              | 0.5686                 | 0.7733              | 0.6554          | 75                  | 0.8232           | 0.9441        | 0.8795    | 143           | 0.6061             | 0.8696          | 0.7143      | 23              | 0.9231         | 0.9231      | 0.9231  | 26          | 0.7289            | 0.8643         | 0.7908     | 0.9490           |
| 0.1655        | 6.0   | 636   | 0.1552          | 0.6522             | 0.8333          | 0.7317      | 72              | 0.6117                 | 0.84                | 0.7079          | 75                  | 0.8395           | 0.9510        | 0.8918    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.6562         | 0.8077      | 0.7241  | 26          | 0.7102            | 0.8820         | 0.7868     | 0.9505           |
| 0.1513        | 7.0   | 742   | 0.1464          | 0.725              | 0.8056          | 0.7632      | 72              | 0.6095                 | 0.8533              | 0.7111          | 75                  | 0.8221           | 0.9371        | 0.8758    | 143           | 0.5882             | 0.8696          | 0.7018      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7184            | 0.8732         | 0.7883     | 0.9530           |
| 0.1403        | 8.0   | 848   | 0.1405          | 0.7215             | 0.7917          | 0.7550      | 72              | 0.6289                 | 0.8133              | 0.7093          | 75                  | 0.8462           | 0.9231        | 0.8829    | 143           | 0.625              | 0.8696          | 0.7273      | 23              | 0.6061         | 0.7692      | 0.6780  | 26          | 0.7305            | 0.8555         | 0.7880     | 0.9542           |
| 0.138         | 9.0   | 954   | 0.1477          | 0.7722             | 0.8472          | 0.8079      | 72              | 0.6176                 | 0.84                | 0.7119          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7538            | 0.8850         | 0.8141     | 0.9527           |
| 0.1301        | 10.0  | 1060  | 0.1356          | 0.7692             | 0.8333          | 0.8         | 72              | 0.6703                 | 0.8133              | 0.7349          | 75                  | 0.8491           | 0.9441        | 0.8940    | 143           | 0.5588             | 0.8261          | 0.6667      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7551            | 0.8732         | 0.8098     | 0.9565           |
| 0.12          | 11.0  | 1166  | 0.1298          | 0.7436             | 0.8056          | 0.7733      | 72              | 0.7079                 | 0.84                | 0.7683          | 75                  | 0.8581           | 0.9301        | 0.8926    | 143           | 0.6129             | 0.8261          | 0.7037      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7696            | 0.8673         | 0.8155     | 0.9587           |
| 0.1171        | 12.0  | 1272  | 0.1306          | 0.7838             | 0.8056          | 0.7945      | 72              | 0.6629                 | 0.7867              | 0.7195          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.8462         | 0.8462      | 0.8462  | 26          | 0.7618            | 0.8584         | 0.8072     | 0.9575           |
| 0.1129        | 13.0  | 1378  | 0.1369          | 0.7468             | 0.8194          | 0.7815      | 72              | 0.6538                 | 0.9067              | 0.7598          | 75                  | 0.8491           | 0.9441        | 0.8940    | 143           | 0.6061             | 0.8696          | 0.7143      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7506            | 0.8968         | 0.8172     | 0.9565           |
| 0.1076        | 14.0  | 1484  | 0.1426          | 0.7662             | 0.8194          | 0.7919      | 72              | 0.6634                 | 0.8933              | 0.7614          | 75                  | 0.8438           | 0.9441        | 0.8911    | 143           | 0.5143             | 0.7826          | 0.6207      | 23              | 0.6562         | 0.8077      | 0.7241  | 26          | 0.7407            | 0.8850         | 0.8065     | 0.9525           |
| 0.1056        | 15.0  | 1590  | 0.1337          | 0.7973             | 0.8194          | 0.8082      | 72              | 0.6804                 | 0.88                | 0.7674          | 75                  | 0.8516           | 0.9231        | 0.8859    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7655            | 0.8761         | 0.8171     | 0.9570           |
| 0.1003        | 16.0  | 1696  | 0.1454          | 0.7821             | 0.8472          | 0.8133      | 72              | 0.67                   | 0.8933              | 0.7657          | 75                  | 0.8590           | 0.9371        | 0.8963    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7607            | 0.8909         | 0.8207     | 0.9575           |
| 0.0997        | 17.0  | 1802  | 0.1396          | 0.7692             | 0.8333          | 0.8         | 72              | 0.6771                 | 0.8667              | 0.7602          | 75                  | 0.8562           | 0.9161        | 0.8851    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7558            | 0.8673         | 0.8077     | 0.9557           |
| 0.0956        | 18.0  | 1908  | 0.1334          | 0.8286             | 0.8056          | 0.8169      | 72              | 0.6559                 | 0.8133              | 0.7262          | 75                  | 0.8581           | 0.9301        | 0.8926    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7704            | 0.8614         | 0.8134     | 0.9587           |
| 0.0906        | 19.0  | 2014  | 0.1338          | 0.7945             | 0.8056          | 0.8         | 72              | 0.66                   | 0.88                | 0.7543          | 75                  | 0.8581           | 0.9301        | 0.8926    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7590            | 0.8732         | 0.8121     | 0.9572           |
| 0.0876        | 20.0  | 2120  | 0.1532          | 0.7922             | 0.8472          | 0.8188      | 72              | 0.6733                 | 0.9067              | 0.7727          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7575            | 0.8938         | 0.8200     | 0.9565           |
| 0.0841        | 21.0  | 2226  | 0.1475          | 0.7722             | 0.8472          | 0.8079      | 72              | 0.6966                 | 0.8267              | 0.7561          | 75                  | 0.8471           | 0.9301        | 0.8867    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7623            | 0.8702         | 0.8127     | 0.9567           |
| 0.0842        | 22.0  | 2332  | 0.1390          | 0.7821             | 0.8472          | 0.8133      | 72              | 0.6939                 | 0.9067              | 0.7861          | 75                  | 0.8544           | 0.9441        | 0.8970    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7646            | 0.8909         | 0.8229     | 0.9570           |
| 0.0798        | 23.0  | 2438  | 0.1507          | 0.7838             | 0.8056          | 0.7945      | 72              | 0.6571                 | 0.92                | 0.7667          | 75                  | 0.8535           | 0.9371        | 0.8933    | 143           | 0.5294             | 0.7826          | 0.6316      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7538            | 0.8850         | 0.8141     | 0.9542           |
| 0.0775        | 24.0  | 2544  | 0.1442          | 0.7895             | 0.8333          | 0.8108      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8544           | 0.9441        | 0.8970    | 143           | 0.6897             | 0.8696          | 0.7692      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.792             | 0.8761         | 0.8319     | 0.9605           |
| 0.0759        | 25.0  | 2650  | 0.1459          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.6979                 | 0.8933              | 0.7836          | 75                  | 0.8590           | 0.9371        | 0.8963    | 143           | 0.5278             | 0.8261          | 0.6441      | 23              | 0.6774         | 0.8077      | 0.7368  | 26          | 0.7652            | 0.8938         | 0.8245     | 0.9582           |
| 0.0731        | 26.0  | 2756  | 0.1513          | 0.7945             | 0.8056          | 0.8         | 72              | 0.7386                 | 0.8667              | 0.7975          | 75                  | 0.8491           | 0.9441        | 0.8940    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7884            | 0.8791         | 0.8312     | 0.9587           |
| 0.0714        | 27.0  | 2862  | 0.1555          | 0.7733             | 0.8056          | 0.7891      | 72              | 0.7126                 | 0.8267              | 0.7654          | 75                  | 0.8481           | 0.9371        | 0.8904    | 143           | 0.7037             | 0.8261          | 0.76        | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7813            | 0.8643         | 0.8207     | 0.9577           |
| 0.0697        | 28.0  | 2968  | 0.1459          | 0.7703             | 0.7917          | 0.7808      | 72              | 0.7045                 | 0.8267              | 0.7607          | 75                  | 0.8645           | 0.9371        | 0.8993    | 143           | 0.6786             | 0.8261          | 0.7451      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7828            | 0.8614         | 0.8202     | 0.9587           |
| 0.0701        | 29.0  | 3074  | 0.1691          | 0.8243             | 0.8472          | 0.8356      | 72              | 0.6421                 | 0.8133              | 0.7176          | 75                  | 0.8693           | 0.9301        | 0.8986    | 143           | 0.4857             | 0.7391          | 0.5862      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7565            | 0.8614         | 0.8055     | 0.9532           |
| 0.0678        | 30.0  | 3180  | 0.1441          | 0.8310             | 0.8194          | 0.8252      | 72              | 0.6932                 | 0.8133              | 0.7485          | 75                  | 0.8590           | 0.9371        | 0.8963    | 143           | 0.6786             | 0.8261          | 0.7451      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7909            | 0.8702         | 0.8287     | 0.9582           |
| 0.0658        | 31.0  | 3286  | 0.1574          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.6939                 | 0.9067              | 0.7861          | 75                  | 0.8645           | 0.9371        | 0.8993    | 143           | 0.7308             | 0.8261          | 0.7755      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7891            | 0.8938         | 0.8382     | 0.9585           |
| 0.0648        | 32.0  | 3392  | 0.1517          | 0.8676             | 0.8194          | 0.8429      | 72              | 0.6882                 | 0.8533              | 0.7619          | 75                  | 0.875            | 0.9301        | 0.9017    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7984            | 0.8761         | 0.8354     | 0.9597           |
| 0.0626        | 33.0  | 3498  | 0.1530          | 0.7838             | 0.8056          | 0.7945      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.875            | 0.9301        | 0.9017    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7789            | 0.8732         | 0.8234     | 0.9585           |
| 0.0631        | 34.0  | 3604  | 0.1685          | 0.8158             | 0.8611          | 0.8378      | 72              | 0.7083                 | 0.9067              | 0.7953          | 75                  | 0.8654           | 0.9441        | 0.9030    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.6562         | 0.8077      | 0.7241  | 26          | 0.7755            | 0.8968         | 0.8317     | 0.9572           |
| 0.0598        | 35.0  | 3710  | 0.1641          | 0.8533             | 0.8889          | 0.8707      | 72              | 0.7065                 | 0.8667              | 0.7784          | 75                  | 0.8693           | 0.9301        | 0.8986    | 143           | 0.5294             | 0.7826          | 0.6316      | 23              | 0.7407         | 0.7692      | 0.7547  | 26          | 0.7874            | 0.8850         | 0.8333     | 0.9580           |
| 0.06          | 36.0  | 3816  | 0.1586          | 0.7792             | 0.8333          | 0.8054      | 72              | 0.6989                 | 0.8667              | 0.7738          | 75                  | 0.8590           | 0.9371        | 0.8963    | 143           | 0.6923             | 0.7826          | 0.7347      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7801            | 0.8791         | 0.8266     | 0.9590           |
| 0.0564        | 37.0  | 3922  | 0.1669          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.6768                 | 0.8933              | 0.7701          | 75                  | 0.8645           | 0.9371        | 0.8993    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7763            | 0.8909         | 0.8297     | 0.9595           |
| 0.0583        | 38.0  | 4028  | 0.1536          | 0.8286             | 0.8056          | 0.8169      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8766           | 0.9441        | 0.9091    | 143           | 0.6667             | 0.7826          | 0.72        | 23              | 0.7778         | 0.8077      | 0.7925  | 26          | 0.8116            | 0.8643         | 0.8371     | 0.9607           |
| 0.0545        | 39.0  | 4134  | 0.1697          | 0.8169             | 0.8056          | 0.8112      | 72              | 0.6842                 | 0.8667              | 0.7647          | 75                  | 0.8599           | 0.9441        | 0.9       | 143           | 0.6552             | 0.8261          | 0.7308      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7816            | 0.8761         | 0.8261     | 0.9580           |
| 0.0555        | 40.0  | 4240  | 0.1670          | 0.8182             | 0.875           | 0.8456      | 72              | 0.7065                 | 0.8667              | 0.7784          | 75                  | 0.8590           | 0.9371        | 0.8963    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.625          | 0.7692      | 0.6897  | 26          | 0.7772            | 0.8850         | 0.8276     | 0.9587           |
| 0.0536        | 41.0  | 4346  | 0.1664          | 0.8289             | 0.875           | 0.8514      | 72              | 0.7128                 | 0.8933              | 0.7929          | 75                  | 0.8590           | 0.9371        | 0.8963    | 143           | 0.6667             | 0.7826          | 0.72        | 23              | 0.6774         | 0.8077      | 0.7368  | 26          | 0.7891            | 0.8938         | 0.8382     | 0.9600           |
| 0.0528        | 42.0  | 4452  | 0.1719          | 0.8767             | 0.8889          | 0.8828      | 72              | 0.7045                 | 0.8267              | 0.7607          | 75                  | 0.8654           | 0.9441        | 0.9030    | 143           | 0.5143             | 0.7826          | 0.6207      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7848            | 0.8820         | 0.8306     | 0.9575           |
| 0.0505        | 43.0  | 4558  | 0.1704          | 0.8356             | 0.8472          | 0.8414      | 72              | 0.6813                 | 0.8267              | 0.7470          | 75                  | 0.8581           | 0.9301        | 0.8926    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7717            | 0.8673         | 0.8167     | 0.9552           |
| 0.05          | 44.0  | 4664  | 0.1659          | 0.7792             | 0.8333          | 0.8054      | 72              | 0.7045                 | 0.8267              | 0.7607          | 75                  | 0.8654           | 0.9441        | 0.9030    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7763            | 0.8702         | 0.8206     | 0.9575           |
| 0.0515        | 45.0  | 4770  | 0.1782          | 0.8611             | 0.8611          | 0.8611      | 72              | 0.7229                 | 0.8                 | 0.7595          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5294             | 0.7826          | 0.6316      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7819            | 0.8673         | 0.8224     | 0.9545           |
| 0.0484        | 46.0  | 4876  | 0.1757          | 0.8243             | 0.8472          | 0.8356      | 72              | 0.7262                 | 0.8133              | 0.7673          | 75                  | 0.8261           | 0.9301        | 0.8750    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7407         | 0.7692      | 0.7547  | 26          | 0.7793            | 0.8643         | 0.8196     | 0.9550           |
| 0.0477        | 47.0  | 4982  | 0.1794          | 0.8356             | 0.8472          | 0.8414      | 72              | 0.7143                 | 0.8                 | 0.7547          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7751            | 0.8643         | 0.8173     | 0.9550           |
| 0.0456        | 48.0  | 5088  | 0.1682          | 0.8472             | 0.8472          | 0.8472      | 72              | 0.7381                 | 0.8267              | 0.7799          | 75                  | 0.8710           | 0.9441        | 0.9060    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.8043            | 0.8732         | 0.8373     | 0.9610           |
| 0.0458        | 49.0  | 5194  | 0.1815          | 0.8630             | 0.875           | 0.8690      | 72              | 0.6224                 | 0.8133              | 0.7052          | 75                  | 0.8481           | 0.9371        | 0.8904    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7609            | 0.8732         | 0.8132     | 0.9547           |
| 0.0449        | 50.0  | 5300  | 0.1736          | 0.84               | 0.875           | 0.8571      | 72              | 0.6782                 | 0.7867              | 0.7284          | 75                  | 0.8758           | 0.9371        | 0.9054    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7819            | 0.8673         | 0.8224     | 0.9577           |
| 0.0443        | 51.0  | 5406  | 0.1777          | 0.8158             | 0.8611          | 0.8378      | 72              | 0.7                    | 0.84                | 0.7636          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7708            | 0.8732         | 0.8188     | 0.9572           |
| 0.044         | 52.0  | 5512  | 0.1775          | 0.8421             | 0.8889          | 0.8649      | 72              | 0.6932                 | 0.8133              | 0.7485          | 75                  | 0.8701           | 0.9371        | 0.9024    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7878            | 0.8761         | 0.8296     | 0.9575           |
| 0.0436        | 53.0  | 5618  | 0.1762          | 0.8421             | 0.8889          | 0.8649      | 72              | 0.6813                 | 0.8267              | 0.7470          | 75                  | 0.8535           | 0.9371        | 0.8933    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7720            | 0.8791         | 0.8221     | 0.9572           |
| 0.0416        | 54.0  | 5724  | 0.1832          | 0.8611             | 0.8611          | 0.8611      | 72              | 0.6778                 | 0.8133              | 0.7394          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7831            | 0.8732         | 0.8257     | 0.9570           |
| 0.0403        | 55.0  | 5830  | 0.1950          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.6566                 | 0.8667              | 0.7471          | 75                  | 0.8272           | 0.9371        | 0.8787    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7570            | 0.8820         | 0.8147     | 0.9542           |
| 0.0422        | 56.0  | 5936  | 0.1782          | 0.8219             | 0.8333          | 0.8276      | 72              | 0.6854                 | 0.8133              | 0.7439          | 75                  | 0.8535           | 0.9371        | 0.8933    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7772            | 0.8643         | 0.8184     | 0.9570           |
| 0.0394        | 57.0  | 6042  | 0.1743          | 0.8333             | 0.8333          | 0.8333      | 72              | 0.7108                 | 0.7867              | 0.7468          | 75                  | 0.8526           | 0.9301        | 0.8896    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7902            | 0.8555         | 0.8215     | 0.9590           |
| 0.0409        | 58.0  | 6148  | 0.1751          | 0.8133             | 0.8472          | 0.8299      | 72              | 0.7317                 | 0.8                 | 0.7643          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7793            | 0.8643         | 0.8196     | 0.9567           |
| 0.0384        | 59.0  | 6254  | 0.1745          | 0.7821             | 0.8472          | 0.8133      | 72              | 0.7294                 | 0.8267              | 0.7750          | 75                  | 0.8526           | 0.9301        | 0.8896    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7804            | 0.8702         | 0.8229     | 0.9580           |
| 0.0385        | 60.0  | 6360  | 0.1878          | 0.8312             | 0.8889          | 0.8591      | 72              | 0.7111                 | 0.8533              | 0.7758          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7752            | 0.8850         | 0.8264     | 0.9557           |
| 0.0371        | 61.0  | 6466  | 0.1879          | 0.8429             | 0.8194          | 0.8310      | 72              | 0.7532                 | 0.7733              | 0.7632          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7890            | 0.8496         | 0.8182     | 0.9562           |
| 0.0385        | 62.0  | 6572  | 0.1834          | 0.7763             | 0.8194          | 0.7973      | 72              | 0.7792                 | 0.8                 | 0.7895          | 75                  | 0.8491           | 0.9441        | 0.8940    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7849            | 0.8614         | 0.8214     | 0.9575           |
| 0.0359        | 63.0  | 6678  | 0.1845          | 0.8                | 0.8333          | 0.8163      | 72              | 0.7241                 | 0.84                | 0.7778          | 75                  | 0.8816           | 0.9371        | 0.9085    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.6452         | 0.7692      | 0.7018  | 26          | 0.7825            | 0.8702         | 0.8240     | 0.9587           |
| 0.0355        | 64.0  | 6784  | 0.2017          | 0.8                | 0.8333          | 0.8163      | 72              | 0.6932                 | 0.8133              | 0.7485          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7670            | 0.8643         | 0.8128     | 0.9542           |
| 0.0338        | 65.0  | 6890  | 0.1863          | 0.7763             | 0.8194          | 0.7973      | 72              | 0.7564                 | 0.7867              | 0.7712          | 75                  | 0.8481           | 0.9371        | 0.8904    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7407         | 0.7692      | 0.7547  | 26          | 0.7902            | 0.8555         | 0.8215     | 0.9570           |
| 0.0376        | 66.0  | 6996  | 0.1855          | 0.8108             | 0.8333          | 0.8219      | 72              | 0.7595                 | 0.8                 | 0.7792          | 75                  | 0.8333           | 0.9441        | 0.8852    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7834            | 0.8643         | 0.8219     | 0.9565           |
| 0.0324        | 67.0  | 7102  | 0.1954          | 0.8                | 0.8333          | 0.8163      | 72              | 0.7564                 | 0.7867              | 0.7712          | 75                  | 0.8239           | 0.9161        | 0.8675    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7742            | 0.8496         | 0.8101     | 0.9547           |
| 0.0361        | 68.0  | 7208  | 0.2019          | 0.8133             | 0.8472          | 0.8299      | 72              | 0.6897                 | 0.8                 | 0.7407          | 75                  | 0.8354           | 0.9231        | 0.8771    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7698            | 0.8584         | 0.8117     | 0.9535           |
| 0.0329        | 69.0  | 7314  | 0.1935          | 0.8026             | 0.8472          | 0.8243      | 72              | 0.7108                 | 0.7867              | 0.7468          | 75                  | 0.8302           | 0.9231        | 0.8742    | 143           | 0.6667             | 0.7826          | 0.72        | 23              | 0.7407         | 0.7692      | 0.7547  | 26          | 0.7796            | 0.8555         | 0.8158     | 0.9560           |
| 0.0336        | 70.0  | 7420  | 0.1864          | 0.8312             | 0.8889          | 0.8591      | 72              | 0.6897                 | 0.8                 | 0.7407          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.6667             | 0.7826          | 0.72        | 23              | 0.7407         | 0.7692      | 0.7547  | 26          | 0.7831            | 0.8732         | 0.8257     | 0.9582           |
| 0.0346        | 71.0  | 7526  | 0.1893          | 0.8356             | 0.8472          | 0.8414      | 72              | 0.6374                 | 0.7733              | 0.6988          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7407         | 0.7692      | 0.7547  | 26          | 0.7592            | 0.8555         | 0.8044     | 0.9550           |
| 0.0312        | 72.0  | 7632  | 0.1960          | 0.8378             | 0.8611          | 0.8493      | 72              | 0.6897                 | 0.8                 | 0.7407          | 75                  | 0.8481           | 0.9371        | 0.8904    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7407         | 0.7692      | 0.7547  | 26          | 0.7798            | 0.8673         | 0.8212     | 0.9570           |
| 0.0342        | 73.0  | 7738  | 0.1941          | 0.8158             | 0.8611          | 0.8378      | 72              | 0.6848                 | 0.84                | 0.7545          | 75                  | 0.8408           | 0.9231        | 0.8800    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7723            | 0.8702         | 0.8183     | 0.9555           |
| 0.0319        | 74.0  | 7844  | 0.1931          | 0.8101             | 0.8889          | 0.8477      | 72              | 0.7209                 | 0.8267              | 0.7702          | 75                  | 0.8282           | 0.9441        | 0.8824    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7726            | 0.8820         | 0.8237     | 0.9582           |
| 0.0293        | 75.0  | 7950  | 0.1970          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.7059                 | 0.8                 | 0.7500          | 75                  | 0.825            | 0.9231        | 0.8713    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7407         | 0.7692      | 0.7547  | 26          | 0.7725            | 0.8614         | 0.8145     | 0.9552           |
| 0.0311        | 76.0  | 8056  | 0.1867          | 0.8077             | 0.875           | 0.8400      | 72              | 0.7011                 | 0.8133              | 0.7531          | 75                  | 0.8282           | 0.9441        | 0.8824    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7760            | 0.8791         | 0.8243     | 0.9582           |
| 0.0299        | 77.0  | 8162  | 0.1915          | 0.7975             | 0.875           | 0.8344      | 72              | 0.7011                 | 0.8133              | 0.7531          | 75                  | 0.8333           | 0.9441        | 0.8852    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7674            | 0.8761         | 0.8182     | 0.9565           |
| 0.03          | 78.0  | 8268  | 0.1934          | 0.8108             | 0.8333          | 0.8219      | 72              | 0.7125                 | 0.76                | 0.7355          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7790            | 0.8525         | 0.8141     | 0.9570           |
| 0.0305        | 79.0  | 8374  | 0.1943          | 0.8                | 0.8333          | 0.8163      | 72              | 0.7093                 | 0.8133              | 0.7578          | 75                  | 0.8428           | 0.9371        | 0.8874    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7751            | 0.8643         | 0.8173     | 0.9567           |
| 0.0306        | 80.0  | 8480  | 0.1931          | 0.7945             | 0.8056          | 0.8         | 72              | 0.7093                 | 0.8133              | 0.7578          | 75                  | 0.8282           | 0.9441        | 0.8824    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7731            | 0.8643         | 0.8162     | 0.9575           |
| 0.0286        | 81.0  | 8586  | 0.1907          | 0.7867             | 0.8194          | 0.8027      | 72              | 0.7209                 | 0.8267              | 0.7702          | 75                  | 0.8221           | 0.9371        | 0.8758    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7690            | 0.8643         | 0.8139     | 0.9557           |
| 0.0283        | 82.0  | 8692  | 0.1927          | 0.8052             | 0.8611          | 0.8322      | 72              | 0.725                  | 0.7733              | 0.7484          | 75                  | 0.8160           | 0.9301        | 0.8693    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7678            | 0.8584         | 0.8106     | 0.9580           |
| 0.0289        | 83.0  | 8798  | 0.1928          | 0.7945             | 0.8056          | 0.8         | 72              | 0.7059                 | 0.8                 | 0.7500          | 75                  | 0.8261           | 0.9301        | 0.8750    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7686            | 0.8525         | 0.8084     | 0.9565           |
| 0.0289        | 84.0  | 8904  | 0.1964          | 0.7973             | 0.8194          | 0.8082      | 72              | 0.7011                 | 0.8133              | 0.7531          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7751            | 0.8643         | 0.8173     | 0.9572           |
| 0.0283        | 85.0  | 9010  | 0.1961          | 0.7792             | 0.8333          | 0.8054      | 72              | 0.7284                 | 0.7867              | 0.7564          | 75                  | 0.8282           | 0.9441        | 0.8824    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7725            | 0.8614         | 0.8145     | 0.9572           |
| 0.0279        | 86.0  | 9116  | 0.2006          | 0.7662             | 0.8194          | 0.7919      | 72              | 0.7284                 | 0.7867              | 0.7564          | 75                  | 0.8272           | 0.9371        | 0.8787    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7672            | 0.8555         | 0.8089     | 0.9550           |
| 0.0288        | 87.0  | 9222  | 0.2026          | 0.7792             | 0.8333          | 0.8054      | 72              | 0.7209                 | 0.8267              | 0.7702          | 75                  | 0.8221           | 0.9371        | 0.8758    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7676            | 0.8673         | 0.8144     | 0.9560           |
| 0.0275        | 88.0  | 9328  | 0.1998          | 0.7625             | 0.8472          | 0.8026      | 72              | 0.7308                 | 0.76                | 0.7451          | 75                  | 0.8242           | 0.9510        | 0.8831    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7684            | 0.8614         | 0.8122     | 0.9570           |
| 0.0272        | 89.0  | 9434  | 0.1984          | 0.7848             | 0.8611          | 0.8212      | 72              | 0.6889                 | 0.8267              | 0.7515          | 75                  | 0.8232           | 0.9441        | 0.8795    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7635            | 0.8761         | 0.8159     | 0.9562           |
| 0.0265        | 90.0  | 9540  | 0.2002          | 0.8219             | 0.8333          | 0.8276      | 72              | 0.7439                 | 0.8133              | 0.7771          | 75                  | 0.8282           | 0.9441        | 0.8824    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7819            | 0.8673         | 0.8224     | 0.9575           |
| 0.0258        | 91.0  | 9646  | 0.1959          | 0.7922             | 0.8472          | 0.8188      | 72              | 0.7143                 | 0.8                 | 0.7547          | 75                  | 0.8171           | 0.9371        | 0.8730    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7670            | 0.8643         | 0.8128     | 0.9575           |
| 0.0256        | 92.0  | 9752  | 0.2037          | 0.7975             | 0.875           | 0.8344      | 72              | 0.7176                 | 0.8133              | 0.7625          | 75                  | 0.8199           | 0.9231        | 0.8684    | 143           | 0.6429             | 0.7826          | 0.7059      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7717            | 0.8673         | 0.8167     | 0.9557           |
| 0.026         | 93.0  | 9858  | 0.2079          | 0.7848             | 0.8611          | 0.8212      | 72              | 0.7381                 | 0.8267              | 0.7799          | 75                  | 0.825            | 0.9231        | 0.8713    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7717            | 0.8673         | 0.8167     | 0.9547           |
| 0.0269        | 94.0  | 9964  | 0.2035          | 0.7848             | 0.8611          | 0.8212      | 72              | 0.7262                 | 0.8133              | 0.7673          | 75                  | 0.8199           | 0.9231        | 0.8684    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7690            | 0.8643         | 0.8139     | 0.9552           |
| 0.0254        | 95.0  | 10070 | 0.2072          | 0.7848             | 0.8611          | 0.8212      | 72              | 0.7176                 | 0.8133              | 0.7625          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7676            | 0.8673         | 0.8144     | 0.9550           |
| 0.0255        | 96.0  | 10176 | 0.2007          | 0.7975             | 0.875           | 0.8344      | 72              | 0.7229                 | 0.8                 | 0.7595          | 75                  | 0.8199           | 0.9231        | 0.8684    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7711            | 0.8643         | 0.8150     | 0.9555           |
| 0.0248        | 97.0  | 10282 | 0.2019          | 0.7848             | 0.8611          | 0.8212      | 72              | 0.7375                 | 0.7867              | 0.7613          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7725            | 0.8614         | 0.8145     | 0.9557           |
| 0.0258        | 98.0  | 10388 | 0.2024          | 0.7848             | 0.8611          | 0.8212      | 72              | 0.7229                 | 0.8                 | 0.7595          | 75                  | 0.8199           | 0.9231        | 0.8684    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7684            | 0.8614         | 0.8122     | 0.9555           |
| 0.0251        | 99.0  | 10494 | 0.2053          | 0.7848             | 0.8611          | 0.8212      | 72              | 0.7349                 | 0.8133              | 0.7722          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7717            | 0.8673         | 0.8167     | 0.9560           |
| 0.0255        | 100.0 | 10600 | 0.2035          | 0.7821             | 0.8472          | 0.8133      | 72              | 0.7317                 | 0.8                 | 0.7643          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7143         | 0.7692      | 0.7407  | 26          | 0.7704            | 0.8614         | 0.8134     | 0.9555           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2