---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-seq_bn-rf64-0
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-seq_bn-rf64-0

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1286
- Location Precision: 0.8077
- Location Recall: 0.9130
- Location F1: 0.8571
- Location Number: 69
- Organization Precision: 0.7231
- Organization Recall: 0.8103
- Organization F1: 0.7642
- Organization Number: 58
- Person Precision: 0.8415
- Person Recall: 0.9079
- Person F1: 0.8734
- Person Number: 152
- Quantity Precision: 0.7143
- Quantity Recall: 0.8333
- Quantity F1: 0.7692
- Quantity Number: 30
- Time Precision: 0.7742
- Time Recall: 0.8276
- Time F1: 0.8000
- Time Number: 29
- Overall Precision: 0.7962
- Overall Recall: 0.8787
- Overall F1: 0.8354
- Overall Accuracy: 0.9624

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.1468        | 1.0   | 106   | 0.6909          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 58                  | 0.0              | 0.0           | 0.0       | 152           | 0.0                | 0.0             | 0.0         | 30              | 0.0            | 0.0         | 0.0     | 29          | 0.0               | 0.0            | 0.0        | 0.8397           |
| 0.6623        | 2.0   | 212   | 0.5532          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 58                  | 0.3889           | 0.0461        | 0.0824    | 152           | 0.0                | 0.0             | 0.0         | 30              | 0.0            | 0.0         | 0.0     | 29          | 0.3684            | 0.0207         | 0.0392     | 0.8433           |
| 0.5401        | 3.0   | 318   | 0.4444          | 0.2857             | 0.0290          | 0.0526      | 69              | 0.0                    | 0.0                 | 0.0             | 58                  | 0.4109           | 0.3487        | 0.3772    | 152           | 0.0                | 0.0             | 0.0         | 30              | 0.4            | 0.2069      | 0.2727  | 29          | 0.3675            | 0.1805         | 0.2421     | 0.8748           |
| 0.4414        | 4.0   | 424   | 0.3588          | 0.4048             | 0.2464          | 0.3063      | 69              | 0.0312                 | 0.0172              | 0.0222          | 58                  | 0.4831           | 0.6579        | 0.5571    | 152           | 0.0                | 0.0             | 0.0         | 30              | 0.5385         | 0.4828      | 0.5091  | 29          | 0.4049            | 0.3905         | 0.3976     | 0.8988           |
| 0.3745        | 5.0   | 530   | 0.3119          | 0.4706             | 0.4638          | 0.4672      | 69              | 0.2                    | 0.1379              | 0.1633          | 58                  | 0.57             | 0.75          | 0.6477    | 152           | 0.2941             | 0.3333          | 0.3125      | 30              | 0.5625         | 0.6207      | 0.5902  | 29          | 0.4866            | 0.5385         | 0.5112     | 0.9157           |
| 0.3306        | 6.0   | 636   | 0.2751          | 0.5172             | 0.6522          | 0.5769      | 69              | 0.4444                 | 0.3448              | 0.3883          | 58                  | 0.6119           | 0.8092        | 0.6969    | 152           | 0.3684             | 0.4667          | 0.4118      | 30              | 0.7931         | 0.7931      | 0.7931  | 29          | 0.5625            | 0.6657         | 0.6098     | 0.9270           |
| 0.2898        | 7.0   | 742   | 0.2449          | 0.5730             | 0.7391          | 0.6456      | 69              | 0.5319                 | 0.4310              | 0.4762          | 58                  | 0.6878           | 0.8553        | 0.7625    | 152           | 0.45               | 0.6             | 0.5143      | 30              | 0.8276         | 0.8276      | 0.8276  | 29          | 0.6294            | 0.7337         | 0.6776     | 0.9347           |
| 0.2565        | 8.0   | 848   | 0.2217          | 0.5778             | 0.7536          | 0.6541      | 69              | 0.4667                 | 0.4828              | 0.4746          | 58                  | 0.7043           | 0.8618        | 0.7751    | 152           | 0.4286             | 0.6             | 0.5         | 30              | 0.8571         | 0.8276      | 0.8421  | 29          | 0.6232            | 0.7485         | 0.6801     | 0.9357           |
| 0.2355        | 9.0   | 954   | 0.1979          | 0.6322             | 0.7971          | 0.7051      | 69              | 0.4815                 | 0.4483              | 0.4643          | 58                  | 0.7389           | 0.875         | 0.8012    | 152           | 0.4186             | 0.6             | 0.4932      | 30              | 0.8571         | 0.8276      | 0.8421  | 29          | 0.6531            | 0.7574         | 0.7014     | 0.9414           |
| 0.2102        | 10.0  | 1060  | 0.1812          | 0.6588             | 0.8116          | 0.7273      | 69              | 0.4821                 | 0.4655              | 0.4737          | 58                  | 0.7586           | 0.8684        | 0.8098    | 152           | 0.45               | 0.6             | 0.5143      | 30              | 0.8571         | 0.8276      | 0.8421  | 29          | 0.6710            | 0.7604         | 0.7129     | 0.9442           |
| 0.1959        | 11.0  | 1166  | 0.1784          | 0.6333             | 0.8261          | 0.7170      | 69              | 0.4677                 | 0.5                 | 0.4833          | 58                  | 0.7374           | 0.8684        | 0.7976    | 152           | 0.475              | 0.6333          | 0.5429      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.6542            | 0.7781         | 0.7108     | 0.9442           |
| 0.1851        | 12.0  | 1272  | 0.1628          | 0.6951             | 0.8261          | 0.7550      | 69              | 0.5                    | 0.5                 | 0.5             | 58                  | 0.7586           | 0.8684        | 0.8098    | 152           | 0.475              | 0.6333          | 0.5429      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.6823            | 0.7751         | 0.7258     | 0.9478           |
| 0.1722        | 13.0  | 1378  | 0.1580          | 0.7108             | 0.8551          | 0.7763      | 69              | 0.4912                 | 0.4828              | 0.4870          | 58                  | 0.7458           | 0.8684        | 0.8024    | 152           | 0.5789             | 0.7333          | 0.6471      | 30              | 0.8387         | 0.8966      | 0.8667  | 29          | 0.6917            | 0.7899         | 0.7376     | 0.9478           |
| 0.1681        | 14.0  | 1484  | 0.1604          | 0.6905             | 0.8406          | 0.7582      | 69              | 0.5070                 | 0.6207              | 0.5581          | 58                  | 0.7674           | 0.8684        | 0.8148    | 152           | 0.6410             | 0.8333          | 0.7246      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.6952            | 0.8166         | 0.7510     | 0.9496           |
| 0.1581        | 15.0  | 1590  | 0.1485          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.5323                 | 0.5690              | 0.5500          | 58                  | 0.7751           | 0.8618        | 0.8162    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7158            | 0.8047         | 0.7577     | 0.9521           |
| 0.1542        | 16.0  | 1696  | 0.1461          | 0.7564             | 0.8551          | 0.8027      | 69              | 0.5522                 | 0.6379              | 0.5920          | 58                  | 0.7706           | 0.8618        | 0.8137    | 152           | 0.5833             | 0.7             | 0.6364      | 30              | 0.8667         | 0.8966      | 0.8814  | 29          | 0.7192            | 0.8107         | 0.7622     | 0.9524           |
| 0.1528        | 17.0  | 1802  | 0.1484          | 0.7143             | 0.8696          | 0.7843      | 69              | 0.5469                 | 0.6034              | 0.5738          | 58                  | 0.7630           | 0.8684        | 0.8123    | 152           | 0.6410             | 0.8333          | 0.7246      | 30              | 0.7353         | 0.8621      | 0.7937  | 29          | 0.7030            | 0.8195         | 0.7568     | 0.9519           |
| 0.1498        | 18.0  | 1908  | 0.1472          | 0.7059             | 0.8696          | 0.7792      | 69              | 0.5410                 | 0.5690              | 0.5546          | 58                  | 0.7644           | 0.875         | 0.8160    | 152           | 0.6154             | 0.8             | 0.6957      | 30              | 0.7576         | 0.8621      | 0.8065  | 29          | 0.7015            | 0.8136         | 0.7534     | 0.9498           |
| 0.1439        | 19.0  | 2014  | 0.1406          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.5536                 | 0.5345              | 0.5439          | 58                  | 0.7751           | 0.8618        | 0.8162    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.8125         | 0.8966      | 0.8525  | 29          | 0.7261            | 0.8077         | 0.7647     | 0.9526           |
| 0.141         | 20.0  | 2120  | 0.1405          | 0.7531             | 0.8841          | 0.8133      | 69              | 0.5645                 | 0.6034              | 0.5833          | 58                  | 0.7811           | 0.8684        | 0.8224    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.7576         | 0.8621      | 0.8065  | 29          | 0.7258            | 0.8225         | 0.7712     | 0.9547           |
| 0.1371        | 21.0  | 2226  | 0.1442          | 0.7470             | 0.8986          | 0.8158      | 69              | 0.56                   | 0.7241              | 0.6316          | 58                  | 0.7778           | 0.875         | 0.8235    | 152           | 0.6316             | 0.8             | 0.7059      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7168            | 0.8462         | 0.7761     | 0.9539           |
| 0.1341        | 22.0  | 2332  | 0.1365          | 0.7561             | 0.8986          | 0.8212      | 69              | 0.5493                 | 0.6724              | 0.6047          | 58                  | 0.7857           | 0.8684        | 0.825     | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.8125         | 0.8966      | 0.8525  | 29          | 0.7256            | 0.8373         | 0.7775     | 0.9565           |
| 0.1304        | 23.0  | 2438  | 0.1390          | 0.7625             | 0.8841          | 0.8188      | 69              | 0.5714                 | 0.6897              | 0.625           | 58                  | 0.7836           | 0.8816        | 0.8297    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.8125         | 0.8966      | 0.8525  | 29          | 0.7315            | 0.8462         | 0.7846     | 0.9552           |
| 0.1318        | 24.0  | 2544  | 0.1461          | 0.7381             | 0.8986          | 0.8105      | 69              | 0.6                    | 0.7241              | 0.6562          | 58                  | 0.7684           | 0.8947        | 0.8267    | 152           | 0.6154             | 0.8             | 0.6957      | 30              | 0.6857         | 0.8276      | 0.75    | 29          | 0.7111            | 0.8521         | 0.7752     | 0.9513           |
| 0.1283        | 25.0  | 2650  | 0.1371          | 0.7654             | 0.8986          | 0.8267      | 69              | 0.5915                 | 0.7241              | 0.6512          | 58                  | 0.8193           | 0.8947        | 0.8553    | 152           | 0.6316             | 0.8             | 0.7059      | 30              | 0.7059         | 0.8276      | 0.7619  | 29          | 0.7385            | 0.8521         | 0.7912     | 0.9565           |
| 0.1235        | 26.0  | 2756  | 0.1399          | 0.7654             | 0.8986          | 0.8267      | 69              | 0.6087                 | 0.7241              | 0.6614          | 58                  | 0.7919           | 0.9013        | 0.8431    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.6857         | 0.8276      | 0.75    | 29          | 0.7323            | 0.8580         | 0.7902     | 0.9554           |
| 0.1227        | 27.0  | 2862  | 0.1340          | 0.775              | 0.8986          | 0.8322      | 69              | 0.6207                 | 0.6207              | 0.6207          | 58                  | 0.8095           | 0.8947        | 0.8500    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7547            | 0.8373         | 0.7938     | 0.9560           |
| 0.1237        | 28.0  | 2968  | 0.1343          | 0.775              | 0.8986          | 0.8322      | 69              | 0.6094                 | 0.6724              | 0.6393          | 58                  | 0.8204           | 0.9013        | 0.8589    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7553            | 0.8491         | 0.7994     | 0.9575           |
| 0.1185        | 29.0  | 3074  | 0.1334          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6271                 | 0.6379              | 0.6325          | 58                  | 0.8204           | 0.9013        | 0.8589    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7620            | 0.8432         | 0.8006     | 0.9575           |
| 0.1188        | 30.0  | 3180  | 0.1292          | 0.7848             | 0.8986          | 0.8378      | 69              | 0.6190                 | 0.6724              | 0.6446          | 58                  | 0.8182           | 0.8882        | 0.8517    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7620            | 0.8432         | 0.8006     | 0.9583           |
| 0.1157        | 31.0  | 3286  | 0.1296          | 0.775              | 0.8986          | 0.8322      | 69              | 0.5902                 | 0.6207              | 0.6050          | 58                  | 0.7988           | 0.8882        | 0.8411    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7460            | 0.8343         | 0.7877     | 0.9580           |
| 0.1159        | 32.0  | 3392  | 0.1288          | 0.7848             | 0.8986          | 0.8378      | 69              | 0.5968                 | 0.6379              | 0.6167          | 58                  | 0.8072           | 0.8816        | 0.8428    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7560            | 0.8343         | 0.7932     | 0.9583           |
| 0.1156        | 33.0  | 3498  | 0.1296          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6032                 | 0.6552              | 0.6281          | 58                  | 0.8110           | 0.875         | 0.8418    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7587            | 0.8373         | 0.7961     | 0.9583           |
| 0.1105        | 34.0  | 3604  | 0.1348          | 0.7949             | 0.8986          | 0.8435      | 69              | 0.6104                 | 0.8103              | 0.6963          | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.6757             | 0.8333          | 0.7463      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7538            | 0.8698         | 0.8077     | 0.9588           |
| 0.1116        | 35.0  | 3710  | 0.1331          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6333                 | 0.6552              | 0.6441          | 58                  | 0.8095           | 0.8947        | 0.8500    | 152           | 0.6154             | 0.8             | 0.6957      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7520            | 0.8432         | 0.7950     | 0.9572           |
| 0.1115        | 36.0  | 3816  | 0.1310          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6094                 | 0.6724              | 0.6393          | 58                  | 0.8121           | 0.8816        | 0.8454    | 152           | 0.6579             | 0.8333          | 0.7353      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7520            | 0.8432         | 0.7950     | 0.9575           |
| 0.1102        | 37.0  | 3922  | 0.1351          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6719                 | 0.7414              | 0.7049          | 58                  | 0.8084           | 0.8882        | 0.8464    | 152           | 0.6410             | 0.8333          | 0.7246      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7572            | 0.8580         | 0.8044     | 0.9590           |
| 0.1082        | 38.0  | 4028  | 0.1363          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6528                 | 0.8103              | 0.7231          | 58                  | 0.8155           | 0.9013        | 0.8562    | 152           | 0.6410             | 0.8333          | 0.7246      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7590            | 0.8757         | 0.8132     | 0.9595           |
| 0.1055        | 39.0  | 4134  | 0.1300          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6825                 | 0.7414              | 0.7107          | 58                  | 0.8133           | 0.8882        | 0.8491    | 152           | 0.6757             | 0.8333          | 0.7463      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7713            | 0.8580         | 0.8123     | 0.9601           |
| 0.1041        | 40.0  | 4240  | 0.1313          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6825                 | 0.7414              | 0.7107          | 58                  | 0.8144           | 0.8947        | 0.8527    | 152           | 0.6316             | 0.8             | 0.7059      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7652            | 0.8580         | 0.8089     | 0.9595           |
| 0.1046        | 41.0  | 4346  | 0.1277          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7069                 | 0.7069              | 0.7069          | 58                  | 0.8107           | 0.9013        | 0.8536    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7844            | 0.8609         | 0.8209     | 0.9606           |
| 0.1035        | 42.0  | 4452  | 0.1274          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6610                 | 0.6724              | 0.6667          | 58                  | 0.8204           | 0.9013        | 0.8589    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7790            | 0.8550         | 0.8152     | 0.9611           |
| 0.1032        | 43.0  | 4558  | 0.1329          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6471                 | 0.7586              | 0.6984          | 58                  | 0.8059           | 0.9013        | 0.8509    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7565            | 0.8639         | 0.8066     | 0.9588           |
| 0.1024        | 44.0  | 4664  | 0.1267          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7                    | 0.7241              | 0.7119          | 58                  | 0.8133           | 0.8882        | 0.8491    | 152           | 0.6667             | 0.8             | 0.7273      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7790            | 0.8550         | 0.8152     | 0.9613           |
| 0.1002        | 45.0  | 4770  | 0.1306          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6765                 | 0.7931              | 0.7302          | 58                  | 0.8144           | 0.8947        | 0.8527    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7757            | 0.8698         | 0.8201     | 0.9611           |
| 0.1001        | 46.0  | 4876  | 0.1273          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7121                 | 0.8103              | 0.7581          | 58                  | 0.8144           | 0.8947        | 0.8527    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7825            | 0.8728         | 0.8252     | 0.9624           |
| 0.0991        | 47.0  | 4982  | 0.1303          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6719                 | 0.7414              | 0.7049          | 58                  | 0.8193           | 0.8947        | 0.8553    | 152           | 0.6667             | 0.8             | 0.7273      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7733            | 0.8580         | 0.8135     | 0.9606           |
| 0.097         | 48.0  | 5088  | 0.1276          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6935                 | 0.7414              | 0.7167          | 58                  | 0.8193           | 0.8947        | 0.8553    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7849            | 0.8639         | 0.8225     | 0.9616           |
| 0.0977        | 49.0  | 5194  | 0.1272          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6923                 | 0.7759              | 0.7317          | 58                  | 0.8193           | 0.8947        | 0.8553    | 152           | 0.6667             | 0.8             | 0.7273      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7793            | 0.8669         | 0.8207     | 0.9618           |
| 0.0972        | 50.0  | 5300  | 0.1248          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6897                 | 0.6897              | 0.6897          | 58                  | 0.8121           | 0.8816        | 0.8454    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8            | 0.8276      | 0.8136  | 29          | 0.7836            | 0.8462         | 0.8137     | 0.9608           |
| 0.096         | 51.0  | 5406  | 0.1289          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6875                 | 0.7586              | 0.7213          | 58                  | 0.8193           | 0.8947        | 0.8553    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7807            | 0.8639         | 0.8202     | 0.9616           |
| 0.0942        | 52.0  | 5512  | 0.1312          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6901                 | 0.8448              | 0.7597          | 58                  | 0.8263           | 0.9079        | 0.8652    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7740            | 0.8817         | 0.8243     | 0.9613           |
| 0.096         | 53.0  | 5618  | 0.1269          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7031                 | 0.7759              | 0.7377          | 58                  | 0.8144           | 0.8947        | 0.8527    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7834            | 0.8669         | 0.8230     | 0.9624           |
| 0.092         | 54.0  | 5724  | 0.1271          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6825                 | 0.7414              | 0.7107          | 58                  | 0.8121           | 0.8816        | 0.8454    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7727            | 0.8550         | 0.8118     | 0.9606           |
| 0.0937        | 55.0  | 5830  | 0.1293          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6857                 | 0.8276              | 0.75            | 58                  | 0.8242           | 0.8947        | 0.8580    | 152           | 0.6757             | 0.8333          | 0.7463      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7769            | 0.8757         | 0.8234     | 0.9613           |
| 0.092         | 56.0  | 5936  | 0.1276          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6721                 | 0.7069              | 0.6891          | 58                  | 0.8133           | 0.8882        | 0.8491    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7742            | 0.8521         | 0.8113     | 0.9606           |
| 0.0908        | 57.0  | 6042  | 0.1289          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6769                 | 0.7586              | 0.7154          | 58                  | 0.8095           | 0.8947        | 0.8500    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7725            | 0.8639         | 0.8156     | 0.9606           |
| 0.089         | 58.0  | 6148  | 0.1268          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8095           | 0.8947        | 0.8500    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7846            | 0.8728         | 0.8263     | 0.9621           |
| 0.089         | 59.0  | 6254  | 0.1250          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7143                 | 0.7759              | 0.7438          | 58                  | 0.8133           | 0.8882        | 0.8491    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8            | 0.8276      | 0.8136  | 29          | 0.7871            | 0.8639         | 0.8237     | 0.9618           |
| 0.0885        | 60.0  | 6360  | 0.1309          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6866                 | 0.7931              | 0.736           | 58                  | 0.8214           | 0.9079        | 0.8625    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7723            | 0.8728         | 0.8194     | 0.9601           |
| 0.0883        | 61.0  | 6466  | 0.1258          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6984                 | 0.7586              | 0.7273          | 58                  | 0.8293           | 0.8947        | 0.8608    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7892            | 0.8639         | 0.8249     | 0.9618           |
| 0.0896        | 62.0  | 6572  | 0.1268          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6935                 | 0.7414              | 0.7167          | 58                  | 0.8253           | 0.9013        | 0.8616    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7871            | 0.8639         | 0.8237     | 0.9611           |
| 0.0893        | 63.0  | 6678  | 0.1258          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7049                 | 0.7414              | 0.7227          | 58                  | 0.8303           | 0.9013        | 0.8644    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7892            | 0.8639         | 0.8249     | 0.9616           |
| 0.089         | 64.0  | 6784  | 0.1325          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6957                 | 0.8276              | 0.7559          | 58                  | 0.8373           | 0.9145        | 0.8742    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.6970         | 0.7931      | 0.7419  | 29          | 0.7734            | 0.8787         | 0.8227     | 0.9603           |
| 0.0892        | 65.0  | 6890  | 0.1317          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6957                 | 0.8276              | 0.7559          | 58                  | 0.8373           | 0.9145        | 0.8742    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7801            | 0.8817         | 0.8278     | 0.9613           |
| 0.0877        | 66.0  | 6996  | 0.1290          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7188                 | 0.7931              | 0.7541          | 58                  | 0.8253           | 0.9013        | 0.8616    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7867            | 0.8728         | 0.8275     | 0.9621           |
| 0.0856        | 67.0  | 7102  | 0.1305          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7188                 | 0.7931              | 0.7541          | 58                  | 0.8466           | 0.9079        | 0.8762    | 152           | 0.6757             | 0.8333          | 0.7463      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7893            | 0.8757         | 0.8303     | 0.9616           |
| 0.0862        | 68.0  | 7208  | 0.1334          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7                    | 0.8448              | 0.7656          | 58                  | 0.8373           | 0.9145        | 0.8742    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.7188         | 0.7931      | 0.7541  | 29          | 0.7781            | 0.8817         | 0.8266     | 0.9611           |
| 0.0867        | 69.0  | 7314  | 0.1309          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6970                 | 0.7931              | 0.7419          | 58                  | 0.8424           | 0.9145        | 0.8770    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7899            | 0.8787         | 0.8319     | 0.9621           |
| 0.0845        | 70.0  | 7420  | 0.1256          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6885                 | 0.7241              | 0.7059          | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7929            | 0.8609         | 0.8255     | 0.9624           |
| 0.0864        | 71.0  | 7526  | 0.1250          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.7031                 | 0.7759              | 0.7377          | 58                  | 0.8144           | 0.8947        | 0.8527    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7876            | 0.8669         | 0.8254     | 0.9621           |
| 0.0854        | 72.0  | 7632  | 0.1275          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7077                 | 0.7931              | 0.7480          | 58                  | 0.8466           | 0.9079        | 0.8762    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7957            | 0.8757         | 0.8338     | 0.9634           |
| 0.0843        | 73.0  | 7738  | 0.1238          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6935                 | 0.7414              | 0.7167          | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7273             | 0.8             | 0.7619      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7908            | 0.8609         | 0.8244     | 0.9618           |
| 0.0871        | 74.0  | 7844  | 0.1290          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.7273                 | 0.8276              | 0.7742          | 58                  | 0.8415           | 0.9079        | 0.8734    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7947            | 0.8817         | 0.8359     | 0.9624           |
| 0.0836        | 75.0  | 7950  | 0.1276          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8405           | 0.9013        | 0.8698    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7957            | 0.8757         | 0.8338     | 0.9626           |
| 0.0825        | 76.0  | 8056  | 0.1277          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.7273                 | 0.8276              | 0.7742          | 58                  | 0.8415           | 0.9079        | 0.8734    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7947            | 0.8817         | 0.8359     | 0.9624           |
| 0.0838        | 77.0  | 8162  | 0.1251          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7951            | 0.8728         | 0.8322     | 0.9621           |
| 0.0846        | 78.0  | 8268  | 0.1269          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7121                 | 0.8103              | 0.7581          | 58                  | 0.8405           | 0.9013        | 0.8698    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7957            | 0.8757         | 0.8338     | 0.9626           |
| 0.0845        | 79.0  | 8374  | 0.1264          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7121                 | 0.8103              | 0.7581          | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7936            | 0.8757         | 0.8326     | 0.9626           |
| 0.0816        | 80.0  | 8480  | 0.1290          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.7206                 | 0.8448              | 0.7778          | 58                  | 0.8303           | 0.9013        | 0.8644    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7188         | 0.7931      | 0.7541  | 29          | 0.7836            | 0.8787         | 0.8285     | 0.9624           |
| 0.0821        | 81.0  | 8586  | 0.1280          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7121                 | 0.8103              | 0.7581          | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7936            | 0.8757         | 0.8326     | 0.9626           |
| 0.0823        | 82.0  | 8692  | 0.1306          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7206                 | 0.8448              | 0.7778          | 58                  | 0.8424           | 0.9145        | 0.8770    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7188         | 0.7931      | 0.7541  | 29          | 0.7910            | 0.8846         | 0.8352     | 0.9631           |
| 0.082         | 83.0  | 8798  | 0.1272          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7951            | 0.8728         | 0.8322     | 0.9626           |
| 0.0796        | 84.0  | 8904  | 0.1286          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7121                 | 0.8103              | 0.7581          | 58                  | 0.8405           | 0.9013        | 0.8698    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7419         | 0.7931      | 0.7667  | 29          | 0.7909            | 0.8728         | 0.8298     | 0.9621           |
| 0.082         | 85.0  | 9010  | 0.1275          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7419         | 0.7931      | 0.7667  | 29          | 0.7903            | 0.8698         | 0.8282     | 0.9618           |
| 0.0827        | 86.0  | 9116  | 0.1279          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8405           | 0.9013        | 0.8698    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7957            | 0.8757         | 0.8338     | 0.9621           |
| 0.0819        | 87.0  | 9222  | 0.1283          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8424           | 0.9145        | 0.8770    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7989            | 0.8817         | 0.8383     | 0.9624           |
| 0.0775        | 88.0  | 9328  | 0.1267          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8303           | 0.9013        | 0.8644    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7936            | 0.8757         | 0.8326     | 0.9626           |
| 0.0784        | 89.0  | 9434  | 0.1289          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8415           | 0.9079        | 0.8734    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7419         | 0.7931      | 0.7667  | 29          | 0.7936            | 0.8757         | 0.8326     | 0.9618           |
| 0.0789        | 90.0  | 9540  | 0.1275          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7951            | 0.8728         | 0.8322     | 0.9626           |
| 0.0808        | 91.0  | 9646  | 0.1293          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7273                 | 0.8276              | 0.7742          | 58                  | 0.8415           | 0.9079        | 0.8734    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7419         | 0.7931      | 0.7667  | 29          | 0.792             | 0.8787         | 0.8331     | 0.9624           |
| 0.0788        | 92.0  | 9752  | 0.1277          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8344           | 0.8947        | 0.8635    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7951            | 0.8728         | 0.8322     | 0.9624           |
| 0.0791        | 93.0  | 9858  | 0.1293          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7273                 | 0.8276              | 0.7742          | 58                  | 0.8415           | 0.9079        | 0.8734    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7947            | 0.8817         | 0.8359     | 0.9624           |
| 0.0786        | 94.0  | 9964  | 0.1287          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8354           | 0.9013        | 0.8671    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7936            | 0.8757         | 0.8326     | 0.9621           |
| 0.0788        | 95.0  | 10070 | 0.1285          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8405           | 0.9013        | 0.8698    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7957            | 0.8757         | 0.8338     | 0.9621           |
| 0.0785        | 96.0  | 10176 | 0.1292          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8424           | 0.9145        | 0.8770    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7947            | 0.8817         | 0.8359     | 0.9626           |
| 0.082         | 97.0  | 10282 | 0.1285          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8405           | 0.9013        | 0.8698    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7936            | 0.8757         | 0.8326     | 0.9621           |
| 0.078         | 98.0  | 10388 | 0.1284          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8405           | 0.9013        | 0.8698    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7957            | 0.8757         | 0.8338     | 0.9618           |
| 0.0783        | 99.0  | 10494 | 0.1284          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8415           | 0.9079        | 0.8734    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7962            | 0.8787         | 0.8354     | 0.9624           |
| 0.0773        | 100.0 | 10600 | 0.1286          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8415           | 0.9079        | 0.8734    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7962            | 0.8787         | 0.8354     | 0.9624           |


### Framework versions

- Transformers 4.40.2
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1