---
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-unipelt-0
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-unipelt-0

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.2329
- Location Precision: 0.7778
- Location Recall: 0.9130
- Location F1: 0.84
- Location Number: 69
- Organization Precision: 0.6389
- Organization Recall: 0.7931
- Organization F1: 0.7077
- Organization Number: 58
- Person Precision: 0.8868
- Person Recall: 0.9276
- Person F1: 0.9068
- Person Number: 152
- Quantity Precision: 0.7576
- Quantity Recall: 0.8333
- Quantity F1: 0.7937
- Quantity Number: 30
- Time Precision: 0.8333
- Time Recall: 0.8621
- Time F1: 0.8475
- Time Number: 29
- Overall Precision: 0.8
- Overall Recall: 0.8876
- Overall F1: 0.8415
- Overall Accuracy: 0.9631

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.9461        | 1.0   | 106   | 0.5988          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 58                  | 0.25             | 0.0066        | 0.0128    | 152           | 0.0                | 0.0             | 0.0         | 30              | 0.0            | 0.0         | 0.0     | 29          | 0.2               | 0.0030         | 0.0058     | 0.8402           |
| 0.5011        | 2.0   | 212   | 0.3293          | 0.3902             | 0.2319          | 0.2909      | 69              | 0.2222                 | 0.1034              | 0.1412          | 58                  | 0.5810           | 0.8026        | 0.6740    | 152           | 0.0952             | 0.0667          | 0.0784      | 30              | 0.5            | 0.5862      | 0.5397  | 29          | 0.4895            | 0.4822         | 0.4858     | 0.9052           |
| 0.2868        | 3.0   | 318   | 0.1914          | 0.5789             | 0.7971          | 0.6707      | 69              | 0.4333                 | 0.6724              | 0.5270          | 58                  | 0.7472           | 0.875         | 0.8061    | 152           | 0.5116             | 0.7333          | 0.6027      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.6247            | 0.8077         | 0.7045     | 0.9357           |
| 0.1873        | 4.0   | 424   | 0.1713          | 0.7356             | 0.9275          | 0.8205      | 69              | 0.5522                 | 0.6379              | 0.5920          | 58                  | 0.7624           | 0.9079        | 0.8288    | 152           | 0.5532             | 0.8667          | 0.6753      | 30              | 0.5789         | 0.7586      | 0.6567  | 29          | 0.6833            | 0.8491         | 0.7573     | 0.9424           |
| 0.158         | 5.0   | 530   | 0.1297          | 0.7143             | 0.7971          | 0.7534      | 69              | 0.5432                 | 0.7586              | 0.6331          | 58                  | 0.8303           | 0.9013        | 0.8644    | 152           | 0.7222             | 0.8667          | 0.7879      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7378            | 0.8491         | 0.7895     | 0.9549           |
| 0.1399        | 6.0   | 636   | 0.1322          | 0.7093             | 0.8841          | 0.7871      | 69              | 0.5972                 | 0.7414              | 0.6615          | 58                  | 0.8059           | 0.9013        | 0.8509    | 152           | 0.7027             | 0.8667          | 0.7761      | 30              | 0.5946         | 0.7586      | 0.6667  | 29          | 0.7189            | 0.8550         | 0.7811     | 0.9560           |
| 0.129         | 7.0   | 742   | 0.1299          | 0.7654             | 0.8986          | 0.8267      | 69              | 0.6143                 | 0.7414              | 0.6719          | 58                  | 0.8166           | 0.9079        | 0.8598    | 152           | 0.6098             | 0.8333          | 0.7042      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7449            | 0.8639         | 0.8        | 0.9557           |
| 0.1206        | 8.0   | 848   | 0.1284          | 0.7848             | 0.8986          | 0.8378      | 69              | 0.6176                 | 0.7241              | 0.6667          | 58                  | 0.8313           | 0.9079        | 0.8679    | 152           | 0.6970             | 0.7667          | 0.7302      | 30              | 0.6765         | 0.7931      | 0.7302  | 29          | 0.7579            | 0.8521         | 0.8022     | 0.9580           |
| 0.113         | 9.0   | 954   | 0.1300          | 0.8052             | 0.8986          | 0.8493      | 69              | 0.6212                 | 0.7069              | 0.6613          | 58                  | 0.8129           | 0.9145        | 0.8607    | 152           | 0.6389             | 0.7667          | 0.6970      | 30              | 0.6857         | 0.8276      | 0.75    | 29          | 0.7506            | 0.8550         | 0.7994     | 0.9570           |
| 0.1052        | 10.0  | 1060  | 0.1301          | 0.7654             | 0.8986          | 0.8267      | 69              | 0.6866                 | 0.7931              | 0.736           | 58                  | 0.8373           | 0.9145        | 0.8742    | 152           | 0.6667             | 0.8             | 0.7273      | 30              | 0.6970         | 0.7931      | 0.7419  | 29          | 0.7676            | 0.8698         | 0.8155     | 0.9601           |
| 0.1015        | 11.0  | 1166  | 0.1399          | 0.775              | 0.8986          | 0.8322      | 69              | 0.6377                 | 0.7586              | 0.6929          | 58                  | 0.8528           | 0.9145        | 0.8825    | 152           | 0.5                | 0.7667          | 0.6053      | 30              | 0.6667         | 0.8276      | 0.7385  | 29          | 0.7411            | 0.8639         | 0.7978     | 0.9572           |
| 0.0947        | 12.0  | 1272  | 0.1328          | 0.8158             | 0.8986          | 0.8552      | 69              | 0.6406                 | 0.7069              | 0.6721          | 58                  | 0.8519           | 0.9079        | 0.8790    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7859            | 0.8580         | 0.8204     | 0.9603           |
| 0.0873        | 13.0  | 1378  | 0.1235          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6667                 | 0.6897              | 0.6780          | 58                  | 0.8642           | 0.9211        | 0.8917    | 152           | 0.6970             | 0.7667          | 0.7302      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7880            | 0.8580         | 0.8215     | 0.9618           |
| 0.0866        | 14.0  | 1484  | 0.1283          | 0.8158             | 0.8986          | 0.8552      | 69              | 0.7049                 | 0.7414              | 0.7227          | 58                  | 0.8383           | 0.9211        | 0.8777    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7882            | 0.8698         | 0.8270     | 0.9618           |
| 0.0798        | 15.0  | 1590  | 0.1420          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6842                 | 0.6724              | 0.6783          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.5854             | 0.8             | 0.6761      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7935            | 0.8639         | 0.8272     | 0.9616           |
| 0.0752        | 16.0  | 1696  | 0.1464          | 0.7683             | 0.9130          | 0.8344      | 69              | 0.6184                 | 0.8103              | 0.7015          | 58                  | 0.8659           | 0.9342        | 0.8987    | 152           | 0.5714             | 0.8             | 0.6667      | 30              | 0.7273         | 0.8276      | 0.7742  | 29          | 0.7557            | 0.8876         | 0.8163     | 0.9575           |
| 0.0735        | 17.0  | 1802  | 0.1395          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6575                 | 0.8276              | 0.7328          | 58                  | 0.8434           | 0.9211        | 0.8805    | 152           | 0.6316             | 0.8             | 0.7059      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7686            | 0.8846         | 0.8226     | 0.9593           |
| 0.0706        | 18.0  | 1908  | 0.1400          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6613                 | 0.7069              | 0.6833          | 58                  | 0.8623           | 0.9474        | 0.9028    | 152           | 0.6154             | 0.8             | 0.6957      | 30              | 0.6857         | 0.8276      | 0.75    | 29          | 0.7775            | 0.8787         | 0.8250     | 0.9598           |
| 0.0659        | 19.0  | 2014  | 0.1347          | 0.8312             | 0.9275          | 0.8767      | 69              | 0.6567                 | 0.7586              | 0.7040          | 58                  | 0.8718           | 0.8947        | 0.8831    | 152           | 0.6486             | 0.8             | 0.7164      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7935            | 0.8639         | 0.8272     | 0.9611           |
| 0.0675        | 20.0  | 2120  | 0.1337          | 0.8182             | 0.9130          | 0.8630      | 69              | 0.6825                 | 0.7414              | 0.7107          | 58                  | 0.8659           | 0.9342        | 0.8987    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7667         | 0.7931      | 0.7797  | 29          | 0.8043            | 0.8757         | 0.8385     | 0.9624           |
| 0.061         | 21.0  | 2226  | 0.1468          | 0.8101             | 0.9275          | 0.8649      | 69              | 0.6087                 | 0.7241              | 0.6614          | 58                  | 0.8758           | 0.9276        | 0.9010    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7867            | 0.8728         | 0.8275     | 0.9601           |
| 0.06          | 22.0  | 2332  | 0.1453          | 0.7561             | 0.8986          | 0.8212      | 69              | 0.6216                 | 0.7931              | 0.6970          | 58                  | 0.8659           | 0.9342        | 0.8987    | 152           | 0.6970             | 0.7667          | 0.7302      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7760            | 0.8817         | 0.8255     | 0.9593           |
| 0.0564        | 23.0  | 2438  | 0.1483          | 0.8133             | 0.8841          | 0.8472      | 69              | 0.6364                 | 0.7241              | 0.6774          | 58                  | 0.8598           | 0.9276        | 0.8924    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.7419         | 0.7931      | 0.7667  | 29          | 0.7844            | 0.8609         | 0.8209     | 0.9585           |
| 0.0554        | 24.0  | 2544  | 0.1449          | 0.8158             | 0.8986          | 0.8552      | 69              | 0.6562                 | 0.7241              | 0.6885          | 58                  | 0.8598           | 0.9276        | 0.8924    | 152           | 0.6970             | 0.7667          | 0.7302      | 30              | 0.8            | 0.8276      | 0.8136  | 29          | 0.7956            | 0.8639         | 0.8284     | 0.9613           |
| 0.0519        | 25.0  | 2650  | 0.1390          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6774                 | 0.7241              | 0.7             | 58                  | 0.8688           | 0.9145        | 0.8910    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8077            | 0.8698         | 0.8376     | 0.9631           |
| 0.0513        | 26.0  | 2756  | 0.1468          | 0.8077             | 0.9130          | 0.8571      | 69              | 0.6515                 | 0.7414              | 0.6935          | 58                  | 0.8614           | 0.9408        | 0.8994    | 152           | 0.7059             | 0.8             | 0.7500      | 30              | 0.7667         | 0.7931      | 0.7797  | 29          | 0.7914            | 0.8757         | 0.8315     | 0.9601           |
| 0.0481        | 27.0  | 2862  | 0.1426          | 0.8052             | 0.8986          | 0.8493      | 69              | 0.6769                 | 0.7586              | 0.7154          | 58                  | 0.8625           | 0.9079        | 0.8846    | 152           | 0.6765             | 0.7667          | 0.7188      | 30              | 0.7931         | 0.7931      | 0.7931  | 29          | 0.7945            | 0.8580         | 0.8250     | 0.9618           |
| 0.049         | 28.0  | 2968  | 0.1447          | 0.8                | 0.9275          | 0.8591      | 69              | 0.6429                 | 0.7759              | 0.7031          | 58                  | 0.8545           | 0.9276        | 0.8896    | 152           | 0.7273             | 0.8             | 0.7619      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7889            | 0.8846         | 0.8340     | 0.9613           |
| 0.0454        | 29.0  | 3074  | 0.1463          | 0.7590             | 0.9130          | 0.8289      | 69              | 0.6301                 | 0.7931              | 0.7023          | 58                  | 0.8659           | 0.9342        | 0.8987    | 152           | 0.7273             | 0.8             | 0.7619      | 30              | 0.7667         | 0.7931      | 0.7797  | 29          | 0.7781            | 0.8817         | 0.8266     | 0.9613           |
| 0.044         | 30.0  | 3180  | 0.1589          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6613                 | 0.7069              | 0.6833          | 58                  | 0.8704           | 0.9276        | 0.8981    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7989            | 0.8698         | 0.8329     | 0.9616           |
| 0.0416        | 31.0  | 3286  | 0.1720          | 0.8                | 0.9275          | 0.8591      | 69              | 0.625                  | 0.6897              | 0.6557          | 58                  | 0.8457           | 0.9013        | 0.8726    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8125         | 0.8966      | 0.8525  | 29          | 0.7871            | 0.8639         | 0.8237     | 0.9585           |
| 0.0401        | 32.0  | 3392  | 0.1568          | 0.7683             | 0.9130          | 0.8344      | 69              | 0.6364                 | 0.7241              | 0.6774          | 58                  | 0.8650           | 0.9276        | 0.8952    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7914            | 0.8757         | 0.8315     | 0.9613           |
| 0.0403        | 33.0  | 3498  | 0.1618          | 0.8                | 0.9275          | 0.8591      | 69              | 0.6154                 | 0.6897              | 0.6504          | 58                  | 0.8805           | 0.9211        | 0.9003    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.7576         | 0.8621      | 0.8065  | 29          | 0.7946            | 0.8698         | 0.8305     | 0.9603           |
| 0.0386        | 34.0  | 3604  | 0.1828          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6479                 | 0.7931              | 0.7132          | 58                  | 0.8545           | 0.9276        | 0.8896    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.6857         | 0.8276      | 0.75    | 29          | 0.7726            | 0.8846         | 0.8248     | 0.9572           |
| 0.039         | 35.0  | 3710  | 0.1586          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6119                 | 0.7069              | 0.6560          | 58                  | 0.8742           | 0.9145        | 0.8939    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7876            | 0.8669         | 0.8254     | 0.9611           |
| 0.0378        | 36.0  | 3816  | 0.1717          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.5663                 | 0.8103              | 0.6667          | 58                  | 0.8882           | 0.9408        | 0.9137    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.7742         | 0.8276      | 0.8000  | 29          | 0.7804            | 0.8935         | 0.8331     | 0.9590           |
| 0.0376        | 37.0  | 3922  | 0.1620          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6212                 | 0.7069              | 0.6613          | 58                  | 0.8875           | 0.9342        | 0.9103    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8027            | 0.8787         | 0.8390     | 0.9621           |
| 0.0337        | 38.0  | 4028  | 0.1658          | 0.8                | 0.9275          | 0.8591      | 69              | 0.6714                 | 0.8103              | 0.7344          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8123            | 0.8964         | 0.8523     | 0.9626           |
| 0.0316        | 39.0  | 4134  | 0.1753          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6267                 | 0.8103              | 0.7068          | 58                  | 0.8805           | 0.9211        | 0.9003    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.7576         | 0.8621      | 0.8065  | 29          | 0.7906            | 0.8935         | 0.8389     | 0.9608           |
| 0.0309        | 40.0  | 4240  | 0.1752          | 0.7805             | 0.9275          | 0.8477      | 69              | 0.6406                 | 0.7069              | 0.6721          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.75           | 0.8276      | 0.7869  | 29          | 0.7951            | 0.8728         | 0.8322     | 0.9613           |
| 0.0299        | 41.0  | 4346  | 0.1854          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6447                 | 0.8448              | 0.7313          | 58                  | 0.8758           | 0.9276        | 0.9010    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7917            | 0.8994         | 0.8421     | 0.9613           |
| 0.0279        | 42.0  | 4452  | 0.1763          | 0.7949             | 0.8986          | 0.8435      | 69              | 0.6377                 | 0.7586              | 0.6929          | 58                  | 0.8861           | 0.9211        | 0.9032    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8043            | 0.8757         | 0.8385     | 0.9634           |
| 0.0314        | 43.0  | 4558  | 0.1803          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6056                 | 0.7414              | 0.6667          | 58                  | 0.8797           | 0.9145        | 0.8968    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.6970         | 0.7931      | 0.7419  | 29          | 0.7751            | 0.8669         | 0.8184     | 0.9583           |
| 0.0285        | 44.0  | 4664  | 0.1857          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6429                 | 0.7759              | 0.7031          | 58                  | 0.8820           | 0.9342        | 0.9073    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7958            | 0.8876         | 0.8392     | 0.9616           |
| 0.0273        | 45.0  | 4770  | 0.1891          | 0.7412             | 0.9130          | 0.8182      | 69              | 0.6286                 | 0.7586              | 0.6875          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.6667             | 0.8             | 0.7273      | 30              | 0.7812         | 0.8621      | 0.8197  | 29          | 0.7775            | 0.8787         | 0.8250     | 0.9593           |
| 0.0283        | 46.0  | 4876  | 0.1838          | 0.7531             | 0.8841          | 0.8133      | 69              | 0.6308                 | 0.7069              | 0.6667          | 58                  | 0.8742           | 0.9145        | 0.8939    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7844            | 0.8609         | 0.8209     | 0.9580           |
| 0.0251        | 47.0  | 4982  | 0.1939          | 0.7590             | 0.9130          | 0.8289      | 69              | 0.6316                 | 0.8276              | 0.7164          | 58                  | 0.8797           | 0.9145        | 0.8968    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.7576         | 0.8621      | 0.8065  | 29          | 0.7766            | 0.8846         | 0.8271     | 0.9601           |
| 0.0247        | 48.0  | 5088  | 0.1982          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6111                 | 0.7586              | 0.6769          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.6944             | 0.8333          | 0.7576      | 30              | 0.7647         | 0.8966      | 0.8254  | 29          | 0.7827            | 0.8846         | 0.8306     | 0.9603           |
| 0.0245        | 49.0  | 5194  | 0.1886          | 0.7683             | 0.9130          | 0.8344      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8875           | 0.9342        | 0.9103    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.7879         | 0.8966      | 0.8387  | 29          | 0.7989            | 0.8935         | 0.8436     | 0.9626           |
| 0.0222        | 50.0  | 5300  | 0.1843          | 0.8267             | 0.8986          | 0.8611      | 69              | 0.6557                 | 0.6897              | 0.6723          | 58                  | 0.8616           | 0.9013        | 0.8810    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8101            | 0.8580         | 0.8333     | 0.9624           |
| 0.0223        | 51.0  | 5406  | 0.2019          | 0.775              | 0.8986          | 0.8322      | 69              | 0.6620                 | 0.8103              | 0.7287          | 58                  | 0.8931           | 0.9342        | 0.9132    | 152           | 0.6857             | 0.8             | 0.7385      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8               | 0.8876         | 0.8415     | 0.9618           |
| 0.022         | 52.0  | 5512  | 0.2002          | 0.7949             | 0.8986          | 0.8435      | 69              | 0.6429                 | 0.7759              | 0.7031          | 58                  | 0.8875           | 0.9342        | 0.9103    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8038            | 0.8846         | 0.8423     | 0.9629           |
| 0.0226        | 53.0  | 5618  | 0.2004          | 0.7848             | 0.8986          | 0.8378      | 69              | 0.6522                 | 0.7759              | 0.7087          | 58                  | 0.8812           | 0.9276        | 0.9038    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8032            | 0.8817         | 0.8406     | 0.9626           |
| 0.0203        | 54.0  | 5724  | 0.2078          | 0.7590             | 0.9130          | 0.8289      | 69              | 0.6438                 | 0.8103              | 0.7176          | 58                  | 0.8981           | 0.9276        | 0.9126    | 152           | 0.7647             | 0.8667          | 0.8125      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7989            | 0.8935         | 0.8436     | 0.9621           |
| 0.0205        | 55.0  | 5830  | 0.2010          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6216                 | 0.7931              | 0.6970          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.7879         | 0.8966      | 0.8387  | 29          | 0.7921            | 0.8905         | 0.8384     | 0.9613           |
| 0.02          | 56.0  | 5936  | 0.2016          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6338                 | 0.7759              | 0.6977          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7995            | 0.8846         | 0.8399     | 0.9618           |
| 0.0183        | 57.0  | 6042  | 0.2022          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6479                 | 0.7931              | 0.7132          | 58                  | 0.8642           | 0.9211        | 0.8917    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7931            | 0.8846         | 0.8364     | 0.9626           |
| 0.0208        | 58.0  | 6148  | 0.1962          | 0.775              | 0.8986          | 0.8322      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8805           | 0.9211        | 0.9003    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8016            | 0.8846         | 0.8411     | 0.9621           |
| 0.02          | 59.0  | 6254  | 0.2105          | 0.7711             | 0.9275          | 0.8421      | 69              | 0.6438                 | 0.8103              | 0.7176          | 58                  | 0.8861           | 0.9211        | 0.9032    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7942            | 0.8905         | 0.8396     | 0.9598           |
| 0.02          | 60.0  | 6360  | 0.2095          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6957                 | 0.8276              | 0.7559          | 58                  | 0.8797           | 0.9145        | 0.8968    | 152           | 0.7353             | 0.8333          | 0.7812      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8086            | 0.8876         | 0.8463     | 0.9618           |
| 0.0189        | 61.0  | 6466  | 0.2092          | 0.7848             | 0.8986          | 0.8378      | 69              | 0.7231                 | 0.8103              | 0.7642          | 58                  | 0.8917           | 0.9211        | 0.9061    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8192            | 0.8846         | 0.8506     | 0.9629           |
| 0.0189        | 62.0  | 6572  | 0.1975          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.7188                 | 0.7931              | 0.7541          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8621         | 0.8621      | 0.8621  | 29          | 0.8292            | 0.8905         | 0.8588     | 0.9667           |
| 0.0181        | 63.0  | 6678  | 0.2113          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6216                 | 0.7931              | 0.6970          | 58                  | 0.8917           | 0.9211        | 0.9061    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7952            | 0.8846         | 0.8375     | 0.9631           |
| 0.0169        | 64.0  | 6784  | 0.2146          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6667                 | 0.8621              | 0.7519          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8064            | 0.8994         | 0.8503     | 0.9624           |
| 0.0156        | 65.0  | 6890  | 0.2125          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6538                 | 0.8793              | 0.7500          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8074            | 0.9053         | 0.8536     | 0.9631           |
| 0.0184        | 66.0  | 6996  | 0.2206          | 0.7711             | 0.9275          | 0.8421      | 69              | 0.6970                 | 0.7931              | 0.7419          | 58                  | 0.8712           | 0.9342        | 0.9016    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8059            | 0.8964         | 0.8487     | 0.9621           |
| 0.0157        | 67.0  | 7102  | 0.2219          | 0.7590             | 0.9130          | 0.8289      | 69              | 0.6901                 | 0.8448              | 0.7597          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7995            | 0.8964         | 0.8452     | 0.9611           |
| 0.017         | 68.0  | 7208  | 0.2105          | 0.7975             | 0.9130          | 0.8514      | 69              | 0.6806                 | 0.8448              | 0.7538          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8150            | 0.8994         | 0.8551     | 0.9641           |
| 0.0153        | 69.0  | 7314  | 0.2124          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6571                 | 0.7931              | 0.7188          | 58                  | 0.8805           | 0.9211        | 0.9003    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8048            | 0.8905         | 0.8455     | 0.9624           |
| 0.0144        | 70.0  | 7420  | 0.2171          | 0.7619             | 0.9275          | 0.8366      | 69              | 0.625                  | 0.7759              | 0.6923          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7937            | 0.8876         | 0.8380     | 0.9618           |
| 0.0143        | 71.0  | 7526  | 0.2197          | 0.7470             | 0.8986          | 0.8158      | 69              | 0.6389                 | 0.7931              | 0.7077          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7143             | 0.8333          | 0.7692      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7910            | 0.8846         | 0.8352     | 0.9618           |
| 0.0132        | 72.0  | 7632  | 0.2083          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6176                 | 0.7241              | 0.6667          | 58                  | 0.8790           | 0.9079        | 0.8932    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7940            | 0.8669         | 0.8289     | 0.9629           |
| 0.0135        | 73.0  | 7738  | 0.2157          | 0.7711             | 0.9275          | 0.8421      | 69              | 0.6216                 | 0.7931              | 0.6970          | 58                  | 0.8981           | 0.9276        | 0.9126    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7989            | 0.8935         | 0.8436     | 0.9624           |
| 0.0129        | 74.0  | 7844  | 0.2206          | 0.7805             | 0.9275          | 0.8477      | 69              | 0.6438                 | 0.8103              | 0.7176          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8032            | 0.8935         | 0.8459     | 0.9629           |
| 0.0121        | 75.0  | 7950  | 0.2265          | 0.8                | 0.9275          | 0.8591      | 69              | 0.6486                 | 0.8276              | 0.7273          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8037            | 0.8964         | 0.8476     | 0.9626           |
| 0.0128        | 76.0  | 8056  | 0.2191          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6667                 | 0.8276              | 0.7385          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8085            | 0.8994         | 0.8515     | 0.9636           |
| 0.0129        | 77.0  | 8162  | 0.2162          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6389                 | 0.7931              | 0.7077          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.8053            | 0.8935         | 0.8471     | 0.9634           |
| 0.0136        | 78.0  | 8268  | 0.2211          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6234                 | 0.8276              | 0.7111          | 58                  | 0.8812           | 0.9276        | 0.9038    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7953            | 0.8964         | 0.8428     | 0.9624           |
| 0.0121        | 79.0  | 8374  | 0.2213          | 0.7805             | 0.9275          | 0.8477      | 69              | 0.6438                 | 0.8103              | 0.7176          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8059            | 0.8964         | 0.8487     | 0.9641           |
| 0.0111        | 80.0  | 8480  | 0.2249          | 0.7805             | 0.9275          | 0.8477      | 69              | 0.6761                 | 0.8276              | 0.7442          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.808             | 0.8964         | 0.8499     | 0.9636           |
| 0.0118        | 81.0  | 8586  | 0.2286          | 0.7683             | 0.9130          | 0.8344      | 69              | 0.6216                 | 0.7931              | 0.6970          | 58                  | 0.8861           | 0.9211        | 0.9032    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8065         | 0.8621      | 0.8333  | 29          | 0.7910            | 0.8846         | 0.8352     | 0.9618           |
| 0.0115        | 82.0  | 8692  | 0.2236          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6806                 | 0.8448              | 0.7538          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8128            | 0.8994         | 0.8539     | 0.9641           |
| 0.0108        | 83.0  | 8798  | 0.2275          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6216                 | 0.7931              | 0.6970          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7958            | 0.8876         | 0.8392     | 0.9626           |
| 0.0129        | 84.0  | 8904  | 0.2284          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6351                 | 0.8103              | 0.7121          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7984            | 0.8905         | 0.8420     | 0.9626           |
| 0.011         | 85.0  | 9010  | 0.2237          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6301                 | 0.7931              | 0.7023          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8027            | 0.8905         | 0.8443     | 0.9644           |
| 0.0115        | 86.0  | 9116  | 0.2261          | 0.7805             | 0.9275          | 0.8477      | 69              | 0.6528                 | 0.8103              | 0.7231          | 58                  | 0.8917           | 0.9211        | 0.9061    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8048            | 0.8905         | 0.8455     | 0.9634           |
| 0.0108        | 87.0  | 9222  | 0.2266          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6164                 | 0.7759              | 0.6870          | 58                  | 0.8917           | 0.9211        | 0.9061    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7968            | 0.8817         | 0.8371     | 0.9624           |
| 0.011         | 88.0  | 9328  | 0.2287          | 0.7875             | 0.9130          | 0.8456      | 69              | 0.6667                 | 0.8276              | 0.7385          | 58                  | 0.8861           | 0.9211        | 0.9032    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8070            | 0.8905         | 0.8467     | 0.9634           |
| 0.0107        | 89.0  | 9434  | 0.2303          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6351                 | 0.8103              | 0.7121          | 58                  | 0.8917           | 0.9211        | 0.9061    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8               | 0.8876         | 0.8415     | 0.9631           |
| 0.0107        | 90.0  | 9540  | 0.2355          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6216                 | 0.7931              | 0.6970          | 58                  | 0.8861           | 0.9211        | 0.9032    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7979            | 0.8876         | 0.8403     | 0.9626           |
| 0.0101        | 91.0  | 9646  | 0.2317          | 0.7778             | 0.9130          | 0.84        | 69              | 0.625                  | 0.7759              | 0.6923          | 58                  | 0.8861           | 0.9211        | 0.9032    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7968            | 0.8817         | 0.8371     | 0.9618           |
| 0.0103        | 92.0  | 9752  | 0.2331          | 0.7901             | 0.9275          | 0.8533      | 69              | 0.6301                 | 0.7931              | 0.7023          | 58                  | 0.8861           | 0.9211        | 0.9032    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8027            | 0.8905         | 0.8443     | 0.9634           |
| 0.0106        | 93.0  | 9858  | 0.2329          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6389                 | 0.7931              | 0.7077          | 58                  | 0.8917           | 0.9211        | 0.9061    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8016            | 0.8846         | 0.8411     | 0.9629           |
| 0.0098        | 94.0  | 9964  | 0.2317          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6528                 | 0.8103              | 0.7231          | 58                  | 0.8924           | 0.9276        | 0.9097    | 152           | 0.7879             | 0.8667          | 0.8254      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8075            | 0.8935         | 0.8483     | 0.9639           |
| 0.0099        | 95.0  | 10070 | 0.2371          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6389                 | 0.7931              | 0.7077          | 58                  | 0.8917           | 0.9211        | 0.9061    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8016            | 0.8846         | 0.8411     | 0.9629           |
| 0.0111        | 96.0  | 10176 | 0.2326          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6389                 | 0.7931              | 0.7077          | 58                  | 0.8861           | 0.9211        | 0.9032    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.7995            | 0.8846         | 0.8399     | 0.9629           |
| 0.0107        | 97.0  | 10282 | 0.2305          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6528                 | 0.8103              | 0.7231          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8027            | 0.8905         | 0.8443     | 0.9631           |
| 0.0089        | 98.0  | 10388 | 0.2344          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6479                 | 0.7931              | 0.7132          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8021            | 0.8876         | 0.8427     | 0.9631           |
| 0.0096        | 99.0  | 10494 | 0.2323          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6528                 | 0.8103              | 0.7231          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8027            | 0.8905         | 0.8443     | 0.9634           |
| 0.0091        | 100.0 | 10600 | 0.2329          | 0.7778             | 0.9130          | 0.84        | 69              | 0.6389                 | 0.7931              | 0.7077          | 58                  | 0.8868           | 0.9276        | 0.9068    | 152           | 0.7576             | 0.8333          | 0.7937      | 30              | 0.8333         | 0.8621      | 0.8475  | 29          | 0.8               | 0.8876         | 0.8415     | 0.9631           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2