---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-lora-r16-2
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-lora-r16-2

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1479
- Location Precision: 0.7561
- Location Recall: 0.8611
- Location F1: 0.8052
- Location Number: 72
- Organization Precision: 0.7021
- Organization Recall: 0.88
- Organization F1: 0.7811
- Organization Number: 75
- Person Precision: 0.8385
- Person Recall: 0.9441
- Person F1: 0.8882
- Person Number: 143
- Quantity Precision: 0.5455
- Quantity Recall: 0.7826
- Quantity F1: 0.6429
- Quantity Number: 23
- Time Precision: 0.7241
- Time Recall: 0.8077
- Time F1: 0.7636
- Time Number: 26
- Overall Precision: 0.7569
- Overall Recall: 0.8909
- Overall F1: 0.8184
- Overall Accuracy: 0.9590

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.1381        | 1.0   | 106   | 0.6853          | 0.0                | 0.0             | 0.0         | 72              | 0.0                    | 0.0                 | 0.0             | 75                  | 0.0              | 0.0           | 0.0       | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.0            | 0.0         | 0.0     | 26          | 0.0               | 0.0            | 0.0        | 0.8449           |
| 0.6775        | 2.0   | 212   | 0.5613          | 0.0                | 0.0             | 0.0         | 72              | 0.0                    | 0.0                 | 0.0             | 75                  | 0.0              | 0.0           | 0.0       | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.0            | 0.0         | 0.0     | 26          | 0.0               | 0.0            | 0.0        | 0.8466           |
| 0.5563        | 3.0   | 318   | 0.4266          | 0.5                | 0.1111          | 0.1818      | 72              | 0.0526                 | 0.0133              | 0.0213          | 75                  | 0.3393           | 0.2657        | 0.2980    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.2222         | 0.1538      | 0.1818  | 26          | 0.3072            | 0.1504         | 0.2020     | 0.8777           |
| 0.4194        | 4.0   | 424   | 0.3158          | 0.54               | 0.375           | 0.4426      | 72              | 0.3906                 | 0.3333              | 0.3597          | 75                  | 0.5126           | 0.7133        | 0.5965    | 143           | 0.0                | 0.0             | 0.0         | 23              | 0.5714         | 0.6154      | 0.5926  | 26          | 0.4775            | 0.5015         | 0.4892     | 0.9127           |
| 0.3199        | 5.0   | 530   | 0.2532          | 0.5682             | 0.6944          | 0.625       | 72              | 0.4471                 | 0.5067              | 0.4750          | 75                  | 0.6793           | 0.8741        | 0.7645    | 143           | 0.3214             | 0.3913          | 0.3529      | 23              | 0.7308         | 0.7308      | 0.7308  | 26          | 0.5864            | 0.7109         | 0.6427     | 0.9302           |
| 0.2663        | 6.0   | 636   | 0.2125          | 0.6207             | 0.75            | 0.6792      | 72              | 0.5158                 | 0.6533              | 0.5765          | 75                  | 0.7345           | 0.9091        | 0.8125    | 143           | 0.3214             | 0.3913          | 0.3529      | 23              | 0.6562         | 0.8077      | 0.7241  | 26          | 0.6277            | 0.7758         | 0.6939     | 0.9362           |
| 0.2335        | 7.0   | 742   | 0.1960          | 0.6941             | 0.8194          | 0.7516      | 72              | 0.5152                 | 0.68                | 0.5862          | 75                  | 0.7293           | 0.9231        | 0.8148    | 143           | 0.3871             | 0.5217          | 0.4444      | 23              | 0.6452         | 0.7692      | 0.7018  | 26          | 0.6417            | 0.8083         | 0.7154     | 0.9392           |
| 0.2093        | 8.0   | 848   | 0.1736          | 0.6932             | 0.8472          | 0.7625      | 72              | 0.5294                 | 0.72                | 0.6102          | 75                  | 0.7714           | 0.9441        | 0.8491    | 143           | 0.4286             | 0.5217          | 0.4706      | 23              | 0.6667         | 0.8462      | 0.7458  | 26          | 0.6667            | 0.8378         | 0.7425     | 0.9450           |
| 0.1945        | 9.0   | 954   | 0.1752          | 0.6848             | 0.875           | 0.7683      | 72              | 0.5340                 | 0.7333              | 0.6180          | 75                  | 0.7917           | 0.9301        | 0.8553    | 143           | 0.4194             | 0.5652          | 0.4815      | 23              | 0.6562         | 0.8077      | 0.7241  | 26          | 0.6690            | 0.8407         | 0.7451     | 0.9440           |
| 0.1804        | 10.0  | 1060  | 0.1638          | 0.7126             | 0.8611          | 0.7799      | 72              | 0.5567                 | 0.72                | 0.6279          | 75                  | 0.7765           | 0.9231        | 0.8435    | 143           | 0.4444             | 0.6957          | 0.5424      | 23              | 0.6667         | 0.8462      | 0.7458  | 26          | 0.6761            | 0.8437         | 0.7507     | 0.9457           |
| 0.1692        | 11.0  | 1166  | 0.1590          | 0.7778             | 0.875           | 0.8235      | 72              | 0.5741                 | 0.8267              | 0.6776          | 75                  | 0.7733           | 0.9301        | 0.8444    | 143           | 0.4545             | 0.6522          | 0.5357      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.6998            | 0.8732         | 0.7769     | 0.9500           |
| 0.1645        | 12.0  | 1272  | 0.1452          | 0.7595             | 0.8333          | 0.7947      | 72              | 0.5773                 | 0.7467              | 0.6512          | 75                  | 0.8              | 0.9231        | 0.8571    | 143           | 0.5161             | 0.6957          | 0.5926      | 23              | 0.8214         | 0.8846      | 0.8519  | 26          | 0.7175            | 0.8466         | 0.7767     | 0.9515           |
| 0.1572        | 13.0  | 1378  | 0.1520          | 0.7722             | 0.8472          | 0.8079      | 72              | 0.5741                 | 0.8267              | 0.6776          | 75                  | 0.7882           | 0.9371        | 0.8562    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.7419         | 0.8846      | 0.8070  | 26          | 0.7146            | 0.8791         | 0.7884     | 0.9515           |
| 0.1538        | 14.0  | 1484  | 0.1492          | 0.7763             | 0.8194          | 0.7973      | 72              | 0.5596                 | 0.8133              | 0.6630          | 75                  | 0.8110           | 0.9301        | 0.8664    | 143           | 0.6333             | 0.8261          | 0.7170      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7213            | 0.8702         | 0.7888     | 0.9510           |
| 0.1483        | 15.0  | 1590  | 0.1384          | 0.7662             | 0.8194          | 0.7919      | 72              | 0.5938                 | 0.76                | 0.6667          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.6207             | 0.7826          | 0.6923      | 23              | 0.8214         | 0.8846      | 0.8519  | 26          | 0.7398            | 0.8555         | 0.7934     | 0.9550           |
| 0.145         | 16.0  | 1696  | 0.1531          | 0.7317             | 0.8333          | 0.7792      | 72              | 0.5625                 | 0.84                | 0.6738          | 75                  | 0.8036           | 0.9441        | 0.8682    | 143           | 0.6452             | 0.8696          | 0.7407      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7092            | 0.8850         | 0.7874     | 0.9497           |
| 0.1378        | 17.0  | 1802  | 0.1462          | 0.7176             | 0.8472          | 0.7771      | 72              | 0.5701                 | 0.8133              | 0.6703          | 75                  | 0.8313           | 0.9301        | 0.8779    | 143           | 0.625              | 0.8696          | 0.7273      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7215            | 0.8791         | 0.7926     | 0.9515           |
| 0.137         | 18.0  | 1908  | 0.1437          | 0.7294             | 0.8611          | 0.7898      | 72              | 0.5455                 | 0.8                 | 0.6486          | 75                  | 0.8418           | 0.9301        | 0.8837    | 143           | 0.6452             | 0.8696          | 0.7407      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7215            | 0.8791         | 0.7926     | 0.9522           |
| 0.1316        | 19.0  | 2014  | 0.1372          | 0.7317             | 0.8333          | 0.7792      | 72              | 0.6040                 | 0.8133              | 0.6932          | 75                  | 0.8199           | 0.9231        | 0.8684    | 143           | 0.6452             | 0.8696          | 0.7407      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7302            | 0.8702         | 0.7941     | 0.9542           |
| 0.1274        | 20.0  | 2120  | 0.1510          | 0.7159             | 0.875           | 0.7875      | 72              | 0.5818                 | 0.8533              | 0.6919          | 75                  | 0.8210           | 0.9301        | 0.8721    | 143           | 0.625              | 0.8696          | 0.7273      | 23              | 0.6875         | 0.8462      | 0.7586  | 26          | 0.7123            | 0.8909         | 0.7916     | 0.9502           |
| 0.1279        | 21.0  | 2226  | 0.1444          | 0.7294             | 0.8611          | 0.7898      | 72              | 0.6095                 | 0.8533              | 0.7111          | 75                  | 0.8133           | 0.9441        | 0.8738    | 143           | 0.6452             | 0.8696          | 0.7407      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7308            | 0.8968         | 0.8053     | 0.9532           |
| 0.1256        | 22.0  | 2332  | 0.1347          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6238                 | 0.84                | 0.7159          | 75                  | 0.8333           | 0.9441        | 0.8852    | 143           | 0.6061             | 0.8696          | 0.7143      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7445            | 0.8938         | 0.8123     | 0.9567           |
| 0.123         | 23.0  | 2438  | 0.1353          | 0.7468             | 0.8194          | 0.7815      | 72              | 0.625                  | 0.8667              | 0.7263          | 75                  | 0.8242           | 0.9510        | 0.8831    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7341            | 0.8879         | 0.8037     | 0.9557           |
| 0.1219        | 24.0  | 2544  | 0.1473          | 0.6889             | 0.8611          | 0.7654      | 72              | 0.5981                 | 0.8533              | 0.7033          | 75                  | 0.8232           | 0.9441        | 0.8795    | 143           | 0.5882             | 0.8696          | 0.7018      | 23              | 0.6875         | 0.8462      | 0.7586  | 26          | 0.7096            | 0.8938         | 0.7911     | 0.9520           |
| 0.1193        | 25.0  | 2650  | 0.1401          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6465                 | 0.8533              | 0.7356          | 75                  | 0.8303           | 0.9580        | 0.8896    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7433            | 0.8968         | 0.8128     | 0.9567           |
| 0.1168        | 26.0  | 2756  | 0.1358          | 0.7381             | 0.8611          | 0.7949      | 72              | 0.6238                 | 0.84                | 0.7159          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7389            | 0.8850         | 0.8054     | 0.9557           |
| 0.1132        | 27.0  | 2862  | 0.1407          | 0.6932             | 0.8472          | 0.7625      | 72              | 0.6517                 | 0.7733              | 0.7073          | 75                  | 0.8333           | 0.9441        | 0.8852    | 143           | 0.5758             | 0.8261          | 0.6786      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7357            | 0.8702         | 0.7973     | 0.9547           |
| 0.115         | 28.0  | 2968  | 0.1366          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6275                 | 0.8533              | 0.7232          | 75                  | 0.8323           | 0.9371        | 0.8816    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7414            | 0.8879         | 0.8081     | 0.9567           |
| 0.112         | 29.0  | 3074  | 0.1384          | 0.7470             | 0.8611          | 0.8         | 72              | 0.6436                 | 0.8667              | 0.7386          | 75                  | 0.8553           | 0.9510        | 0.9007    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7525            | 0.8968         | 0.8183     | 0.9560           |
| 0.1112        | 30.0  | 3180  | 0.1362          | 0.6966             | 0.8611          | 0.7702      | 72              | 0.6311                 | 0.8667              | 0.7303          | 75                  | 0.8447           | 0.9510        | 0.8947    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7319            | 0.8938         | 0.8048     | 0.9557           |
| 0.1093        | 31.0  | 3286  | 0.1323          | 0.7262             | 0.8472          | 0.7821      | 72              | 0.6702                 | 0.84                | 0.7456          | 75                  | 0.8447           | 0.9510        | 0.8947    | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.755             | 0.8909         | 0.8173     | 0.9577           |
| 0.1075        | 32.0  | 3392  | 0.1293          | 0.775              | 0.8611          | 0.8158      | 72              | 0.6739                 | 0.8267              | 0.7425          | 75                  | 0.8599           | 0.9441        | 0.9       | 143           | 0.5938             | 0.8261          | 0.6909      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7718            | 0.8879         | 0.8258     | 0.9597           |
| 0.1046        | 33.0  | 3498  | 0.1313          | 0.7176             | 0.8472          | 0.7771      | 72              | 0.6598                 | 0.8533              | 0.7442          | 75                  | 0.8831           | 0.9510        | 0.9158    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7588            | 0.8909         | 0.8195     | 0.9595           |
| 0.1017        | 34.0  | 3604  | 0.1427          | 0.7209             | 0.8611          | 0.7848      | 72              | 0.64                   | 0.8533              | 0.7314          | 75                  | 0.8282           | 0.9441        | 0.8824    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.6875         | 0.8462      | 0.7586  | 26          | 0.7271            | 0.8879         | 0.7995     | 0.9547           |
| 0.1071        | 35.0  | 3710  | 0.1403          | 0.7126             | 0.8611          | 0.7799      | 72              | 0.6275                 | 0.8533              | 0.7232          | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7426            | 0.8938         | 0.8112     | 0.9562           |
| 0.1026        | 36.0  | 3816  | 0.1297          | 0.7262             | 0.8472          | 0.7821      | 72              | 0.6897                 | 0.8                 | 0.7407          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7602            | 0.8791         | 0.8153     | 0.9590           |
| 0.1005        | 37.0  | 3922  | 0.1433          | 0.7209             | 0.8611          | 0.7848      | 72              | 0.6569                 | 0.8933              | 0.7571          | 75                  | 0.8405           | 0.9580        | 0.8954    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7391            | 0.9027         | 0.8127     | 0.9550           |
| 0.0981        | 38.0  | 4028  | 0.1404          | 0.775              | 0.8611          | 0.8158      | 72              | 0.6436                 | 0.8667              | 0.7386          | 75                  | 0.8415           | 0.9650        | 0.8990    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.75              | 0.9027         | 0.8193     | 0.9572           |
| 0.0982        | 39.0  | 4134  | 0.1409          | 0.7654             | 0.8611          | 0.8105      | 72              | 0.6837                 | 0.8933              | 0.7746          | 75                  | 0.8344           | 0.9510        | 0.8889    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7667         | 0.8846      | 0.8214  | 26          | 0.7556            | 0.9027         | 0.8226     | 0.9580           |
| 0.0986        | 40.0  | 4240  | 0.1324          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8293           | 0.9510        | 0.8860    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.7594            | 0.8938         | 0.8211     | 0.9587           |
| 0.0963        | 41.0  | 4346  | 0.1360          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6804                 | 0.88                | 0.7674          | 75                  | 0.8344           | 0.9510        | 0.8889    | 143           | 0.5862             | 0.7391          | 0.6538      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.76              | 0.8968         | 0.8227     | 0.9577           |
| 0.096         | 42.0  | 4452  | 0.1379          | 0.7470             | 0.8611          | 0.8         | 72              | 0.6875                 | 0.88                | 0.7719          | 75                  | 0.8457           | 0.9580        | 0.8984    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7419         | 0.8846      | 0.8070  | 26          | 0.7574            | 0.9027         | 0.8237     | 0.9585           |
| 0.0944        | 43.0  | 4558  | 0.1291          | 0.7625             | 0.8472          | 0.8026      | 72              | 0.7333                 | 0.88                | 0.8             | 75                  | 0.8662           | 0.9510        | 0.9067    | 143           | 0.5862             | 0.7391          | 0.6538      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7844            | 0.8909         | 0.8343     | 0.9617           |
| 0.0959        | 44.0  | 4664  | 0.1381          | 0.7590             | 0.875           | 0.8129      | 72              | 0.7053                 | 0.8933              | 0.7882          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7619            | 0.8968         | 0.8238     | 0.9570           |
| 0.0935        | 45.0  | 4770  | 0.1383          | 0.7778             | 0.875           | 0.8235      | 72              | 0.6842                 | 0.8667              | 0.7647          | 75                  | 0.8571           | 0.9650        | 0.9079    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7638            | 0.8968         | 0.8250     | 0.9585           |
| 0.0903        | 46.0  | 4876  | 0.1356          | 0.7470             | 0.8611          | 0.8         | 72              | 0.6633                 | 0.8667              | 0.7514          | 75                  | 0.8562           | 0.9580        | 0.9043    | 143           | 0.5667             | 0.7391          | 0.6415      | 23              | 0.7931         | 0.8846      | 0.8364  | 26          | 0.76              | 0.8968         | 0.8227     | 0.9582           |
| 0.0933        | 47.0  | 4982  | 0.1516          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6869                 | 0.9067              | 0.7816          | 75                  | 0.8466           | 0.9650        | 0.9020    | 143           | 0.5                | 0.7391          | 0.5965      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7488            | 0.8968         | 0.8161     | 0.9552           |
| 0.093         | 48.0  | 5088  | 0.1348          | 0.7470             | 0.8611          | 0.8         | 72              | 0.6842                 | 0.8667              | 0.7647          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7563            | 0.8879         | 0.8168     | 0.9580           |
| 0.0906        | 49.0  | 5194  | 0.1454          | 0.7470             | 0.8611          | 0.8         | 72              | 0.6602                 | 0.9067              | 0.7640          | 75                  | 0.8562           | 0.9580        | 0.9043    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7537            | 0.9027         | 0.8215     | 0.9570           |
| 0.0894        | 50.0  | 5300  | 0.1340          | 0.7625             | 0.8472          | 0.8026      | 72              | 0.7159                 | 0.84                | 0.7730          | 75                  | 0.8395           | 0.9510        | 0.8918    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.8214         | 0.8846      | 0.8519  | 26          | 0.7738            | 0.8879         | 0.8269     | 0.9610           |
| 0.0882        | 51.0  | 5406  | 0.1365          | 0.7654             | 0.8611          | 0.8105      | 72              | 0.6771                 | 0.8667              | 0.7602          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.5667             | 0.7391          | 0.6415      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7632            | 0.8938         | 0.8234     | 0.9595           |
| 0.0886        | 52.0  | 5512  | 0.1407          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6768                 | 0.8933              | 0.7701          | 75                  | 0.8519           | 0.9650        | 0.9049    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7568            | 0.8997         | 0.8221     | 0.9587           |
| 0.086         | 53.0  | 5618  | 0.1391          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6907                 | 0.8933              | 0.7791          | 75                  | 0.8447           | 0.9510        | 0.8947    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7333         | 0.8462      | 0.7857  | 26          | 0.7606            | 0.8997         | 0.8243     | 0.9592           |
| 0.0872        | 54.0  | 5724  | 0.1392          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8608           | 0.9510        | 0.9037    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7671            | 0.8938         | 0.8256     | 0.9590           |
| 0.0897        | 55.0  | 5830  | 0.1569          | 0.7381             | 0.8611          | 0.7949      | 72              | 0.6602                 | 0.9067              | 0.7640          | 75                  | 0.8571           | 0.9650        | 0.9079    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7421            | 0.8997         | 0.8133     | 0.9535           |
| 0.0881        | 56.0  | 5936  | 0.1365          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.7143                 | 0.8667              | 0.7831          | 75                  | 0.8553           | 0.9510        | 0.9007    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7653            | 0.8850         | 0.8208     | 0.9597           |
| 0.0857        | 57.0  | 6042  | 0.1363          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7333                 | 0.88                | 0.8             | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7724            | 0.8909         | 0.8274     | 0.9612           |
| 0.0846        | 58.0  | 6148  | 0.1401          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.6979                 | 0.8933              | 0.7836          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5484             | 0.7391          | 0.6296      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7632            | 0.8938         | 0.8234     | 0.9595           |
| 0.0843        | 59.0  | 6254  | 0.1426          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.7128                 | 0.8933              | 0.7929          | 75                  | 0.8571           | 0.9650        | 0.9079    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7619            | 0.8968         | 0.8238     | 0.9595           |
| 0.087         | 60.0  | 6360  | 0.1385          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6989                 | 0.8667              | 0.7738          | 75                  | 0.8553           | 0.9510        | 0.9007    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7857         | 0.8462      | 0.8148  | 26          | 0.7665            | 0.8909         | 0.8240     | 0.9595           |
| 0.0836        | 61.0  | 6466  | 0.1407          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6837                 | 0.8933              | 0.7746          | 75                  | 0.8625           | 0.9650        | 0.9109    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7631            | 0.9027         | 0.8270     | 0.9602           |
| 0.0823        | 62.0  | 6572  | 0.1372          | 0.7625             | 0.8472          | 0.8026      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5667             | 0.7391          | 0.6415      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7692            | 0.8850         | 0.8230     | 0.9602           |
| 0.0814        | 63.0  | 6678  | 0.1416          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6804                 | 0.88                | 0.7674          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.6897         | 0.7692      | 0.7273  | 26          | 0.7525            | 0.8879         | 0.8146     | 0.9580           |
| 0.0806        | 64.0  | 6784  | 0.1517          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6442                 | 0.8933              | 0.7486          | 75                  | 0.8571           | 0.9650        | 0.9079    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7457            | 0.8997         | 0.8155     | 0.9565           |
| 0.0794        | 65.0  | 6890  | 0.1416          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7065                 | 0.8667              | 0.7784          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7620            | 0.8879         | 0.8202     | 0.9590           |
| 0.079         | 66.0  | 6996  | 0.1457          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6939                 | 0.9067              | 0.7861          | 75                  | 0.8571           | 0.9650        | 0.9079    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7637            | 0.9056         | 0.8286     | 0.9592           |
| 0.0811        | 67.0  | 7102  | 0.1385          | 0.7654             | 0.8611          | 0.8105      | 72              | 0.6989                 | 0.8667              | 0.7738          | 75                  | 0.8553           | 0.9510        | 0.9007    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7690            | 0.8938         | 0.8267     | 0.9605           |
| 0.0792        | 68.0  | 7208  | 0.1480          | 0.7349             | 0.8472          | 0.7871      | 72              | 0.6569                 | 0.8933              | 0.7571          | 75                  | 0.8616           | 0.9580        | 0.9073    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7481            | 0.8938         | 0.8145     | 0.9572           |
| 0.0795        | 69.0  | 7314  | 0.1455          | 0.7470             | 0.8611          | 0.8         | 72              | 0.6768                 | 0.8933              | 0.7701          | 75                  | 0.8395           | 0.9510        | 0.8918    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7531            | 0.8997         | 0.8199     | 0.9585           |
| 0.0805        | 70.0  | 7420  | 0.1422          | 0.7654             | 0.8611          | 0.8105      | 72              | 0.6989                 | 0.8667              | 0.7738          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7677            | 0.8968         | 0.8272     | 0.9600           |
| 0.0809        | 71.0  | 7526  | 0.1447          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7053                 | 0.8933              | 0.7882          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7644            | 0.8997         | 0.8266     | 0.9595           |
| 0.0787        | 72.0  | 7632  | 0.1448          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.7204                 | 0.8933              | 0.7976          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7632            | 0.8938         | 0.8234     | 0.9597           |
| 0.0792        | 73.0  | 7738  | 0.1406          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6923                 | 0.84                | 0.7590          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.6                | 0.7826          | 0.6792      | 23              | 0.7586         | 0.8462      | 0.8     | 26          | 0.7659            | 0.8879         | 0.8224     | 0.9602           |
| 0.078         | 74.0  | 7844  | 0.1471          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.7097                 | 0.88                | 0.7857          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7582            | 0.8879         | 0.8179     | 0.9582           |
| 0.0773        | 75.0  | 7950  | 0.1460          | 0.7439             | 0.8472          | 0.7922      | 72              | 0.6979                 | 0.8933              | 0.7836          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.76              | 0.8968         | 0.8227     | 0.9590           |
| 0.0772        | 76.0  | 8056  | 0.1484          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6979                 | 0.8933              | 0.7836          | 75                  | 0.8562           | 0.9580        | 0.9043    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7644            | 0.8997         | 0.8266     | 0.9585           |
| 0.0767        | 77.0  | 8162  | 0.1515          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6907                 | 0.8933              | 0.7791          | 75                  | 0.8616           | 0.9580        | 0.9073    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.76              | 0.8968         | 0.8227     | 0.9575           |
| 0.0757        | 78.0  | 8268  | 0.1435          | 0.7875             | 0.875           | 0.8289      | 72              | 0.7079                 | 0.84                | 0.7683          | 75                  | 0.8544           | 0.9441        | 0.8970    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7732            | 0.8850         | 0.8253     | 0.9590           |
| 0.0767        | 79.0  | 8374  | 0.1456          | 0.7654             | 0.8611          | 0.8105      | 72              | 0.7174                 | 0.88                | 0.7904          | 75                  | 0.8562           | 0.9580        | 0.9043    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7690            | 0.8938         | 0.8267     | 0.9602           |
| 0.0752        | 80.0  | 8480  | 0.1556          | 0.7778             | 0.875           | 0.8235      | 72              | 0.6569                 | 0.8933              | 0.7571          | 75                  | 0.8562           | 0.9580        | 0.9043    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.7488            | 0.8968         | 0.8161     | 0.9555           |
| 0.078         | 81.0  | 8586  | 0.1439          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7            | 0.8077      | 0.75    | 26          | 0.7619            | 0.8968         | 0.8238     | 0.9600           |
| 0.0733        | 82.0  | 8692  | 0.1478          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7053                 | 0.8933              | 0.7882          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.6667         | 0.7692      | 0.7143  | 26          | 0.755             | 0.8909         | 0.8173     | 0.9587           |
| 0.0747        | 83.0  | 8798  | 0.1448          | 0.7531             | 0.8472          | 0.7974      | 72              | 0.7143                 | 0.8667              | 0.7831          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7659            | 0.8879         | 0.8224     | 0.9600           |
| 0.0755        | 84.0  | 8904  | 0.1465          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7128                 | 0.8933              | 0.7929          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7632            | 0.8938         | 0.8234     | 0.9597           |
| 0.0757        | 85.0  | 9010  | 0.1434          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7079                 | 0.84                | 0.7683          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7608            | 0.8820         | 0.8169     | 0.9592           |
| 0.076         | 86.0  | 9116  | 0.1468          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5312             | 0.7391          | 0.6182      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7614            | 0.8850         | 0.8186     | 0.9587           |
| 0.0721        | 87.0  | 9222  | 0.1454          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7033                 | 0.8533              | 0.7711          | 75                  | 0.8447           | 0.9510        | 0.8947    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.75           | 0.8077      | 0.7778  | 26          | 0.7640            | 0.8879         | 0.8213     | 0.9592           |
| 0.0724        | 88.0  | 9328  | 0.1470          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7065                 | 0.8667              | 0.7784          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5806             | 0.7826          | 0.6667      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7665            | 0.8909         | 0.8240     | 0.9595           |
| 0.074         | 89.0  | 9434  | 0.1489          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6989                 | 0.8667              | 0.7738          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5625             | 0.7826          | 0.6545      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7626            | 0.8909         | 0.8218     | 0.9590           |
| 0.0721        | 90.0  | 9540  | 0.1496          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.85             | 0.9510        | 0.8977    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7588            | 0.8909         | 0.8195     | 0.9587           |
| 0.0766        | 91.0  | 9646  | 0.1454          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6957                 | 0.8533              | 0.7665          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7531            | 0.8820         | 0.8125     | 0.9587           |
| 0.075         | 92.0  | 9752  | 0.1483          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8447           | 0.9510        | 0.8947    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7569            | 0.8909         | 0.8184     | 0.9587           |
| 0.0713        | 93.0  | 9858  | 0.1479          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8438           | 0.9441        | 0.8911    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7563            | 0.8879         | 0.8168     | 0.9587           |
| 0.0727        | 94.0  | 9964  | 0.1480          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8509           | 0.9580        | 0.9013    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7594            | 0.8938         | 0.8211     | 0.9590           |
| 0.0726        | 95.0  | 10070 | 0.1487          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7097                 | 0.88                | 0.7857          | 75                  | 0.8447           | 0.9510        | 0.8947    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7588            | 0.8909         | 0.8195     | 0.9587           |
| 0.0733        | 96.0  | 10176 | 0.1490          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8375           | 0.9371        | 0.8845    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7538            | 0.8850         | 0.8141     | 0.9580           |
| 0.0721        | 97.0  | 10282 | 0.1473          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.6915                 | 0.8667              | 0.7692          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7544            | 0.8879         | 0.8157     | 0.9585           |
| 0.0722        | 98.0  | 10388 | 0.1479          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7569            | 0.8909         | 0.8184     | 0.9590           |
| 0.0729        | 99.0  | 10494 | 0.1479          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5152             | 0.7391          | 0.6071      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7544            | 0.8879         | 0.8157     | 0.9587           |
| 0.0718        | 100.0 | 10600 | 0.1479          | 0.7561             | 0.8611          | 0.8052      | 72              | 0.7021                 | 0.88                | 0.7811          | 75                  | 0.8385           | 0.9441        | 0.8882    | 143           | 0.5455             | 0.7826          | 0.6429      | 23              | 0.7241         | 0.8077      | 0.7636  | 26          | 0.7569            | 0.8909         | 0.8184     | 0.9590           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2