---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerugm-seq_bn-rf64-1
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerugm-seq_bn-rf64-1

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.1294
- Location Precision: 0.7595
- Location Recall: 0.8696
- Location F1: 0.8108
- Location Number: 69
- Organization Precision: 0.6533
- Organization Recall: 0.8033
- Organization F1: 0.7206
- Organization Number: 61
- Person Precision: 0.8650
- Person Recall: 0.9216
- Person F1: 0.8924
- Person Number: 153
- Quantity Precision: 0.6944
- Quantity Recall: 0.7812
- Quantity F1: 0.7353
- Quantity Number: 32
- Time Precision: 0.7647
- Time Recall: 0.8387
- Time F1: 0.8000
- Time Number: 31
- Overall Precision: 0.7778
- Overall Recall: 0.8699
- Overall F1: 0.8213
- Overall Accuracy: 0.9628

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step  | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 1.1444        | 1.0   | 106   | 0.6990          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 61                  | 0.0              | 0.0           | 0.0       | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.0            | 0.0         | 0.0     | 31          | 0.0               | 0.0            | 0.0        | 0.8353           |
| 0.663         | 2.0   | 212   | 0.5583          | 0.0                | 0.0             | 0.0         | 69              | 0.0                    | 0.0                 | 0.0             | 61                  | 0.3333           | 0.0327        | 0.0595    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.0            | 0.0         | 0.0     | 31          | 0.2381            | 0.0145         | 0.0272     | 0.8385           |
| 0.5434        | 3.0   | 318   | 0.4403          | 0.375              | 0.0435          | 0.0779      | 69              | 0.0455                 | 0.0164              | 0.0241          | 61                  | 0.4031           | 0.3399        | 0.3688    | 153           | 0.0                | 0.0             | 0.0         | 32              | 0.5455         | 0.3871      | 0.4528  | 31          | 0.3696            | 0.1965         | 0.2566     | 0.8747           |
| 0.4445        | 4.0   | 424   | 0.3639          | 0.5349             | 0.3333          | 0.4107      | 69              | 0.25                   | 0.1639              | 0.1980          | 61                  | 0.4688           | 0.5882        | 0.5217    | 153           | 0.0625             | 0.0312          | 0.0417      | 32              | 0.5758         | 0.6129      | 0.5938  | 31          | 0.4414            | 0.4133         | 0.4269     | 0.9004           |
| 0.3757        | 5.0   | 530   | 0.3190          | 0.5417             | 0.5652          | 0.5532      | 69              | 0.2586                 | 0.2459              | 0.2521          | 61                  | 0.5311           | 0.7255        | 0.6133    | 153           | 0.4516             | 0.4375          | 0.4444      | 32              | 0.5833         | 0.6774      | 0.6269  | 31          | 0.4926            | 0.5780         | 0.5319     | 0.9160           |
| 0.3296        | 6.0   | 636   | 0.2728          | 0.5375             | 0.6232          | 0.5772      | 69              | 0.5094                 | 0.4426              | 0.4737          | 61                  | 0.58             | 0.7582        | 0.6572    | 153           | 0.4706             | 0.5             | 0.4848      | 32              | 0.75           | 0.7742      | 0.7619  | 31          | 0.5664            | 0.6532         | 0.6067     | 0.9284           |
| 0.2902        | 7.0   | 742   | 0.2488          | 0.5747             | 0.7246          | 0.6410      | 69              | 0.4429                 | 0.5082              | 0.4733          | 61                  | 0.6649           | 0.8431        | 0.7435    | 153           | 0.5122             | 0.6562          | 0.5753      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.6047            | 0.7428         | 0.6667     | 0.9341           |
| 0.2557        | 8.0   | 848   | 0.2189          | 0.5862             | 0.7391          | 0.6538      | 69              | 0.4615                 | 0.5902              | 0.5180          | 61                  | 0.6882           | 0.8366        | 0.7552    | 153           | 0.5128             | 0.625           | 0.5634      | 32              | 0.8667         | 0.8387      | 0.8525  | 31          | 0.6214            | 0.7543         | 0.6815     | 0.9393           |
| 0.2295        | 9.0   | 954   | 0.1959          | 0.6235             | 0.7681          | 0.6883      | 69              | 0.5211                 | 0.6066              | 0.5606          | 61                  | 0.7443           | 0.8562        | 0.7964    | 153           | 0.525              | 0.6562          | 0.5833      | 32              | 0.8387         | 0.8387      | 0.8387  | 31          | 0.6650            | 0.7746         | 0.7156     | 0.9438           |
| 0.2073        | 10.0  | 1060  | 0.1798          | 0.6163             | 0.7681          | 0.6839      | 69              | 0.5373                 | 0.5902              | 0.5625          | 61                  | 0.7719           | 0.8627        | 0.8148    | 153           | 0.5122             | 0.6562          | 0.5753      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.6759            | 0.7775         | 0.7231     | 0.9453           |
| 0.1909        | 11.0  | 1166  | 0.1723          | 0.6353             | 0.7826          | 0.7013      | 69              | 0.5278                 | 0.6230              | 0.5714          | 61                  | 0.7674           | 0.8627        | 0.8123    | 153           | 0.4884             | 0.6562          | 0.5600      | 32              | 0.8182         | 0.8710      | 0.8438  | 31          | 0.6716            | 0.7861         | 0.7244     | 0.9470           |
| 0.1803        | 12.0  | 1272  | 0.1605          | 0.6707             | 0.7971          | 0.7285      | 69              | 0.5205                 | 0.6230              | 0.5672          | 61                  | 0.7661           | 0.8562        | 0.8086    | 153           | 0.5366             | 0.6875          | 0.6027      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.6842            | 0.7890         | 0.7329     | 0.9507           |
| 0.172         | 13.0  | 1378  | 0.1547          | 0.6786             | 0.8261          | 0.7451      | 69              | 0.5                    | 0.6393              | 0.5612          | 61                  | 0.7857           | 0.8627        | 0.8224    | 153           | 0.525              | 0.6562          | 0.5833      | 32              | 0.8438         | 0.8710      | 0.8571  | 31          | 0.6866            | 0.7977         | 0.7380     | 0.9522           |
| 0.1628        | 14.0  | 1484  | 0.1574          | 0.6867             | 0.8261          | 0.75        | 69              | 0.5062                 | 0.6721              | 0.5775          | 61                  | 0.7857           | 0.8627        | 0.8224    | 153           | 0.5122             | 0.6562          | 0.5753      | 32              | 0.8            | 0.9032      | 0.8485  | 31          | 0.6838            | 0.8064         | 0.7401     | 0.9497           |
| 0.1563        | 15.0  | 1590  | 0.1469          | 0.6867             | 0.8261          | 0.75        | 69              | 0.5325                 | 0.6721              | 0.5942          | 61                  | 0.7892           | 0.8562        | 0.8213    | 153           | 0.525              | 0.6562          | 0.5833      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.6967            | 0.8035         | 0.7463     | 0.9534           |
| 0.1517        | 16.0  | 1696  | 0.1440          | 0.6951             | 0.8261          | 0.7550      | 69              | 0.5526                 | 0.6885              | 0.6131          | 61                  | 0.8012           | 0.8693        | 0.8339    | 153           | 0.5897             | 0.7188          | 0.6479      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7128            | 0.8179         | 0.7618     | 0.9547           |
| 0.1453        | 17.0  | 1802  | 0.1530          | 0.6591             | 0.8406          | 0.7389      | 69              | 0.5432                 | 0.7213              | 0.6197          | 61                  | 0.7964           | 0.8693        | 0.8313    | 153           | 0.5854             | 0.75            | 0.6575      | 32              | 0.75           | 0.8710      | 0.8060  | 31          | 0.6925            | 0.8266         | 0.7536     | 0.9507           |
| 0.1429        | 18.0  | 1908  | 0.1450          | 0.6905             | 0.8406          | 0.7582      | 69              | 0.5395                 | 0.6721              | 0.5985          | 61                  | 0.8110           | 0.8693        | 0.8391    | 153           | 0.5952             | 0.7812          | 0.6757      | 32              | 0.7714         | 0.8710      | 0.8182  | 31          | 0.7082            | 0.8208         | 0.7604     | 0.9532           |
| 0.1403        | 19.0  | 2014  | 0.1397          | 0.6988             | 0.8406          | 0.7632      | 69              | 0.56                   | 0.6885              | 0.6176          | 61                  | 0.8012           | 0.8693        | 0.8339    | 153           | 0.6154             | 0.75            | 0.6761      | 32              | 0.8235         | 0.9032      | 0.8615  | 31          | 0.7179            | 0.8237         | 0.7672     | 0.9559           |
| 0.1339        | 20.0  | 2120  | 0.1472          | 0.6628             | 0.8261          | 0.7355      | 69              | 0.5513                 | 0.7049              | 0.6187          | 61                  | 0.7917           | 0.8693        | 0.8287    | 153           | 0.5854             | 0.75            | 0.6575      | 32              | 0.7297         | 0.8710      | 0.7941  | 31          | 0.6927            | 0.8208         | 0.7513     | 0.9519           |
| 0.134         | 21.0  | 2226  | 0.1470          | 0.6628             | 0.8261          | 0.7355      | 69              | 0.5349                 | 0.7541              | 0.6259          | 61                  | 0.7907           | 0.8889        | 0.8369    | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.7714         | 0.8710      | 0.8182  | 31          | 0.6945            | 0.8410         | 0.7608     | 0.9502           |
| 0.131         | 22.0  | 2332  | 0.1419          | 0.6988             | 0.8406          | 0.7632      | 69              | 0.55                   | 0.7213              | 0.6241          | 61                  | 0.7941           | 0.8824        | 0.8359    | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.6923         | 0.8710      | 0.7714  | 31          | 0.7015            | 0.8353         | 0.7625     | 0.9532           |
| 0.1292        | 23.0  | 2438  | 0.1338          | 0.725              | 0.8406          | 0.7785      | 69              | 0.5658                 | 0.7049              | 0.6277          | 61                  | 0.8047           | 0.8889        | 0.8447    | 153           | 0.6410             | 0.7812          | 0.7042      | 32              | 0.7714         | 0.8710      | 0.8182  | 31          | 0.7243            | 0.8353         | 0.7758     | 0.9584           |
| 0.1245        | 24.0  | 2544  | 0.1478          | 0.6591             | 0.8406          | 0.7389      | 69              | 0.5488                 | 0.7377              | 0.6294          | 61                  | 0.8166           | 0.9020        | 0.8571    | 153           | 0.5952             | 0.7812          | 0.6757      | 32              | 0.6667         | 0.8387      | 0.7429  | 31          | 0.6952            | 0.8439         | 0.7624     | 0.9519           |
| 0.1239        | 25.0  | 2650  | 0.1390          | 0.7195             | 0.8551          | 0.7815      | 69              | 0.5556                 | 0.7377              | 0.6338          | 61                  | 0.8155           | 0.8954        | 0.8536    | 153           | 0.6098             | 0.7812          | 0.6849      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.7139            | 0.8439         | 0.7735     | 0.9554           |
| 0.1241        | 26.0  | 2756  | 0.1395          | 0.6988             | 0.8406          | 0.7632      | 69              | 0.5610                 | 0.7541              | 0.6434          | 61                  | 0.8225           | 0.9085        | 0.8634    | 153           | 0.5814             | 0.7812          | 0.6667      | 32              | 0.6842         | 0.8387      | 0.7536  | 31          | 0.7084            | 0.8497         | 0.7727     | 0.9542           |
| 0.1236        | 27.0  | 2862  | 0.1355          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.5753                 | 0.6885              | 0.6269          | 61                  | 0.8263           | 0.9020        | 0.8625    | 153           | 0.5952             | 0.7812          | 0.6757      | 32              | 0.6667         | 0.8387      | 0.7429  | 31          | 0.7239            | 0.8410         | 0.7781     | 0.9564           |
| 0.1189        | 28.0  | 2968  | 0.1319          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5541                 | 0.6721              | 0.6074          | 61                  | 0.8225           | 0.9085        | 0.8634    | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.6842         | 0.8387      | 0.7536  | 31          | 0.7214            | 0.8382         | 0.7754     | 0.9579           |
| 0.1163        | 29.0  | 3074  | 0.1303          | 0.75               | 0.8696          | 0.8054      | 69              | 0.5634                 | 0.6557              | 0.6061          | 61                  | 0.8214           | 0.9020        | 0.8598    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.8485         | 0.9032      | 0.875   | 31          | 0.7455            | 0.8382         | 0.7891     | 0.9604           |
| 0.1151        | 30.0  | 3180  | 0.1333          | 0.7037             | 0.8261          | 0.76        | 69              | 0.5974                 | 0.7541              | 0.6667          | 61                  | 0.8263           | 0.9020        | 0.8625    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7312            | 0.8410         | 0.7823     | 0.9586           |
| 0.1159        | 31.0  | 3286  | 0.1321          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5694                 | 0.6721              | 0.6165          | 61                  | 0.8333           | 0.9150        | 0.8723    | 153           | 0.6410             | 0.7812          | 0.7042      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7367            | 0.8410         | 0.7854     | 0.9586           |
| 0.1104        | 32.0  | 3392  | 0.1301          | 0.725              | 0.8406          | 0.7785      | 69              | 0.6133                 | 0.7541              | 0.6765          | 61                  | 0.8323           | 0.9085        | 0.8688    | 153           | 0.6486             | 0.75            | 0.6957      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7437            | 0.8468         | 0.7919     | 0.9606           |
| 0.1111        | 33.0  | 3498  | 0.1324          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5867                 | 0.7213              | 0.6471          | 61                  | 0.8333           | 0.9150        | 0.8723    | 153           | 0.6410             | 0.7812          | 0.7042      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.735             | 0.8497         | 0.7882     | 0.9594           |
| 0.1103        | 34.0  | 3604  | 0.1343          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.5949                 | 0.7705              | 0.6714          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.6842         | 0.8387      | 0.7536  | 31          | 0.7333            | 0.8584         | 0.7909     | 0.9576           |
| 0.11          | 35.0  | 3710  | 0.1313          | 0.7284             | 0.8551          | 0.7867      | 69              | 0.6081                 | 0.7377              | 0.6667          | 61                  | 0.8476           | 0.9085        | 0.8770    | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7462            | 0.8497         | 0.7946     | 0.9596           |
| 0.1097        | 36.0  | 3816  | 0.1294          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.5915                 | 0.6885              | 0.6364          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.7027         | 0.8387      | 0.7647  | 31          | 0.7399            | 0.8468         | 0.7898     | 0.9591           |
| 0.1053        | 37.0  | 3922  | 0.1332          | 0.7375             | 0.8551          | 0.7919      | 69              | 0.6316                 | 0.7869              | 0.7007          | 61                  | 0.8333           | 0.9150        | 0.8723    | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.745             | 0.8613         | 0.7989     | 0.9594           |
| 0.1052        | 38.0  | 4028  | 0.1298          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6575                 | 0.7869              | 0.7164          | 61                  | 0.8333           | 0.9150        | 0.8723    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7628            | 0.8642         | 0.8103     | 0.9619           |
| 0.1005        | 39.0  | 4134  | 0.1264          | 0.7792             | 0.8696          | 0.8219      | 69              | 0.6429                 | 0.7377              | 0.6870          | 61                  | 0.8434           | 0.9150        | 0.8777    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7668            | 0.8555         | 0.8087     | 0.9616           |
| 0.103         | 40.0  | 4240  | 0.1295          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6528                 | 0.7705              | 0.7068          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7563            | 0.8613         | 0.8054     | 0.9611           |
| 0.1024        | 41.0  | 4346  | 0.1294          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6351                 | 0.7705              | 0.6963          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7583            | 0.8613         | 0.8065     | 0.9611           |
| 0.1009        | 42.0  | 4452  | 0.1317          | 0.7468             | 0.8551          | 0.7973      | 69              | 0.6351                 | 0.7705              | 0.6963          | 61                  | 0.8393           | 0.9216        | 0.8785    | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7544            | 0.8613         | 0.8043     | 0.9614           |
| 0.1019        | 43.0  | 4558  | 0.1347          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6316                 | 0.7869              | 0.7007          | 61                  | 0.8393           | 0.9216        | 0.8785    | 153           | 0.625              | 0.7812          | 0.6944      | 32              | 0.6842         | 0.8387      | 0.7536  | 31          | 0.7481            | 0.8671         | 0.8032     | 0.9599           |
| 0.0998        | 44.0  | 4664  | 0.1255          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6438                 | 0.7705              | 0.7015          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7706            | 0.8642         | 0.8147     | 0.9628           |
| 0.099         | 45.0  | 4770  | 0.1310          | 0.7468             | 0.8551          | 0.7973      | 69              | 0.64                   | 0.7869              | 0.7059          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.6579             | 0.7812          | 0.7143      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7544            | 0.8613         | 0.8043     | 0.9604           |
| 0.0943        | 46.0  | 4876  | 0.1283          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6364                 | 0.8033              | 0.7101          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7595            | 0.8671         | 0.8097     | 0.9609           |
| 0.0964        | 47.0  | 4982  | 0.1296          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6316                 | 0.7869              | 0.7007          | 61                  | 0.8434           | 0.9150        | 0.8777    | 153           | 0.6410             | 0.7812          | 0.7042      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7551            | 0.8642         | 0.8059     | 0.9609           |
| 0.093         | 48.0  | 5088  | 0.1315          | 0.7468             | 0.8551          | 0.7973      | 69              | 0.6234                 | 0.7869              | 0.6957          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.6410             | 0.7812          | 0.7042      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7513            | 0.8642         | 0.8038     | 0.9606           |
| 0.095         | 49.0  | 5194  | 0.1287          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6234                 | 0.7869              | 0.6957          | 61                  | 0.8434           | 0.9150        | 0.8777    | 153           | 0.6667             | 0.75            | 0.7059      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7602            | 0.8613         | 0.8076     | 0.9609           |
| 0.0931        | 50.0  | 5300  | 0.1242          | 0.7564             | 0.8551          | 0.8027      | 69              | 0.6571                 | 0.7541              | 0.7023          | 61                  | 0.8434           | 0.9150        | 0.8777    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7728            | 0.8555         | 0.8121     | 0.9628           |
| 0.0913        | 51.0  | 5406  | 0.1282          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6364                 | 0.8033              | 0.7101          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7614            | 0.8671         | 0.8108     | 0.9614           |
| 0.0903        | 52.0  | 5512  | 0.1309          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6220                 | 0.8361              | 0.7133          | 61                  | 0.8402           | 0.9281        | 0.8820    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7562            | 0.8786         | 0.8128     | 0.9611           |
| 0.0916        | 53.0  | 5618  | 0.1269          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6316                 | 0.7869              | 0.7007          | 61                  | 0.8393           | 0.9216        | 0.8785    | 153           | 0.6667             | 0.75            | 0.7059      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7608            | 0.8642         | 0.8092     | 0.9621           |
| 0.0908        | 54.0  | 5724  | 0.1262          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6429                 | 0.7377              | 0.6870          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7649            | 0.8555         | 0.8076     | 0.9621           |
| 0.0909        | 55.0  | 5830  | 0.1326          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6329                 | 0.8197              | 0.7143          | 61                  | 0.8294           | 0.9216        | 0.8731    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7531            | 0.8728         | 0.8086     | 0.9601           |
| 0.0901        | 56.0  | 5936  | 0.1253          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6479                 | 0.7541              | 0.6970          | 61                  | 0.8494           | 0.9216        | 0.8840    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7720            | 0.8613         | 0.8142     | 0.9628           |
| 0.0887        | 57.0  | 6042  | 0.1284          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.64                   | 0.7869              | 0.7059          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7659            | 0.8699         | 0.8146     | 0.9621           |
| 0.0871        | 58.0  | 6148  | 0.1309          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6494                 | 0.8197              | 0.7246          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7652            | 0.8757         | 0.8167     | 0.9606           |
| 0.0873        | 59.0  | 6254  | 0.1259          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.64                   | 0.7869              | 0.7059          | 61                  | 0.8485           | 0.9150        | 0.8805    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7667            | 0.8642         | 0.8125     | 0.9614           |
| 0.0881        | 60.0  | 6360  | 0.1329          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6494                 | 0.8197              | 0.7246          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6757             | 0.7812          | 0.7246      | 32              | 0.7222         | 0.8387      | 0.7761  | 31          | 0.7613            | 0.8757         | 0.8145     | 0.9611           |
| 0.0862        | 61.0  | 6466  | 0.1278          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6267                 | 0.7705              | 0.6912          | 61                  | 0.8434           | 0.9150        | 0.8777    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7641            | 0.8613         | 0.8098     | 0.9623           |
| 0.0846        | 62.0  | 6572  | 0.1268          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6267                 | 0.7705              | 0.6912          | 61                  | 0.8452           | 0.9281        | 0.8847    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7653            | 0.8671         | 0.8130     | 0.9626           |
| 0.0848        | 63.0  | 6678  | 0.1273          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6267                 | 0.7705              | 0.6912          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7621            | 0.8613         | 0.8087     | 0.9621           |
| 0.0839        | 64.0  | 6784  | 0.1308          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6296                 | 0.8361              | 0.7183          | 61                  | 0.8452           | 0.9281        | 0.8847    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7619            | 0.8786         | 0.8161     | 0.9614           |
| 0.0844        | 65.0  | 6890  | 0.1304          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6234                 | 0.7869              | 0.6957          | 61                  | 0.8393           | 0.9216        | 0.8785    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7595            | 0.8671         | 0.8097     | 0.9614           |
| 0.0843        | 66.0  | 6996  | 0.1285          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6234                 | 0.7869              | 0.6957          | 61                  | 0.8343           | 0.9216        | 0.8758    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7595            | 0.8671         | 0.8097     | 0.9619           |
| 0.0835        | 67.0  | 7102  | 0.1305          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6364                 | 0.8033              | 0.7101          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7646            | 0.8728         | 0.8151     | 0.9616           |
| 0.0829        | 68.0  | 7208  | 0.1330          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6282                 | 0.8033              | 0.7050          | 61                  | 0.8443           | 0.9216        | 0.8812    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7582            | 0.8699         | 0.8102     | 0.9616           |
| 0.0825        | 69.0  | 7314  | 0.1298          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6364                 | 0.8033              | 0.7101          | 61                  | 0.8383           | 0.9150        | 0.875     | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7595            | 0.8671         | 0.8097     | 0.9616           |
| 0.0838        | 70.0  | 7420  | 0.1245          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6351                 | 0.7705              | 0.6963          | 61                  | 0.8545           | 0.9216        | 0.8868    | 153           | 0.6667             | 0.75            | 0.7059      | 32              | 0.7879         | 0.8387      | 0.8125  | 31          | 0.7720            | 0.8613         | 0.8142     | 0.9631           |
| 0.082         | 71.0  | 7526  | 0.1278          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6316                 | 0.7869              | 0.7007          | 61                  | 0.8537           | 0.9150        | 0.8833    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7686            | 0.8642         | 0.8136     | 0.9621           |
| 0.0828        | 72.0  | 7632  | 0.1286          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6104                 | 0.7705              | 0.6812          | 61                  | 0.8545           | 0.9216        | 0.8868    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7429         | 0.8387      | 0.7879  | 31          | 0.7628            | 0.8642         | 0.8103     | 0.9619           |
| 0.0817        | 73.0  | 7738  | 0.1266          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.5897                 | 0.7541              | 0.6619          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.7222             | 0.8125          | 0.7647      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7614            | 0.8671         | 0.8108     | 0.9621           |
| 0.0812        | 74.0  | 7844  | 0.1293          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6282                 | 0.8033              | 0.7050          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7684            | 0.8728         | 0.8173     | 0.9626           |
| 0.0807        | 75.0  | 7950  | 0.1287          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6316                 | 0.7869              | 0.7007          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7712            | 0.8671         | 0.8163     | 0.9626           |
| 0.0812        | 76.0  | 8056  | 0.1300          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6364                 | 0.8033              | 0.7101          | 61                  | 0.8614           | 0.9346        | 0.8966    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7710            | 0.8757         | 0.8200     | 0.9631           |
| 0.0802        | 77.0  | 8162  | 0.1278          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7738            | 0.8699         | 0.8190     | 0.9626           |
| 0.0784        | 78.0  | 8268  | 0.1290          | 0.7821             | 0.8841          | 0.8299      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7784            | 0.8728         | 0.8229     | 0.9631           |
| 0.0786        | 79.0  | 8374  | 0.1273          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6316                 | 0.7869              | 0.7007          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7712            | 0.8671         | 0.8163     | 0.9631           |
| 0.079         | 80.0  | 8480  | 0.1324          | 0.7407             | 0.8696          | 0.8000      | 69              | 0.6582                 | 0.8525              | 0.7429          | 61                  | 0.8503           | 0.9281        | 0.8875    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7683            | 0.8815         | 0.8210     | 0.9631           |
| 0.0787        | 81.0  | 8586  | 0.1298          | 0.7722             | 0.8841          | 0.8243      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7763            | 0.8728         | 0.8218     | 0.9628           |
| 0.0773        | 82.0  | 8692  | 0.1300          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6579                 | 0.8197              | 0.7299          | 61                  | 0.8589           | 0.9150        | 0.8861    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7758            | 0.8699         | 0.8202     | 0.9626           |
| 0.0774        | 83.0  | 8798  | 0.1283          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6579                 | 0.8197              | 0.7299          | 61                  | 0.8528           | 0.9085        | 0.8797    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7732            | 0.8671         | 0.8174     | 0.9626           |
| 0.08          | 84.0  | 8904  | 0.1285          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6579                 | 0.8197              | 0.7299          | 61                  | 0.8528           | 0.9085        | 0.8797    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7732            | 0.8671         | 0.8174     | 0.9623           |
| 0.0793        | 85.0  | 9010  | 0.1299          | 0.75               | 0.8696          | 0.8054      | 69              | 0.6579                 | 0.8197              | 0.7299          | 61                  | 0.8589           | 0.9150        | 0.8861    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7738            | 0.8699         | 0.8190     | 0.9623           |
| 0.0785        | 86.0  | 9116  | 0.1294          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6533                 | 0.8033              | 0.7206          | 61                  | 0.8650           | 0.9216        | 0.8924    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7778            | 0.8699         | 0.8213     | 0.9636           |
| 0.0775        | 87.0  | 9222  | 0.1289          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8606           | 0.9281        | 0.8931    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7744            | 0.8728         | 0.8207     | 0.9631           |
| 0.0762        | 88.0  | 9328  | 0.1290          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6533                 | 0.8033              | 0.7206          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7784            | 0.8728         | 0.8229     | 0.9636           |
| 0.0793        | 89.0  | 9434  | 0.1308          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6494                 | 0.8197              | 0.7246          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7744            | 0.8728         | 0.8207     | 0.9631           |
| 0.0775        | 90.0  | 9540  | 0.1300          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8667           | 0.9346        | 0.8994    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7769            | 0.8757         | 0.8234     | 0.9633           |
| 0.0773        | 91.0  | 9646  | 0.1287          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6447                 | 0.8033              | 0.7153          | 61                  | 0.8650           | 0.9216        | 0.8924    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7758            | 0.8699         | 0.8202     | 0.9631           |
| 0.0779        | 92.0  | 9752  | 0.1300          | 0.7692             | 0.8696          | 0.8163      | 69              | 0.6364                 | 0.8033              | 0.7101          | 61                  | 0.8650           | 0.9216        | 0.8924    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7758            | 0.8699         | 0.8202     | 0.9628           |
| 0.0779        | 93.0  | 9858  | 0.1293          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6533                 | 0.8033              | 0.7206          | 61                  | 0.8712           | 0.9281        | 0.8987    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7804            | 0.8728         | 0.8240     | 0.9631           |
| 0.0758        | 94.0  | 9964  | 0.1298          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6494                 | 0.8197              | 0.7246          | 61                  | 0.8606           | 0.9281        | 0.8931    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7749            | 0.8757         | 0.8223     | 0.9633           |
| 0.075         | 95.0  | 10070 | 0.1302          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6494                 | 0.8197              | 0.7246          | 61                  | 0.8606           | 0.9281        | 0.8931    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7749            | 0.8757         | 0.8223     | 0.9631           |
| 0.0767        | 96.0  | 10176 | 0.1305          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6494                 | 0.8197              | 0.7246          | 61                  | 0.8598           | 0.9216        | 0.8896    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7744            | 0.8728         | 0.8207     | 0.9631           |
| 0.0774        | 97.0  | 10282 | 0.1299          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6533                 | 0.8033              | 0.7206          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7784            | 0.8728         | 0.8229     | 0.9631           |
| 0.0734        | 98.0  | 10388 | 0.1297          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6533                 | 0.8033              | 0.7206          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7784            | 0.8728         | 0.8229     | 0.9631           |
| 0.0764        | 99.0  | 10494 | 0.1293          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6533                 | 0.8033              | 0.7206          | 61                  | 0.8659           | 0.9281        | 0.8959    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7784            | 0.8728         | 0.8229     | 0.9631           |
| 0.0766        | 100.0 | 10600 | 0.1294          | 0.7595             | 0.8696          | 0.8108      | 69              | 0.6533                 | 0.8033              | 0.7206          | 61                  | 0.8650           | 0.9216        | 0.8924    | 153           | 0.6944             | 0.7812          | 0.7353      | 32              | 0.7647         | 0.8387      | 0.8000  | 31          | 0.7778            | 0.8699         | 0.8213     | 0.9628           |


### Framework versions

- Transformers 4.40.2
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.19.1