---
language:
- id
license: mit
base_model: indolem/indobert-base-uncased
tags:
- generated_from_trainer
model-index:
- name: nerui-pt-pl10-0
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# nerui-pt-pl10-0

This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.0530
- Location Precision: 0.8447
- Location Recall: 0.9255
- Location F1: 0.8832
- Location Number: 94
- Organization Precision: 0.9198
- Organization Recall: 0.8922
- Organization F1: 0.9058
- Organization Number: 167
- Person Precision: 0.9926
- Person Recall: 0.9781
- Person F1: 0.9853
- Person Number: 137
- Overall Precision: 0.925
- Overall Recall: 0.9296
- Overall F1: 0.9273
- Overall Accuracy: 0.9859

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 16
- eval_batch_size: 64
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 100.0

### Training results

| Training Loss | Epoch | Step | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:-----------------:|:--------------:|:----------:|:----------------:|
| 0.8344        | 1.0   | 96   | 0.3987          | 0.375              | 0.0319          | 0.0588      | 94              | 0.2115                 | 0.2874              | 0.2437          | 167                 | 0.2775           | 0.3869        | 0.3232    | 137           | 0.2441            | 0.2613         | 0.2524     | 0.8663           |
| 0.359         | 2.0   | 192  | 0.2302          | 0.39               | 0.4149          | 0.4021      | 94              | 0.5145                 | 0.7425              | 0.6078          | 167                 | 0.8037           | 0.9562        | 0.8733    | 137           | 0.5833            | 0.7387         | 0.6519     | 0.9373           |
| 0.1857        | 3.0   | 288  | 0.1083          | 0.7579             | 0.7660          | 0.7619      | 94              | 0.6919                 | 0.8204              | 0.7507          | 167                 | 0.9574           | 0.9854        | 0.9712    | 137           | 0.7926            | 0.8643         | 0.8269     | 0.9635           |
| 0.1288        | 4.0   | 384  | 0.0742          | 0.8155             | 0.8936          | 0.8528      | 94              | 0.7921                 | 0.8443              | 0.8174          | 167                 | 0.9708           | 0.9708        | 0.9708    | 137           | 0.8565            | 0.8995         | 0.8775     | 0.9740           |
| 0.108         | 5.0   | 480  | 0.0655          | 0.81               | 0.8617          | 0.8351      | 94              | 0.8631                 | 0.8683              | 0.8657          | 167                 | 0.9854           | 0.9854        | 0.9854    | 137           | 0.8914            | 0.9070         | 0.8991     | 0.9765           |
| 0.0921        | 6.0   | 576  | 0.0532          | 0.8208             | 0.9255          | 0.8700      | 94              | 0.8521                 | 0.8623              | 0.8571          | 167                 | 0.9926           | 0.9854        | 0.9890    | 137           | 0.8905            | 0.9196         | 0.9048     | 0.9812           |
| 0.0824        | 7.0   | 672  | 0.0591          | 0.7857             | 0.9362          | 0.8544      | 94              | 0.8774                 | 0.8144              | 0.8447          | 167                 | 0.9926           | 0.9854        | 0.9890    | 137           | 0.8908            | 0.9020         | 0.8964     | 0.9771           |
| 0.0751        | 8.0   | 768  | 0.0534          | 0.7692             | 0.9574          | 0.8531      | 94              | 0.8598                 | 0.8443              | 0.8520          | 167                 | 0.9926           | 0.9854        | 0.9890    | 137           | 0.8777            | 0.9196         | 0.8982     | 0.9804           |
| 0.0697        | 9.0   | 864  | 0.0415          | 0.86               | 0.9149          | 0.8866      | 94              | 0.8844                 | 0.9162              | 0.9             | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9167            | 0.9397         | 0.9280     | 0.9865           |
| 0.0657        | 10.0  | 960  | 0.0403          | 0.8958             | 0.9149          | 0.9053      | 94              | 0.8708                 | 0.9281              | 0.8986          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9193            | 0.9447         | 0.9318     | 0.9867           |
| 0.0639        | 11.0  | 1056 | 0.0430          | 0.8812             | 0.9468          | 0.9128      | 94              | 0.8976                 | 0.8922              | 0.8949          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9279            | 0.9372         | 0.9325     | 0.9856           |
| 0.0571        | 12.0  | 1152 | 0.0544          | 0.8349             | 0.9681          | 0.8966      | 94              | 0.9308                 | 0.8862              | 0.9080          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9280            | 0.9397         | 0.9338     | 0.9840           |
| 0.0546        | 13.0  | 1248 | 0.0453          | 0.8558             | 0.9468          | 0.8990      | 94              | 0.8929                 | 0.8982              | 0.8955          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9189            | 0.9397         | 0.9292     | 0.9859           |
| 0.0494        | 14.0  | 1344 | 0.0392          | 0.9175             | 0.9468          | 0.9319      | 94              | 0.8715                 | 0.9341              | 0.9017          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9221            | 0.9523         | 0.9370     | 0.9881           |
| 0.0491        | 15.0  | 1440 | 0.0368          | 0.8788             | 0.9255          | 0.9016      | 94              | 0.8935                 | 0.9042              | 0.8988          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9231            | 0.9347         | 0.9288     | 0.9876           |
| 0.0486        | 16.0  | 1536 | 0.0391          | 0.8969             | 0.9255          | 0.9110      | 94              | 0.9157                 | 0.9102              | 0.9129          | 167                 | 0.9854           | 0.9854        | 0.9854    | 137           | 0.935             | 0.9397         | 0.9373     | 0.9878           |
| 0.0467        | 17.0  | 1632 | 0.0396          | 0.8738             | 0.9574          | 0.9137      | 94              | 0.9059                 | 0.9222              | 0.9139          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9242            | 0.9497         | 0.9368     | 0.9870           |
| 0.0401        | 18.0  | 1728 | 0.0443          | 0.9082             | 0.9468          | 0.9271      | 94              | 0.9030                 | 0.8922              | 0.8976          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9372            | 0.9372         | 0.9372     | 0.9867           |
| 0.0414        | 19.0  | 1824 | 0.0476          | 0.8288             | 0.9787          | 0.8976      | 94              | 0.9363                 | 0.8802              | 0.9074          | 167                 | 0.9781           | 0.9781        | 0.9781    | 137           | 0.9210            | 0.9372         | 0.9290     | 0.9851           |
| 0.0404        | 20.0  | 1920 | 0.0459          | 0.8411             | 0.9574          | 0.8955      | 94              | 0.9217                 | 0.9162              | 0.9189          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9265            | 0.9497         | 0.9380     | 0.9873           |
| 0.0411        | 21.0  | 2016 | 0.0429          | 0.875              | 0.9681          | 0.9192      | 94              | 0.9394                 | 0.9281              | 0.9337          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9431            | 0.9573         | 0.9501     | 0.9887           |
| 0.0354        | 22.0  | 2112 | 0.0412          | 0.9082             | 0.9468          | 0.9271      | 94              | 0.8786                 | 0.9102              | 0.8941          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9261            | 0.9447         | 0.9353     | 0.9876           |
| 0.0343        | 23.0  | 2208 | 0.0573          | 0.8476             | 0.9468          | 0.8945      | 94              | 0.9026                 | 0.8323              | 0.8660          | 167                 | 0.9640           | 0.9781        | 0.9710    | 137           | 0.9095            | 0.9095         | 0.9095     | 0.9804           |
| 0.0337        | 24.0  | 2304 | 0.0420          | 0.8911             | 0.9574          | 0.9231      | 94              | 0.9107                 | 0.9162              | 0.9134          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9356            | 0.9497         | 0.9426     | 0.9887           |
| 0.0321        | 25.0  | 2400 | 0.0474          | 0.8824             | 0.9574          | 0.9184      | 94              | 0.9112                 | 0.9222              | 0.9167          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9335            | 0.9523         | 0.9428     | 0.9873           |
| 0.0334        | 26.0  | 2496 | 0.0418          | 0.9158             | 0.9255          | 0.9206      | 94              | 0.9                    | 0.9162              | 0.9080          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9375            | 0.9422         | 0.9398     | 0.9887           |
| 0.0319        | 27.0  | 2592 | 0.0404          | 0.9255             | 0.9255          | 0.9255      | 94              | 0.9337                 | 0.9281              | 0.9309          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9544            | 0.9472         | 0.9508     | 0.9898           |
| 0.0342        | 28.0  | 2688 | 0.0398          | 0.8922             | 0.9681          | 0.9286      | 94              | 0.95                   | 0.9102              | 0.9297          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9472            | 0.9472         | 0.9472     | 0.9895           |
| 0.0322        | 29.0  | 2784 | 0.0495          | 0.8365             | 0.9255          | 0.8788      | 94              | 0.9024                 | 0.8862              | 0.8943          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9181            | 0.9296         | 0.9238     | 0.9851           |
| 0.0285        | 30.0  | 2880 | 0.0434          | 0.8990             | 0.9468          | 0.9223      | 94              | 0.9053                 | 0.9162              | 0.9107          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9330            | 0.9447         | 0.9388     | 0.9878           |
| 0.0281        | 31.0  | 2976 | 0.0395          | 0.8990             | 0.9468          | 0.9223      | 94              | 0.9107                 | 0.9162              | 0.9134          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9330            | 0.9447         | 0.9388     | 0.9884           |
| 0.0261        | 32.0  | 3072 | 0.0441          | 0.8571             | 0.9574          | 0.9045      | 94              | 0.9264                 | 0.9042              | 0.9152          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9282            | 0.9422         | 0.9352     | 0.9876           |
| 0.0267        | 33.0  | 3168 | 0.0412          | 0.8969             | 0.9255          | 0.9110      | 94              | 0.9264                 | 0.9042              | 0.9152          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9394            | 0.9347         | 0.9370     | 0.9878           |
| 0.0254        | 34.0  | 3264 | 0.0474          | 0.9255             | 0.9255          | 0.9255      | 94              | 0.8663                 | 0.8922              | 0.8791          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9204            | 0.9296         | 0.925      | 0.9862           |
| 0.0234        | 35.0  | 3360 | 0.0434          | 0.8990             | 0.9468          | 0.9223      | 94              | 0.9152                 | 0.9042              | 0.9096          | 167                 | 0.9779           | 0.9708        | 0.9744    | 137           | 0.9325            | 0.9372         | 0.9348     | 0.9881           |
| 0.0248        | 36.0  | 3456 | 0.0449          | 0.8889             | 0.9362          | 0.9119      | 94              | 0.9075                 | 0.9401              | 0.9235          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9335            | 0.9523         | 0.9428     | 0.9892           |
| 0.0227        | 37.0  | 3552 | 0.0458          | 0.8889             | 0.9362          | 0.9119      | 94              | 0.9212                 | 0.9102              | 0.9157          | 167                 | 0.9852           | 0.9708        | 0.9779    | 137           | 0.9348            | 0.9372         | 0.9360     | 0.9876           |
| 0.0232        | 38.0  | 3648 | 0.0487          | 0.8812             | 0.9468          | 0.9128      | 94              | 0.9030                 | 0.8922              | 0.8976          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9254            | 0.9347         | 0.93       | 0.9862           |
| 0.0217        | 39.0  | 3744 | 0.0493          | 0.8627             | 0.9362          | 0.8980      | 94              | 0.9264                 | 0.9042              | 0.9152          | 167                 | 0.9926           | 0.9854        | 0.9890    | 137           | 0.9327            | 0.9397         | 0.9362     | 0.9870           |
| 0.0228        | 40.0  | 3840 | 0.0473          | 0.8725             | 0.9468          | 0.9082      | 94              | 0.925                  | 0.8862              | 0.9052          | 167                 | 0.9852           | 0.9708        | 0.9779    | 137           | 0.9320            | 0.9296         | 0.9308     | 0.9867           |
| 0.0216        | 41.0  | 3936 | 0.0429          | 0.8725             | 0.9468          | 0.9082      | 94              | 0.9212                 | 0.9102              | 0.9157          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9328            | 0.9422         | 0.9375     | 0.9881           |
| 0.0195        | 42.0  | 4032 | 0.0459          | 0.8738             | 0.9574          | 0.9137      | 94              | 0.9363                 | 0.8802              | 0.9074          | 167                 | 0.9926           | 0.9854        | 0.9890    | 137           | 0.9394            | 0.9347         | 0.9370     | 0.9884           |
| 0.0217        | 43.0  | 4128 | 0.0496          | 0.88               | 0.9362          | 0.9072      | 94              | 0.9125                 | 0.8743              | 0.8930          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9342            | 0.9271         | 0.9306     | 0.9859           |
| 0.0182        | 44.0  | 4224 | 0.0518          | 0.8654             | 0.9574          | 0.9091      | 94              | 0.9313                 | 0.8922              | 0.9113          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9373            | 0.9397         | 0.9385     | 0.9873           |
| 0.0202        | 45.0  | 4320 | 0.0446          | 0.9062             | 0.9255          | 0.9158      | 94              | 0.9255                 | 0.8922              | 0.9085          | 167                 | 0.9926           | 0.9854        | 0.9890    | 137           | 0.9440            | 0.9322         | 0.9381     | 0.9884           |
| 0.0192        | 46.0  | 4416 | 0.0466          | 0.8476             | 0.9468          | 0.8945      | 94              | 0.9255                 | 0.8922              | 0.9085          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9302            | 0.9372         | 0.9337     | 0.9865           |
| 0.0185        | 47.0  | 4512 | 0.0456          | 0.8812             | 0.9468          | 0.9128      | 94              | 0.9325                 | 0.9102              | 0.9212          | 167                 | 0.9778           | 0.9635        | 0.9706    | 137           | 0.9348            | 0.9372         | 0.9360     | 0.9878           |
| 0.0191        | 48.0  | 4608 | 0.0458          | 0.88               | 0.9362          | 0.9072      | 94              | 0.9321                 | 0.9042              | 0.9179          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9372            | 0.9372         | 0.9372     | 0.9878           |
| 0.0177        | 49.0  | 4704 | 0.0496          | 0.8812             | 0.9468          | 0.9128      | 94              | 0.9264                 | 0.9042              | 0.9152          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9398            | 0.9422         | 0.9410     | 0.9870           |
| 0.0176        | 50.0  | 4800 | 0.0473          | 0.8558             | 0.9468          | 0.8990      | 94              | 0.9112                 | 0.9222              | 0.9167          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9265            | 0.9497         | 0.9380     | 0.9870           |
| 0.0167        | 51.0  | 4896 | 0.0466          | 0.8738             | 0.9574          | 0.9137      | 94              | 0.8922                 | 0.8922              | 0.8922          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9235            | 0.9397         | 0.9315     | 0.9873           |
| 0.0162        | 52.0  | 4992 | 0.0431          | 0.8969             | 0.9255          | 0.9110      | 94              | 0.9202                 | 0.8982              | 0.9091          | 167                 | 0.9779           | 0.9708        | 0.9744    | 137           | 0.9343            | 0.9296         | 0.9320     | 0.9878           |
| 0.0154        | 53.0  | 5088 | 0.0494          | 0.8462             | 0.9362          | 0.8889      | 94              | 0.9102                 | 0.9102              | 0.9102          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9236            | 0.9422         | 0.9328     | 0.9867           |
| 0.0161        | 54.0  | 5184 | 0.0438          | 0.8713             | 0.9362          | 0.9026      | 94              | 0.9102                 | 0.9102              | 0.9102          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9303            | 0.9397         | 0.9350     | 0.9881           |
| 0.014         | 55.0  | 5280 | 0.0494          | 0.8878             | 0.9255          | 0.9062      | 94              | 0.9259                 | 0.8982              | 0.9119          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9418            | 0.9347         | 0.9382     | 0.9878           |
| 0.0149        | 56.0  | 5376 | 0.0460          | 0.8812             | 0.9468          | 0.9128      | 94              | 0.9379                 | 0.9042              | 0.9207          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9444            | 0.9397         | 0.9421     | 0.9887           |
| 0.0126        | 57.0  | 5472 | 0.0443          | 0.8911             | 0.9574          | 0.9231      | 94              | 0.9141                 | 0.8922              | 0.9030          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9348            | 0.9372         | 0.9360     | 0.9873           |
| 0.0148        | 58.0  | 5568 | 0.0479          | 0.8980             | 0.9362          | 0.9167      | 94              | 0.9273                 | 0.9162              | 0.9217          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9446            | 0.9422         | 0.9434     | 0.9870           |
| 0.0136        | 59.0  | 5664 | 0.0509          | 0.8641             | 0.9468          | 0.9036      | 94              | 0.9102                 | 0.9102              | 0.9102          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9282            | 0.9422         | 0.9352     | 0.9865           |
| 0.0141        | 60.0  | 5760 | 0.0581          | 0.8476             | 0.9468          | 0.8945      | 94              | 0.9329                 | 0.9162              | 0.9245          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9330            | 0.9447         | 0.9388     | 0.9856           |
| 0.0135        | 61.0  | 5856 | 0.0474          | 0.8725             | 0.9468          | 0.9082      | 94              | 0.9217                 | 0.9162              | 0.9189          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9330            | 0.9447         | 0.9388     | 0.9887           |
| 0.0135        | 62.0  | 5952 | 0.0525          | 0.8812             | 0.9468          | 0.9128      | 94              | 0.9259                 | 0.8982              | 0.9119          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9348            | 0.9372         | 0.9360     | 0.9865           |
| 0.0125        | 63.0  | 6048 | 0.0510          | 0.8878             | 0.9255          | 0.9062      | 94              | 0.9202                 | 0.8982              | 0.9091          | 167                 | 0.9779           | 0.9708        | 0.9744    | 137           | 0.9320            | 0.9296         | 0.9308     | 0.9856           |
| 0.0142        | 64.0  | 6144 | 0.0533          | 0.8812             | 0.9468          | 0.9128      | 94              | 0.9198                 | 0.8922              | 0.9058          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9347            | 0.9347         | 0.9347     | 0.9862           |
| 0.0137        | 65.0  | 6240 | 0.0534          | 0.8431             | 0.9149          | 0.8776      | 94              | 0.9198                 | 0.8922              | 0.9058          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9248            | 0.9271         | 0.9260     | 0.9856           |
| 0.0132        | 66.0  | 6336 | 0.0523          | 0.87               | 0.9255          | 0.8969      | 94              | 0.9548                 | 0.8862              | 0.9193          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9437            | 0.9271         | 0.9354     | 0.9865           |
| 0.0136        | 67.0  | 6432 | 0.0542          | 0.8447             | 0.9255          | 0.8832      | 94              | 0.9141                 | 0.8922              | 0.9030          | 167                 | 0.9852           | 0.9708        | 0.9779    | 137           | 0.9202            | 0.9271         | 0.9237     | 0.9851           |
| 0.0113        | 68.0  | 6528 | 0.0497          | 0.8776             | 0.9149          | 0.8958      | 94              | 0.9042                 | 0.9042              | 0.9042          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9275            | 0.9322         | 0.9298     | 0.9859           |
| 0.0121        | 69.0  | 6624 | 0.0473          | 0.8641             | 0.9468          | 0.9036      | 94              | 0.9367                 | 0.8862              | 0.9108          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9369            | 0.9322         | 0.9345     | 0.9884           |
| 0.0124        | 70.0  | 6720 | 0.0438          | 0.8788             | 0.9255          | 0.9016      | 94              | 0.9321                 | 0.9042              | 0.9179          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9419            | 0.9372         | 0.9395     | 0.9887           |
| 0.0132        | 71.0  | 6816 | 0.0438          | 0.87               | 0.9255          | 0.8969      | 94              | 0.9162                 | 0.9162              | 0.9162          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9303            | 0.9397         | 0.9350     | 0.9881           |
| 0.0127        | 72.0  | 6912 | 0.0513          | 0.8627             | 0.9362          | 0.8980      | 94              | 0.9277                 | 0.9222              | 0.9249          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9353            | 0.9447         | 0.94       | 0.9876           |
| 0.0107        | 73.0  | 7008 | 0.0499          | 0.8476             | 0.9468          | 0.8945      | 94              | 0.9308                 | 0.8862              | 0.9080          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9298            | 0.9322         | 0.9310     | 0.9876           |
| 0.0114        | 74.0  | 7104 | 0.0467          | 0.8889             | 0.9362          | 0.9119      | 94              | 0.9264                 | 0.9042              | 0.9152          | 167                 | 0.9779           | 0.9708        | 0.9744    | 137           | 0.9347            | 0.9347         | 0.9347     | 0.9890           |
| 0.0103        | 75.0  | 7200 | 0.0486          | 0.8654             | 0.9574          | 0.9091      | 94              | 0.9259                 | 0.8982              | 0.9119          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9352            | 0.9422         | 0.9387     | 0.9887           |
| 0.0101        | 76.0  | 7296 | 0.0512          | 0.8544             | 0.9362          | 0.8934      | 94              | 0.925                  | 0.8862              | 0.9052          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9322            | 0.9322         | 0.9322     | 0.9873           |
| 0.0101        | 77.0  | 7392 | 0.0530          | 0.8447             | 0.9255          | 0.8832      | 94              | 0.9130                 | 0.8802              | 0.8963          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9248            | 0.9271         | 0.9260     | 0.9862           |
| 0.0094        | 78.0  | 7488 | 0.0495          | 0.8878             | 0.9255          | 0.9062      | 94              | 0.9212                 | 0.9102              | 0.9157          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9397            | 0.9397         | 0.9397     | 0.9887           |
| 0.0099        | 79.0  | 7584 | 0.0508          | 0.9158             | 0.9255          | 0.9206      | 94              | 0.9281                 | 0.9281              | 0.9281          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.9496            | 0.9472         | 0.9484     | 0.9887           |
| 0.0097        | 80.0  | 7680 | 0.0553          | 0.8614             | 0.9255          | 0.8923      | 94              | 0.9268                 | 0.9102              | 0.9184          | 167                 | 1.0              | 0.9854        | 0.9926    | 137           | 0.935             | 0.9397         | 0.9373     | 0.9870           |
| 0.009         | 81.0  | 7776 | 0.0551          | 0.8447             | 0.9255          | 0.8832      | 94              | 0.9259                 | 0.8982              | 0.9119          | 167                 | 0.9926           | 0.9854        | 0.9890    | 137           | 0.9277            | 0.9347         | 0.9312     | 0.9865           |
| 0.0096        | 82.0  | 7872 | 0.0544          | 0.8878             | 0.9255          | 0.9062      | 94              | 0.9157                 | 0.9102              | 0.9129          | 167                 | 0.9926           | 0.9854        | 0.9890    | 137           | 0.935             | 0.9397         | 0.9373     | 0.9873           |
| 0.0103        | 83.0  | 7968 | 0.0530          | 0.8713             | 0.9362          | 0.9026      | 94              | 0.9268                 | 0.9102              | 0.9184          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.935             | 0.9397         | 0.9373     | 0.9873           |
| 0.0094        | 84.0  | 8064 | 0.0547          | 0.8544             | 0.9362          | 0.8934      | 94              | 0.9259                 | 0.8982              | 0.9119          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9323            | 0.9347         | 0.9335     | 0.9862           |
| 0.0087        | 85.0  | 8160 | 0.0532          | 0.8713             | 0.9362          | 0.9026      | 94              | 0.9202                 | 0.8982              | 0.9091          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9347            | 0.9347         | 0.9347     | 0.9870           |
| 0.0094        | 86.0  | 8256 | 0.0555          | 0.8627             | 0.9362          | 0.8980      | 94              | 0.9255                 | 0.8922              | 0.9085          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9322            | 0.9322         | 0.9322     | 0.9865           |
| 0.0092        | 87.0  | 8352 | 0.0544          | 0.8333             | 0.9574          | 0.8911      | 94              | 0.9317                 | 0.8982              | 0.9146          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9257            | 0.9397         | 0.9327     | 0.9870           |
| 0.0098        | 88.0  | 8448 | 0.0556          | 0.8529             | 0.9255          | 0.8878      | 94              | 0.9308                 | 0.8862              | 0.9080          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9318            | 0.9271         | 0.9295     | 0.9859           |
| 0.008         | 89.0  | 8544 | 0.0557          | 0.8447             | 0.9255          | 0.8832      | 94              | 0.9317                 | 0.8982              | 0.9146          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9298            | 0.9322         | 0.9310     | 0.9862           |
| 0.0087        | 90.0  | 8640 | 0.0531          | 0.8544             | 0.9362          | 0.8934      | 94              | 0.9317                 | 0.8982              | 0.9146          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9323            | 0.9347         | 0.9335     | 0.9873           |
| 0.0094        | 91.0  | 8736 | 0.0544          | 0.8529             | 0.9255          | 0.8878      | 94              | 0.9193                 | 0.8862              | 0.9024          | 167                 | 0.9853           | 0.9781        | 0.9817    | 137           | 0.9248            | 0.9271         | 0.9260     | 0.9862           |
| 0.0083        | 92.0  | 8832 | 0.0591          | 0.8529             | 0.9255          | 0.8878      | 94              | 0.9375                 | 0.8982              | 0.9174          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.9369            | 0.9322         | 0.9345     | 0.9859           |
| 0.0081        | 93.0  | 8928 | 0.0565          | 0.8447             | 0.9255          | 0.8832      | 94              | 0.9264                 | 0.9042              | 0.9152          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.93              | 0.9347         | 0.9323     | 0.9862           |
| 0.0083        | 94.0  | 9024 | 0.0543          | 0.8529             | 0.9255          | 0.8878      | 94              | 0.9255                 | 0.8922              | 0.9085          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9296            | 0.9296         | 0.9296     | 0.9865           |
| 0.0084        | 95.0  | 9120 | 0.0516          | 0.8725             | 0.9468          | 0.9082      | 94              | 0.9207                 | 0.9042              | 0.9124          | 167                 | 1.0              | 0.9781        | 0.9889    | 137           | 0.935             | 0.9397         | 0.9373     | 0.9873           |
| 0.0089        | 96.0  | 9216 | 0.0520          | 0.8627             | 0.9362          | 0.8980      | 94              | 0.9141                 | 0.8922              | 0.9030          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9275            | 0.9322         | 0.9298     | 0.9867           |
| 0.0076        | 97.0  | 9312 | 0.0528          | 0.8544             | 0.9362          | 0.8934      | 94              | 0.9141                 | 0.8922              | 0.9030          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9252            | 0.9322         | 0.9287     | 0.9865           |
| 0.0091        | 98.0  | 9408 | 0.0530          | 0.8447             | 0.9255          | 0.8832      | 94              | 0.9141                 | 0.8922              | 0.9030          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9227            | 0.9296         | 0.9262     | 0.9862           |
| 0.0089        | 99.0  | 9504 | 0.0528          | 0.8544             | 0.9362          | 0.8934      | 94              | 0.9198                 | 0.8922              | 0.9058          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.9275            | 0.9322         | 0.9298     | 0.9862           |
| 0.0083        | 100.0 | 9600 | 0.0530          | 0.8447             | 0.9255          | 0.8832      | 94              | 0.9198                 | 0.8922              | 0.9058          | 167                 | 0.9926           | 0.9781        | 0.9853    | 137           | 0.925             | 0.9296         | 0.9273     | 0.9859           |


### Framework versions

- Transformers 4.39.3
- Pytorch 2.3.0+cu121
- Datasets 2.19.1
- Tokenizers 0.15.2