|
--- |
|
language: |
|
- id |
|
license: mit |
|
base_model: indolem/indobert-base-uncased |
|
tags: |
|
- generated_from_trainer |
|
model-index: |
|
- name: nerugm-lora-r8-4 |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# nerugm-lora-r8-4 |
|
|
|
This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.1318 |
|
- Location Precision: 0.7349 |
|
- Location Recall: 0.8356 |
|
- Location F1: 0.7821 |
|
- Location Number: 73 |
|
- Organization Precision: 0.6623 |
|
- Organization Recall: 0.7846 |
|
- Organization F1: 0.7183 |
|
- Organization Number: 65 |
|
- Person Precision: 0.8634 |
|
- Person Recall: 0.9267 |
|
- Person F1: 0.8939 |
|
- Person Number: 150 |
|
- Quantity Precision: 0.6111 |
|
- Quantity Recall: 0.7586 |
|
- Quantity F1: 0.6769 |
|
- Quantity Number: 29 |
|
- Time Precision: 0.775 |
|
- Time Recall: 0.9118 |
|
- Time F1: 0.8378 |
|
- Time Number: 34 |
|
- Overall Precision: 0.7657 |
|
- Overall Recall: 0.8661 |
|
- Overall F1: 0.8128 |
|
- Overall Accuracy: 0.9587 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 5e-05 |
|
- train_batch_size: 16 |
|
- eval_batch_size: 64 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- num_epochs: 100.0 |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy | |
|
|:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:| |
|
| 1.2491 | 1.0 | 106 | 0.7289 | 0.0 | 0.0 | 0.0 | 73 | 0.0 | 0.0 | 0.0 | 65 | 0.0 | 0.0 | 0.0 | 150 | 0.0 | 0.0 | 0.0 | 29 | 0.0 | 0.0 | 0.0 | 34 | 0.0 | 0.0 | 0.0 | 0.8366 | |
|
| 0.7042 | 2.0 | 212 | 0.6215 | 0.0 | 0.0 | 0.0 | 73 | 0.0 | 0.0 | 0.0 | 65 | 0.1667 | 0.0067 | 0.0128 | 150 | 0.0 | 0.0 | 0.0 | 29 | 0.0 | 0.0 | 0.0 | 34 | 0.1429 | 0.0028 | 0.0056 | 0.8376 | |
|
| 0.6157 | 3.0 | 318 | 0.5324 | 0.3333 | 0.0137 | 0.0263 | 73 | 0.0 | 0.0 | 0.0 | 65 | 0.25 | 0.0333 | 0.0588 | 150 | 0.0 | 0.0 | 0.0 | 29 | 0.0 | 0.0 | 0.0 | 34 | 0.1714 | 0.0171 | 0.0311 | 0.8437 | |
|
| 0.5215 | 4.0 | 424 | 0.4347 | 0.6364 | 0.0959 | 0.1667 | 73 | 0.0667 | 0.0154 | 0.025 | 65 | 0.4 | 0.2533 | 0.3102 | 150 | 0.0 | 0.0 | 0.0 | 29 | 0.3889 | 0.2059 | 0.2692 | 34 | 0.3813 | 0.1510 | 0.2163 | 0.8708 | |
|
| 0.4311 | 5.0 | 530 | 0.3518 | 0.5238 | 0.3014 | 0.3826 | 73 | 0.2759 | 0.1231 | 0.1702 | 65 | 0.6 | 0.62 | 0.6098 | 150 | 0.125 | 0.0345 | 0.0541 | 29 | 0.6364 | 0.6176 | 0.6269 | 34 | 0.5431 | 0.4131 | 0.4693 | 0.9048 | |
|
| 0.3468 | 6.0 | 636 | 0.2931 | 0.5 | 0.5342 | 0.5166 | 73 | 0.3968 | 0.3846 | 0.3906 | 65 | 0.7 | 0.8867 | 0.7824 | 150 | 0.3871 | 0.4138 | 0.4000 | 29 | 0.625 | 0.7353 | 0.6757 | 34 | 0.5821 | 0.6667 | 0.6215 | 0.9237 | |
|
| 0.2867 | 7.0 | 742 | 0.2470 | 0.5730 | 0.6986 | 0.6296 | 73 | 0.4051 | 0.4923 | 0.4444 | 65 | 0.7405 | 0.9133 | 0.8179 | 150 | 0.3889 | 0.4828 | 0.4308 | 29 | 0.65 | 0.7647 | 0.7027 | 34 | 0.6061 | 0.7407 | 0.6667 | 0.9328 | |
|
| 0.2534 | 8.0 | 848 | 0.2196 | 0.5778 | 0.7123 | 0.6380 | 73 | 0.4675 | 0.5538 | 0.5070 | 65 | 0.7598 | 0.9067 | 0.8267 | 150 | 0.4118 | 0.4828 | 0.4444 | 29 | 0.6341 | 0.7647 | 0.6933 | 34 | 0.6271 | 0.7521 | 0.6839 | 0.9355 | |
|
| 0.225 | 9.0 | 954 | 0.1991 | 0.6556 | 0.8082 | 0.7239 | 73 | 0.4824 | 0.6308 | 0.5467 | 65 | 0.7740 | 0.9133 | 0.8379 | 150 | 0.4118 | 0.4828 | 0.4444 | 29 | 0.675 | 0.7941 | 0.7297 | 34 | 0.6526 | 0.7920 | 0.7156 | 0.9404 | |
|
| 0.2073 | 10.0 | 1060 | 0.1878 | 0.6667 | 0.8219 | 0.7362 | 73 | 0.5119 | 0.6615 | 0.5772 | 65 | 0.7727 | 0.9067 | 0.8344 | 150 | 0.4545 | 0.5172 | 0.4839 | 29 | 0.725 | 0.8529 | 0.7838 | 34 | 0.6690 | 0.8063 | 0.7313 | 0.9422 | |
|
| 0.1928 | 11.0 | 1166 | 0.1793 | 0.6526 | 0.8493 | 0.7381 | 73 | 0.5114 | 0.6923 | 0.5882 | 65 | 0.7697 | 0.9133 | 0.8354 | 150 | 0.4474 | 0.5862 | 0.5075 | 29 | 0.6905 | 0.8529 | 0.7632 | 34 | 0.6576 | 0.8262 | 0.7323 | 0.9427 | |
|
| 0.1834 | 12.0 | 1272 | 0.1778 | 0.6526 | 0.8493 | 0.7381 | 73 | 0.5217 | 0.7385 | 0.6115 | 65 | 0.7771 | 0.9067 | 0.8369 | 150 | 0.4737 | 0.6207 | 0.5373 | 29 | 0.7143 | 0.8824 | 0.7895 | 34 | 0.6652 | 0.8376 | 0.7415 | 0.9429 | |
|
| 0.172 | 13.0 | 1378 | 0.1679 | 0.6667 | 0.8493 | 0.7470 | 73 | 0.5341 | 0.7231 | 0.6144 | 65 | 0.7861 | 0.9067 | 0.8421 | 150 | 0.4872 | 0.6552 | 0.5588 | 29 | 0.7143 | 0.8824 | 0.7895 | 34 | 0.6759 | 0.8376 | 0.7481 | 0.9459 | |
|
| 0.171 | 14.0 | 1484 | 0.1659 | 0.6966 | 0.8493 | 0.7654 | 73 | 0.5543 | 0.7846 | 0.6497 | 65 | 0.7895 | 0.9 | 0.8411 | 150 | 0.4872 | 0.6552 | 0.5588 | 29 | 0.6977 | 0.8824 | 0.7792 | 34 | 0.6843 | 0.8462 | 0.7567 | 0.9456 | |
|
| 0.1631 | 15.0 | 1590 | 0.1693 | 0.6495 | 0.8630 | 0.7412 | 73 | 0.5455 | 0.7385 | 0.6275 | 65 | 0.7965 | 0.9133 | 0.8509 | 150 | 0.5526 | 0.7241 | 0.6269 | 29 | 0.6977 | 0.8824 | 0.7792 | 34 | 0.6826 | 0.8519 | 0.7579 | 0.9451 | |
|
| 0.1579 | 16.0 | 1696 | 0.1637 | 0.6632 | 0.8630 | 0.75 | 73 | 0.5393 | 0.7385 | 0.6234 | 65 | 0.8095 | 0.9067 | 0.8553 | 150 | 0.525 | 0.7241 | 0.6087 | 29 | 0.6818 | 0.8824 | 0.7692 | 34 | 0.6835 | 0.8490 | 0.7573 | 0.9476 | |
|
| 0.1558 | 17.0 | 1802 | 0.1595 | 0.7 | 0.8630 | 0.7730 | 73 | 0.5319 | 0.7692 | 0.6289 | 65 | 0.8 | 0.9067 | 0.8500 | 150 | 0.5 | 0.6897 | 0.5797 | 29 | 0.6977 | 0.8824 | 0.7792 | 34 | 0.6842 | 0.8519 | 0.7589 | 0.9486 | |
|
| 0.15 | 18.0 | 1908 | 0.1526 | 0.7191 | 0.8767 | 0.7901 | 73 | 0.5882 | 0.7692 | 0.6667 | 65 | 0.8133 | 0.9 | 0.8544 | 150 | 0.5405 | 0.6897 | 0.6061 | 29 | 0.7143 | 0.8824 | 0.7895 | 34 | 0.7136 | 0.8519 | 0.7766 | 0.9508 | |
|
| 0.1469 | 19.0 | 2014 | 0.1538 | 0.7191 | 0.8767 | 0.7901 | 73 | 0.5306 | 0.8 | 0.6380 | 65 | 0.8133 | 0.9 | 0.8544 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7143 | 0.8824 | 0.7895 | 34 | 0.7014 | 0.8632 | 0.7739 | 0.9503 | |
|
| 0.1429 | 20.0 | 2120 | 0.1472 | 0.7241 | 0.8630 | 0.7875 | 73 | 0.5904 | 0.7538 | 0.6622 | 65 | 0.8133 | 0.9 | 0.8544 | 150 | 0.5526 | 0.7241 | 0.6269 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7181 | 0.8490 | 0.7781 | 0.9525 | |
|
| 0.1419 | 21.0 | 2226 | 0.1474 | 0.7241 | 0.8630 | 0.7875 | 73 | 0.5882 | 0.7692 | 0.6667 | 65 | 0.8232 | 0.9 | 0.8599 | 150 | 0.5789 | 0.7586 | 0.6567 | 29 | 0.6818 | 0.8824 | 0.7692 | 34 | 0.7177 | 0.8547 | 0.7802 | 0.9525 | |
|
| 0.1365 | 22.0 | 2332 | 0.1541 | 0.7143 | 0.8904 | 0.7927 | 73 | 0.5484 | 0.7846 | 0.6456 | 65 | 0.8434 | 0.9333 | 0.8861 | 150 | 0.6053 | 0.7931 | 0.6866 | 29 | 0.6667 | 0.8824 | 0.7595 | 34 | 0.7136 | 0.8803 | 0.7883 | 0.9518 | |
|
| 0.1356 | 23.0 | 2438 | 0.1455 | 0.7273 | 0.8767 | 0.7950 | 73 | 0.5618 | 0.7692 | 0.6494 | 65 | 0.8242 | 0.9067 | 0.8635 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7561 | 0.9118 | 0.8267 | 34 | 0.7214 | 0.8632 | 0.7860 | 0.9535 | |
|
| 0.1326 | 24.0 | 2544 | 0.1505 | 0.7065 | 0.8904 | 0.7879 | 73 | 0.5543 | 0.7846 | 0.6497 | 65 | 0.8364 | 0.92 | 0.8762 | 150 | 0.5897 | 0.7931 | 0.6765 | 29 | 0.6818 | 0.8824 | 0.7692 | 34 | 0.7106 | 0.8746 | 0.7842 | 0.9523 | |
|
| 0.13 | 25.0 | 2650 | 0.1473 | 0.7143 | 0.8904 | 0.7927 | 73 | 0.5698 | 0.7538 | 0.6490 | 65 | 0.8415 | 0.92 | 0.8790 | 150 | 0.5897 | 0.7931 | 0.6765 | 29 | 0.6818 | 0.8824 | 0.7692 | 34 | 0.7193 | 0.8689 | 0.7871 | 0.9530 | |
|
| 0.1321 | 26.0 | 2756 | 0.1409 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6104 | 0.7231 | 0.6620 | 65 | 0.8405 | 0.9133 | 0.8754 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7438 | 0.8519 | 0.7942 | 0.9552 | |
|
| 0.1272 | 27.0 | 2862 | 0.1427 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.5802 | 0.7231 | 0.6438 | 65 | 0.8476 | 0.9267 | 0.8854 | 150 | 0.6053 | 0.7931 | 0.6866 | 29 | 0.6818 | 0.8824 | 0.7692 | 34 | 0.7330 | 0.8604 | 0.7916 | 0.9547 | |
|
| 0.1278 | 28.0 | 2968 | 0.1453 | 0.7241 | 0.8630 | 0.7875 | 73 | 0.5854 | 0.7385 | 0.6531 | 65 | 0.8528 | 0.9267 | 0.8882 | 150 | 0.5526 | 0.7241 | 0.6269 | 29 | 0.6977 | 0.8824 | 0.7792 | 34 | 0.7288 | 0.8575 | 0.7880 | 0.9527 | |
|
| 0.1242 | 29.0 | 3074 | 0.1453 | 0.7209 | 0.8493 | 0.7799 | 73 | 0.5795 | 0.7846 | 0.6667 | 65 | 0.8466 | 0.92 | 0.8818 | 150 | 0.5385 | 0.7241 | 0.6176 | 29 | 0.6977 | 0.8824 | 0.7792 | 34 | 0.7208 | 0.8604 | 0.7844 | 0.9540 | |
|
| 0.1208 | 30.0 | 3180 | 0.1393 | 0.75 | 0.8630 | 0.8025 | 73 | 0.6154 | 0.7385 | 0.6713 | 65 | 0.8457 | 0.9133 | 0.8782 | 150 | 0.5676 | 0.7241 | 0.6364 | 29 | 0.75 | 0.8824 | 0.8108 | 34 | 0.7456 | 0.8519 | 0.7952 | 0.9562 | |
|
| 0.1213 | 31.0 | 3286 | 0.1461 | 0.7442 | 0.8767 | 0.8050 | 73 | 0.5484 | 0.7846 | 0.6456 | 65 | 0.8447 | 0.9067 | 0.8746 | 150 | 0.5641 | 0.7586 | 0.6471 | 29 | 0.6591 | 0.8529 | 0.7436 | 34 | 0.7139 | 0.8604 | 0.7804 | 0.9532 | |
|
| 0.1181 | 32.0 | 3392 | 0.1417 | 0.7442 | 0.8767 | 0.8050 | 73 | 0.5730 | 0.7846 | 0.6623 | 65 | 0.8519 | 0.92 | 0.8846 | 150 | 0.5526 | 0.7241 | 0.6269 | 29 | 0.725 | 0.8529 | 0.7838 | 34 | 0.7301 | 0.8632 | 0.7911 | 0.9557 | |
|
| 0.1191 | 33.0 | 3498 | 0.1410 | 0.7529 | 0.8767 | 0.8101 | 73 | 0.5618 | 0.7692 | 0.6494 | 65 | 0.8415 | 0.92 | 0.8790 | 150 | 0.5789 | 0.7586 | 0.6567 | 29 | 0.6905 | 0.8529 | 0.7632 | 34 | 0.7249 | 0.8632 | 0.7880 | 0.9555 | |
|
| 0.1156 | 34.0 | 3604 | 0.1408 | 0.7356 | 0.8767 | 0.8 | 73 | 0.5833 | 0.7538 | 0.6577 | 65 | 0.8519 | 0.92 | 0.8846 | 150 | 0.5641 | 0.7586 | 0.6471 | 29 | 0.7073 | 0.8529 | 0.7733 | 34 | 0.7312 | 0.8604 | 0.7906 | 0.9557 | |
|
| 0.1159 | 35.0 | 3710 | 0.1430 | 0.7356 | 0.8767 | 0.8 | 73 | 0.5814 | 0.7692 | 0.6623 | 65 | 0.8476 | 0.9267 | 0.8854 | 150 | 0.5641 | 0.7586 | 0.6471 | 29 | 0.6744 | 0.8529 | 0.7532 | 34 | 0.7255 | 0.8661 | 0.7896 | 0.9542 | |
|
| 0.1133 | 36.0 | 3816 | 0.1378 | 0.75 | 0.8630 | 0.8025 | 73 | 0.5833 | 0.7538 | 0.6577 | 65 | 0.8457 | 0.9133 | 0.8782 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7143 | 0.8824 | 0.7895 | 34 | 0.7359 | 0.8575 | 0.7921 | 0.9559 | |
|
| 0.1141 | 37.0 | 3922 | 0.1476 | 0.7241 | 0.8630 | 0.7875 | 73 | 0.5591 | 0.8 | 0.6582 | 65 | 0.8485 | 0.9333 | 0.8889 | 150 | 0.55 | 0.7586 | 0.6377 | 29 | 0.6591 | 0.8529 | 0.7436 | 34 | 0.7133 | 0.8718 | 0.7846 | 0.9530 | |
|
| 0.1131 | 38.0 | 4028 | 0.1364 | 0.7590 | 0.8630 | 0.8077 | 73 | 0.6104 | 0.7231 | 0.6620 | 65 | 0.8537 | 0.9333 | 0.8917 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.75 | 0.8824 | 0.8108 | 34 | 0.7531 | 0.8604 | 0.8032 | 0.9572 | |
|
| 0.1107 | 39.0 | 4134 | 0.1446 | 0.7273 | 0.8767 | 0.7950 | 73 | 0.5652 | 0.8 | 0.6624 | 65 | 0.8485 | 0.9333 | 0.8889 | 150 | 0.5641 | 0.7586 | 0.6471 | 29 | 0.6744 | 0.8529 | 0.7532 | 34 | 0.7190 | 0.8746 | 0.7892 | 0.9542 | |
|
| 0.1096 | 40.0 | 4240 | 0.1409 | 0.7241 | 0.8630 | 0.7875 | 73 | 0.5795 | 0.7846 | 0.6667 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7073 | 0.8529 | 0.7733 | 34 | 0.7361 | 0.8661 | 0.7958 | 0.9555 | |
|
| 0.1076 | 41.0 | 4346 | 0.1396 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6 | 0.7846 | 0.6800 | 65 | 0.8589 | 0.9333 | 0.8946 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7073 | 0.8529 | 0.7733 | 34 | 0.7439 | 0.8689 | 0.8016 | 0.9569 | |
|
| 0.1074 | 42.0 | 4452 | 0.1412 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.5930 | 0.7846 | 0.6755 | 65 | 0.8476 | 0.9267 | 0.8854 | 150 | 0.55 | 0.7586 | 0.6377 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7332 | 0.8689 | 0.7953 | 0.9562 | |
|
| 0.1068 | 43.0 | 4558 | 0.1361 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6267 | 0.7231 | 0.6714 | 65 | 0.8424 | 0.9267 | 0.8825 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7512 | 0.8604 | 0.8021 | 0.9584 | |
|
| 0.1067 | 44.0 | 4664 | 0.1334 | 0.7561 | 0.8493 | 0.8000 | 73 | 0.6282 | 0.7538 | 0.6853 | 65 | 0.8373 | 0.9267 | 0.8797 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7949 | 0.9118 | 0.8493 | 34 | 0.7537 | 0.8632 | 0.8048 | 0.9584 | |
|
| 0.1053 | 45.0 | 4770 | 0.1370 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6 | 0.7846 | 0.6800 | 65 | 0.8537 | 0.9333 | 0.8917 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7488 | 0.8746 | 0.8068 | 0.9579 | |
|
| 0.1028 | 46.0 | 4876 | 0.1316 | 0.7683 | 0.8630 | 0.8129 | 73 | 0.6098 | 0.7692 | 0.6803 | 65 | 0.8589 | 0.9333 | 0.8946 | 150 | 0.6389 | 0.7931 | 0.7077 | 29 | 0.7949 | 0.9118 | 0.8493 | 34 | 0.7637 | 0.8746 | 0.8154 | 0.9589 | |
|
| 0.1061 | 47.0 | 4982 | 0.1331 | 0.7590 | 0.8630 | 0.8077 | 73 | 0.6076 | 0.7385 | 0.6667 | 65 | 0.8485 | 0.9333 | 0.8889 | 150 | 0.6216 | 0.7931 | 0.6970 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7506 | 0.8661 | 0.8042 | 0.9582 | |
|
| 0.104 | 48.0 | 5088 | 0.1344 | 0.7590 | 0.8630 | 0.8077 | 73 | 0.6071 | 0.7846 | 0.6846 | 65 | 0.8537 | 0.9333 | 0.8917 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7482 | 0.8718 | 0.8053 | 0.9579 | |
|
| 0.1025 | 49.0 | 5194 | 0.1350 | 0.75 | 0.8630 | 0.8025 | 73 | 0.5882 | 0.7692 | 0.6667 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7451 | 0.8661 | 0.8011 | 0.9569 | |
|
| 0.1032 | 50.0 | 5300 | 0.1372 | 0.75 | 0.8630 | 0.8025 | 73 | 0.6125 | 0.7538 | 0.6759 | 65 | 0.8485 | 0.9333 | 0.8889 | 150 | 0.5789 | 0.7586 | 0.6567 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7451 | 0.8661 | 0.8011 | 0.9569 | |
|
| 0.0993 | 51.0 | 5406 | 0.1356 | 0.7326 | 0.8630 | 0.7925 | 73 | 0.5714 | 0.7385 | 0.6443 | 65 | 0.8415 | 0.92 | 0.8790 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7324 | 0.8575 | 0.7900 | 0.9557 | |
|
| 0.0992 | 52.0 | 5512 | 0.1370 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6486 | 0.7385 | 0.6906 | 65 | 0.8485 | 0.9333 | 0.8889 | 150 | 0.5789 | 0.7586 | 0.6567 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7519 | 0.8632 | 0.8037 | 0.9577 | |
|
| 0.0994 | 53.0 | 5618 | 0.1401 | 0.7241 | 0.8630 | 0.7875 | 73 | 0.5843 | 0.8 | 0.6753 | 65 | 0.8528 | 0.9267 | 0.8882 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7338 | 0.8718 | 0.7969 | 0.9572 | |
|
| 0.0993 | 54.0 | 5724 | 0.1364 | 0.75 | 0.8630 | 0.8025 | 73 | 0.5795 | 0.7846 | 0.6667 | 65 | 0.8528 | 0.9267 | 0.8882 | 150 | 0.6216 | 0.7931 | 0.6970 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7409 | 0.8718 | 0.8010 | 0.9567 | |
|
| 0.0971 | 55.0 | 5830 | 0.1400 | 0.7529 | 0.8767 | 0.8101 | 73 | 0.5444 | 0.7538 | 0.6323 | 65 | 0.8528 | 0.9267 | 0.8882 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7308 | 0.8661 | 0.7927 | 0.9562 | |
|
| 0.1 | 56.0 | 5936 | 0.1349 | 0.75 | 0.8630 | 0.8025 | 73 | 0.5698 | 0.7538 | 0.6490 | 65 | 0.8476 | 0.9267 | 0.8854 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7381 | 0.9118 | 0.8158 | 34 | 0.7379 | 0.8661 | 0.7969 | 0.9567 | |
|
| 0.0987 | 57.0 | 6042 | 0.1363 | 0.7326 | 0.8630 | 0.7925 | 73 | 0.6049 | 0.7538 | 0.6712 | 65 | 0.8476 | 0.9267 | 0.8854 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7426 | 0.8632 | 0.7984 | 0.9562 | |
|
| 0.0976 | 58.0 | 6148 | 0.1328 | 0.7590 | 0.8630 | 0.8077 | 73 | 0.6267 | 0.7231 | 0.6714 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7607 | 0.8604 | 0.8075 | 0.9584 | |
|
| 0.0957 | 59.0 | 6254 | 0.1330 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6184 | 0.7231 | 0.6667 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.5833 | 0.7241 | 0.6462 | 29 | 0.7561 | 0.9118 | 0.8267 | 34 | 0.7519 | 0.8547 | 0.8 | 0.9577 | |
|
| 0.0953 | 60.0 | 6360 | 0.1346 | 0.7683 | 0.8630 | 0.8129 | 73 | 0.6 | 0.7846 | 0.6800 | 65 | 0.8528 | 0.9267 | 0.8882 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7518 | 0.8718 | 0.8074 | 0.9582 | |
|
| 0.0961 | 61.0 | 6466 | 0.1299 | 0.7590 | 0.8630 | 0.8077 | 73 | 0.6494 | 0.7692 | 0.7042 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7805 | 0.9412 | 0.8533 | 34 | 0.7688 | 0.8718 | 0.8171 | 0.9591 | |
|
| 0.0951 | 62.0 | 6572 | 0.1375 | 0.7209 | 0.8493 | 0.7799 | 73 | 0.6456 | 0.7846 | 0.7083 | 65 | 0.8466 | 0.92 | 0.8818 | 150 | 0.5789 | 0.7586 | 0.6567 | 29 | 0.7317 | 0.8824 | 0.8 | 34 | 0.7445 | 0.8632 | 0.7995 | 0.9567 | |
|
| 0.0935 | 63.0 | 6678 | 0.1345 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6220 | 0.7846 | 0.6939 | 65 | 0.8476 | 0.9267 | 0.8854 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7805 | 0.9412 | 0.8533 | 34 | 0.7525 | 0.8746 | 0.8090 | 0.9567 | |
|
| 0.0932 | 64.0 | 6784 | 0.1302 | 0.775 | 0.8493 | 0.8105 | 73 | 0.64 | 0.7385 | 0.6857 | 65 | 0.8528 | 0.9267 | 0.8882 | 150 | 0.5833 | 0.7241 | 0.6462 | 29 | 0.7805 | 0.9412 | 0.8533 | 34 | 0.7646 | 0.8604 | 0.8097 | 0.9584 | |
|
| 0.0941 | 65.0 | 6890 | 0.1338 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6494 | 0.7692 | 0.7042 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.6216 | 0.7931 | 0.6970 | 29 | 0.7619 | 0.9412 | 0.8421 | 34 | 0.7612 | 0.8718 | 0.8127 | 0.9572 | |
|
| 0.0909 | 66.0 | 6996 | 0.1357 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6190 | 0.8 | 0.6980 | 65 | 0.8528 | 0.9267 | 0.8882 | 150 | 0.6053 | 0.7931 | 0.6866 | 29 | 0.7561 | 0.9118 | 0.8267 | 34 | 0.7488 | 0.8746 | 0.8068 | 0.9569 | |
|
| 0.0912 | 67.0 | 7102 | 0.1353 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6420 | 0.8 | 0.7123 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.6216 | 0.7931 | 0.6970 | 29 | 0.7619 | 0.9412 | 0.8421 | 34 | 0.7592 | 0.8803 | 0.8153 | 0.9567 | |
|
| 0.0903 | 68.0 | 7208 | 0.1336 | 0.7262 | 0.8356 | 0.7771 | 73 | 0.6711 | 0.7846 | 0.7234 | 65 | 0.8688 | 0.9267 | 0.8968 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7619 | 0.9412 | 0.8421 | 34 | 0.7644 | 0.8689 | 0.8133 | 0.9577 | |
|
| 0.0912 | 69.0 | 7314 | 0.1328 | 0.7683 | 0.8630 | 0.8129 | 73 | 0.6118 | 0.8 | 0.6933 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.6389 | 0.7931 | 0.7077 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7630 | 0.8803 | 0.8175 | 0.9579 | |
|
| 0.0902 | 70.0 | 7420 | 0.1315 | 0.7561 | 0.8493 | 0.8000 | 73 | 0.6447 | 0.7538 | 0.6950 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.6389 | 0.7931 | 0.7077 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7702 | 0.8689 | 0.8166 | 0.9582 | |
|
| 0.0908 | 71.0 | 7526 | 0.1357 | 0.7209 | 0.8493 | 0.7799 | 73 | 0.6341 | 0.8 | 0.7075 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7381 | 0.9118 | 0.8158 | 34 | 0.75 | 0.8718 | 0.8063 | 0.9567 | |
|
| 0.0897 | 72.0 | 7632 | 0.1334 | 0.7470 | 0.8493 | 0.7949 | 73 | 0.6494 | 0.7692 | 0.7042 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.5833 | 0.7241 | 0.6462 | 29 | 0.7805 | 0.9412 | 0.8533 | 34 | 0.7619 | 0.8661 | 0.8107 | 0.9574 | |
|
| 0.0896 | 73.0 | 7738 | 0.1333 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6375 | 0.7846 | 0.7034 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7618 | 0.8746 | 0.8143 | 0.9582 | |
|
| 0.0882 | 74.0 | 7844 | 0.1297 | 0.7590 | 0.8630 | 0.8077 | 73 | 0.6486 | 0.7385 | 0.6906 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7696 | 0.8661 | 0.8150 | 0.9587 | |
|
| 0.0895 | 75.0 | 7950 | 0.1331 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7694 | 0.8746 | 0.8187 | 0.9591 | |
|
| 0.0888 | 76.0 | 8056 | 0.1329 | 0.7531 | 0.8356 | 0.7922 | 73 | 0.6456 | 0.7846 | 0.7083 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.5833 | 0.7241 | 0.6462 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7657 | 0.8661 | 0.8128 | 0.9589 | |
|
| 0.0879 | 77.0 | 8162 | 0.1320 | 0.7470 | 0.8493 | 0.7949 | 73 | 0.6494 | 0.7692 | 0.7042 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7683 | 0.8689 | 0.8155 | 0.9589 | |
|
| 0.0869 | 78.0 | 8268 | 0.1333 | 0.7470 | 0.8493 | 0.7949 | 73 | 0.6494 | 0.7692 | 0.7042 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7638 | 0.8661 | 0.8117 | 0.9584 | |
|
| 0.0901 | 79.0 | 8374 | 0.1383 | 0.7412 | 0.8630 | 0.7975 | 73 | 0.6506 | 0.8308 | 0.7297 | 65 | 0.8580 | 0.9267 | 0.8910 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.7381 | 0.9118 | 0.8158 | 34 | 0.7555 | 0.8803 | 0.8132 | 0.9574 | |
|
| 0.0871 | 80.0 | 8480 | 0.1347 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6753 | 0.8 | 0.7324 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7669 | 0.8718 | 0.8160 | 0.9584 | |
|
| 0.0851 | 81.0 | 8586 | 0.1324 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6753 | 0.8 | 0.7324 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7714 | 0.8746 | 0.8198 | 0.9589 | |
|
| 0.0861 | 82.0 | 8692 | 0.1333 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6753 | 0.8 | 0.7324 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7714 | 0.8746 | 0.8198 | 0.9589 | |
|
| 0.0877 | 83.0 | 8798 | 0.1340 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6795 | 0.8154 | 0.7413 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.7949 | 0.9118 | 0.8493 | 34 | 0.7714 | 0.8746 | 0.8198 | 0.9589 | |
|
| 0.0873 | 84.0 | 8904 | 0.1332 | 0.7470 | 0.8493 | 0.7949 | 73 | 0.6667 | 0.8 | 0.7273 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7714 | 0.8746 | 0.8198 | 0.9591 | |
|
| 0.0878 | 85.0 | 9010 | 0.1356 | 0.7294 | 0.8493 | 0.7848 | 73 | 0.6795 | 0.8154 | 0.7413 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.5946 | 0.7586 | 0.6667 | 29 | 0.75 | 0.8824 | 0.8108 | 34 | 0.7631 | 0.8718 | 0.8138 | 0.9582 | |
|
| 0.0854 | 86.0 | 9116 | 0.1318 | 0.7439 | 0.8356 | 0.7871 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6389 | 0.7931 | 0.7077 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7727 | 0.8718 | 0.8193 | 0.9591 | |
|
| 0.0848 | 87.0 | 9222 | 0.1333 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6216 | 0.7931 | 0.6970 | 29 | 0.8 | 0.9412 | 0.8649 | 34 | 0.7694 | 0.8746 | 0.8187 | 0.9587 | |
|
| 0.0841 | 88.0 | 9328 | 0.1320 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7663 | 0.8689 | 0.8144 | 0.9584 | |
|
| 0.0868 | 89.0 | 9434 | 0.1321 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7663 | 0.8689 | 0.8144 | 0.9589 | |
|
| 0.0844 | 90.0 | 9540 | 0.1318 | 0.7349 | 0.8356 | 0.7821 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7657 | 0.8661 | 0.8128 | 0.9587 | |
|
| 0.0838 | 91.0 | 9646 | 0.1326 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6667 | 0.8 | 0.7273 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7669 | 0.8718 | 0.8160 | 0.9591 | |
|
| 0.0866 | 92.0 | 9752 | 0.1332 | 0.7381 | 0.8493 | 0.7898 | 73 | 0.6667 | 0.8 | 0.7273 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7669 | 0.8718 | 0.8160 | 0.9589 | |
|
| 0.085 | 93.0 | 9858 | 0.1317 | 0.7439 | 0.8356 | 0.7871 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7677 | 0.8661 | 0.8139 | 0.9589 | |
|
| 0.084 | 94.0 | 9964 | 0.1322 | 0.7349 | 0.8356 | 0.7821 | 73 | 0.6667 | 0.8 | 0.7273 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7663 | 0.8689 | 0.8144 | 0.9589 | |
|
| 0.0838 | 95.0 | 10070 | 0.1319 | 0.7349 | 0.8356 | 0.7821 | 73 | 0.6667 | 0.8 | 0.7273 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7663 | 0.8689 | 0.8144 | 0.9587 | |
|
| 0.087 | 96.0 | 10176 | 0.1328 | 0.7349 | 0.8356 | 0.7821 | 73 | 0.6667 | 0.8 | 0.7273 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7663 | 0.8689 | 0.8144 | 0.9584 | |
|
| 0.0832 | 97.0 | 10282 | 0.1314 | 0.7439 | 0.8356 | 0.7871 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7677 | 0.8661 | 0.8139 | 0.9587 | |
|
| 0.0859 | 98.0 | 10388 | 0.1315 | 0.7439 | 0.8356 | 0.7871 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7677 | 0.8661 | 0.8139 | 0.9587 | |
|
| 0.0838 | 99.0 | 10494 | 0.1318 | 0.7349 | 0.8356 | 0.7821 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7657 | 0.8661 | 0.8128 | 0.9587 | |
|
| 0.0849 | 100.0 | 10600 | 0.1318 | 0.7349 | 0.8356 | 0.7821 | 73 | 0.6623 | 0.7846 | 0.7183 | 65 | 0.8634 | 0.9267 | 0.8939 | 150 | 0.6111 | 0.7586 | 0.6769 | 29 | 0.775 | 0.9118 | 0.8378 | 34 | 0.7657 | 0.8661 | 0.8128 | 0.9587 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.39.3 |
|
- Pytorch 2.3.0+cu121 |
|
- Datasets 2.19.1 |
|
- Tokenizers 0.15.2 |
|
|
