--- language: - id license: mit base_model: indolem/indobert-base-uncased tags: - generated_from_trainer model-index: - name: nerugm-pt-pl30-1 results: [] --- # nerugm-pt-pl30-1 This model is a fine-tuned version of [indolem/indobert-base-uncased](https://huggingface.co./indolem/indobert-base-uncased) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.1730 - Location Precision: 0.7895 - Location Recall: 0.8696 - Location F1: 0.8276 - Location Number: 69 - Organization Precision: 0.6173 - Organization Recall: 0.8197 - Organization F1: 0.7042 - Organization Number: 61 - Person Precision: 0.8720 - Person Recall: 0.9346 - Person F1: 0.9022 - Person Number: 153 - Quantity Precision: 0.7429 - Quantity Recall: 0.8125 - Quantity F1: 0.7761 - Quantity Number: 32 - Time Precision: 0.8485 - Time Recall: 0.9032 - Time F1: 0.875 - Time Number: 31 - Overall Precision: 0.7892 - Overall Recall: 0.8873 - Overall F1: 0.8354 - Overall Accuracy: 0.9636 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 5e-05 - train_batch_size: 16 - eval_batch_size: 64 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 100.0 ### Training results | Training Loss | Epoch | Step | Validation Loss | Location Precision | Location Recall | Location F1 | Location Number | Organization Precision | Organization Recall | Organization F1 | Organization Number | Person Precision | Person Recall | Person F1 | Person Number | Quantity Precision | Quantity Recall | Quantity F1 | Quantity Number | Time Precision | Time Recall | Time F1 | Time Number | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy | |:-------------:|:-----:|:-----:|:---------------:|:------------------:|:---------------:|:-----------:|:---------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:-------------:|:---------:|:-------------:|:------------------:|:---------------:|:-----------:|:---------------:|:--------------:|:-----------:|:-------:|:-----------:|:-----------------:|:--------------:|:----------:|:----------------:| | 0.9884 | 1.0 | 106 | 0.5702 | 0.0 | 0.0 | 0.0 | 69 | 0.0 | 0.0 | 0.0 | 61 | 0.1852 | 0.0327 | 0.0556 | 153 | 0.0 | 0.0 | 0.0 | 32 | 0.0 | 0.0 | 0.0 | 31 | 0.1220 | 0.0145 | 0.0258 | 0.8395 | | 0.4955 | 2.0 | 212 | 0.3472 | 0.4483 | 0.1884 | 0.2653 | 69 | 0.0333 | 0.0164 | 0.0220 | 61 | 0.4696 | 0.7582 | 0.5800 | 153 | 0.0 | 0.0 | 0.0 | 32 | 0.3077 | 0.2581 | 0.2807 | 31 | 0.4095 | 0.3988 | 0.4041 | 0.8935 | | 0.3135 | 3.0 | 318 | 0.2126 | 0.5745 | 0.7826 | 0.6626 | 69 | 0.3733 | 0.4590 | 0.4118 | 61 | 0.7624 | 0.9020 | 0.8263 | 153 | 0.4565 | 0.6562 | 0.5385 | 32 | 0.7222 | 0.8387 | 0.7761 | 31 | 0.6181 | 0.7717 | 0.6864 | 0.9329 | | 0.2135 | 4.0 | 424 | 0.1868 | 0.58 | 0.8406 | 0.6864 | 69 | 0.4588 | 0.6393 | 0.5342 | 61 | 0.8150 | 0.9216 | 0.8650 | 153 | 0.4314 | 0.6875 | 0.5301 | 32 | 0.5909 | 0.8387 | 0.6933 | 31 | 0.6313 | 0.8266 | 0.7159 | 0.9363 | | 0.1776 | 5.0 | 530 | 0.1490 | 0.6867 | 0.8261 | 0.75 | 69 | 0.5269 | 0.8033 | 0.6364 | 61 | 0.8161 | 0.9281 | 0.8685 | 153 | 0.6 | 0.75 | 0.6667 | 32 | 0.8966 | 0.8387 | 0.8667 | 31 | 0.7112 | 0.8613 | 0.7791 | 0.9510 | | 0.1582 | 6.0 | 636 | 0.1369 | 0.6484 | 0.8551 | 0.7375 | 69 | 0.5341 | 0.7705 | 0.6309 | 61 | 0.8314 | 0.9346 | 0.8800 | 153 | 0.6 | 0.75 | 0.6667 | 32 | 0.8 | 0.9032 | 0.8485 | 31 | 0.7066 | 0.8699 | 0.7798 | 0.9559 | | 0.1452 | 7.0 | 742 | 0.1393 | 0.7195 | 0.8551 | 0.7815 | 69 | 0.5402 | 0.7705 | 0.6351 | 61 | 0.8353 | 0.9281 | 0.8793 | 153 | 0.6 | 0.8438 | 0.7013 | 32 | 0.8 | 0.9032 | 0.8485 | 31 | 0.7232 | 0.8757 | 0.7922 | 0.9549 | | 0.1352 | 8.0 | 848 | 0.1316 | 0.7467 | 0.8116 | 0.7778 | 69 | 0.5732 | 0.7705 | 0.6573 | 61 | 0.8512 | 0.9346 | 0.8910 | 153 | 0.6410 | 0.7812 | 0.7042 | 32 | 0.6667 | 0.8387 | 0.7429 | 31 | 0.7370 | 0.8584 | 0.7931 | 0.9567 | | 0.1268 | 9.0 | 954 | 0.1275 | 0.7195 | 0.8551 | 0.7815 | 69 | 0.5658 | 0.7049 | 0.6277 | 61 | 0.8402 | 0.9281 | 0.8820 | 153 | 0.6579 | 0.7812 | 0.7143 | 32 | 0.7027 | 0.8387 | 0.7647 | 31 | 0.7338 | 0.8526 | 0.7888 | 0.9564 | | 0.1197 | 10.0 | 1060 | 0.1243 | 0.75 | 0.8696 | 0.8054 | 69 | 0.6053 | 0.7541 | 0.6715 | 61 | 0.8494 | 0.9216 | 0.8840 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.6842 | 0.8387 | 0.7536 | 31 | 0.7475 | 0.8642 | 0.8016 | 0.9581 | | 0.1149 | 11.0 | 1166 | 0.1298 | 0.75 | 0.8696 | 0.8054 | 69 | 0.5854 | 0.7869 | 0.6713 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.6 | 0.8438 | 0.7013 | 32 | 0.8 | 0.9032 | 0.8485 | 31 | 0.7512 | 0.8815 | 0.8112 | 0.9579 | | 0.1074 | 12.0 | 1272 | 0.1298 | 0.8 | 0.8696 | 0.8333 | 69 | 0.5875 | 0.7705 | 0.6667 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.6279 | 0.8438 | 0.72 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7702 | 0.8815 | 0.8221 | 0.9584 | | 0.1021 | 13.0 | 1378 | 0.1449 | 0.7564 | 0.8551 | 0.8027 | 69 | 0.53 | 0.8689 | 0.6584 | 61 | 0.8521 | 0.9412 | 0.8944 | 153 | 0.675 | 0.8438 | 0.75 | 32 | 0.6923 | 0.8710 | 0.7714 | 31 | 0.7277 | 0.8960 | 0.8031 | 0.9542 | | 0.1 | 14.0 | 1484 | 0.1380 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.5833 | 0.8033 | 0.6759 | 61 | 0.8667 | 0.9346 | 0.8994 | 153 | 0.6429 | 0.8438 | 0.7297 | 32 | 0.675 | 0.8710 | 0.7606 | 31 | 0.7518 | 0.8844 | 0.8127 | 0.9564 | | 0.0956 | 15.0 | 1590 | 0.1301 | 0.7532 | 0.8406 | 0.7945 | 69 | 0.6486 | 0.7869 | 0.7111 | 61 | 0.8834 | 0.9412 | 0.9114 | 153 | 0.675 | 0.8438 | 0.75 | 32 | 0.7429 | 0.8387 | 0.7879 | 31 | 0.7789 | 0.8757 | 0.8245 | 0.9599 | | 0.0952 | 16.0 | 1696 | 0.1324 | 0.7375 | 0.8551 | 0.7919 | 69 | 0.5926 | 0.7869 | 0.6761 | 61 | 0.8631 | 0.9477 | 0.9034 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.8710 | 0.8710 | 0.8710 | 31 | 0.7663 | 0.8815 | 0.8199 | 0.9596 | | 0.09 | 17.0 | 1802 | 0.1328 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.5862 | 0.8361 | 0.6892 | 61 | 0.8765 | 0.9281 | 0.9016 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.7568 | 0.9032 | 0.8235 | 31 | 0.7681 | 0.8902 | 0.8246 | 0.9591 | | 0.0862 | 18.0 | 1908 | 0.1255 | 0.7532 | 0.8406 | 0.7945 | 69 | 0.6389 | 0.7541 | 0.6917 | 61 | 0.8951 | 0.9477 | 0.9206 | 153 | 0.675 | 0.8438 | 0.75 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7829 | 0.8757 | 0.8267 | 0.9614 | | 0.0825 | 19.0 | 2014 | 0.1247 | 0.76 | 0.8261 | 0.7917 | 69 | 0.6538 | 0.8361 | 0.7338 | 61 | 0.8667 | 0.9346 | 0.8994 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7778 | 0.9032 | 0.8358 | 31 | 0.7781 | 0.8815 | 0.8266 | 0.9614 | | 0.0814 | 20.0 | 2120 | 0.1330 | 0.7973 | 0.8551 | 0.8252 | 69 | 0.5833 | 0.8033 | 0.6759 | 61 | 0.8795 | 0.9542 | 0.9154 | 153 | 0.6923 | 0.8438 | 0.7606 | 32 | 0.7027 | 0.8387 | 0.7647 | 31 | 0.7675 | 0.8873 | 0.8231 | 0.9589 | | 0.0782 | 21.0 | 2226 | 0.1432 | 0.7375 | 0.8551 | 0.7919 | 69 | 0.6184 | 0.7705 | 0.6861 | 61 | 0.8683 | 0.9477 | 0.9062 | 153 | 0.6098 | 0.7812 | 0.6849 | 32 | 0.7027 | 0.8387 | 0.7647 | 31 | 0.7531 | 0.8728 | 0.8086 | 0.9564 | | 0.0799 | 22.0 | 2332 | 0.1451 | 0.7848 | 0.8986 | 0.8378 | 69 | 0.5354 | 0.8689 | 0.6625 | 61 | 0.8727 | 0.9412 | 0.9057 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7464 | 0.9017 | 0.8168 | 0.9557 | | 0.0756 | 23.0 | 2438 | 0.1407 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.6076 | 0.7869 | 0.6857 | 61 | 0.8650 | 0.9216 | 0.8924 | 153 | 0.6098 | 0.7812 | 0.6849 | 32 | 0.7222 | 0.8387 | 0.7761 | 31 | 0.7634 | 0.8671 | 0.8119 | 0.9574 | | 0.0711 | 24.0 | 2544 | 0.1331 | 0.7733 | 0.8406 | 0.8056 | 69 | 0.6098 | 0.8197 | 0.6993 | 61 | 0.8735 | 0.9477 | 0.9091 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.7429 | 0.8387 | 0.7879 | 31 | 0.7722 | 0.8815 | 0.8232 | 0.9594 | | 0.0715 | 25.0 | 2650 | 0.1326 | 0.775 | 0.8986 | 0.8322 | 69 | 0.6024 | 0.8197 | 0.6944 | 61 | 0.9006 | 0.9477 | 0.9236 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.7568 | 0.9032 | 0.8235 | 31 | 0.7794 | 0.8988 | 0.8349 | 0.9623 | | 0.0699 | 26.0 | 2756 | 0.1396 | 0.7595 | 0.8696 | 0.8108 | 69 | 0.6296 | 0.8361 | 0.7183 | 61 | 0.8675 | 0.9412 | 0.9028 | 153 | 0.6098 | 0.7812 | 0.6849 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7669 | 0.8844 | 0.8215 | 0.9594 | | 0.064 | 27.0 | 2862 | 0.1338 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6447 | 0.8033 | 0.7153 | 61 | 0.8683 | 0.9477 | 0.9062 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.75 | 0.8710 | 0.8060 | 31 | 0.7872 | 0.8873 | 0.8342 | 0.9628 | | 0.066 | 28.0 | 2968 | 0.1395 | 0.7848 | 0.8986 | 0.8378 | 69 | 0.6316 | 0.5902 | 0.6102 | 61 | 0.8896 | 0.9477 | 0.9177 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.6923 | 0.8710 | 0.7714 | 31 | 0.7899 | 0.8584 | 0.8227 | 0.9606 | | 0.0643 | 29.0 | 3074 | 0.1434 | 0.7625 | 0.8841 | 0.8188 | 69 | 0.6220 | 0.8361 | 0.7133 | 61 | 0.8735 | 0.9477 | 0.9091 | 153 | 0.75 | 0.8438 | 0.7941 | 32 | 0.7222 | 0.8387 | 0.7761 | 31 | 0.775 | 0.8960 | 0.8311 | 0.9614 | | 0.0613 | 30.0 | 3180 | 0.1416 | 0.7922 | 0.8841 | 0.8356 | 69 | 0.5904 | 0.8033 | 0.6806 | 61 | 0.8834 | 0.9412 | 0.9114 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.7879 | 0.8387 | 0.8125 | 31 | 0.7852 | 0.8873 | 0.8331 | 0.9621 | | 0.0611 | 31.0 | 3286 | 0.1443 | 0.7692 | 0.8696 | 0.8163 | 69 | 0.6184 | 0.7705 | 0.6861 | 61 | 0.8944 | 0.9412 | 0.9172 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.7647 | 0.8387 | 0.8000 | 31 | 0.7850 | 0.8757 | 0.8279 | 0.9601 | | 0.0594 | 32.0 | 3392 | 0.1368 | 0.7692 | 0.8696 | 0.8163 | 69 | 0.6329 | 0.8197 | 0.7143 | 61 | 0.8788 | 0.9477 | 0.9119 | 153 | 0.6579 | 0.7812 | 0.7143 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7772 | 0.8873 | 0.8286 | 0.9616 | | 0.0591 | 33.0 | 3498 | 0.1401 | 0.775 | 0.8986 | 0.8322 | 69 | 0.6479 | 0.7541 | 0.6970 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7891 | 0.8757 | 0.8301 | 0.9623 | | 0.0586 | 34.0 | 3604 | 0.1381 | 0.7821 | 0.8841 | 0.8299 | 69 | 0.625 | 0.8197 | 0.7092 | 61 | 0.8889 | 0.9412 | 0.9143 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7923 | 0.8931 | 0.8397 | 0.9631 | | 0.0557 | 35.0 | 3710 | 0.1449 | 0.7654 | 0.8986 | 0.8267 | 69 | 0.5610 | 0.7541 | 0.6434 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7677 | 0.8786 | 0.8194 | 0.9596 | | 0.055 | 36.0 | 3816 | 0.1479 | 0.7821 | 0.8841 | 0.8299 | 69 | 0.5529 | 0.7705 | 0.6438 | 61 | 0.8820 | 0.9281 | 0.9045 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.7568 | 0.9032 | 0.8235 | 31 | 0.7638 | 0.8786 | 0.8172 | 0.9594 | | 0.0549 | 37.0 | 3922 | 0.1484 | 0.7821 | 0.8841 | 0.8299 | 69 | 0.6024 | 0.8197 | 0.6944 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.6579 | 0.7812 | 0.7143 | 32 | 0.7778 | 0.9032 | 0.8358 | 31 | 0.7719 | 0.8902 | 0.8268 | 0.9606 | | 0.0516 | 38.0 | 4028 | 0.1517 | 0.7821 | 0.8841 | 0.8299 | 69 | 0.6486 | 0.7869 | 0.7111 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.6667 | 0.8125 | 0.7324 | 32 | 0.7714 | 0.8710 | 0.8182 | 31 | 0.7846 | 0.8844 | 0.8315 | 0.9621 | | 0.0525 | 39.0 | 4134 | 0.1387 | 0.7922 | 0.8841 | 0.8356 | 69 | 0.6267 | 0.7705 | 0.6912 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.6757 | 0.7812 | 0.7246 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7902 | 0.8815 | 0.8333 | 0.9643 | | 0.0493 | 40.0 | 4240 | 0.1406 | 0.7922 | 0.8841 | 0.8356 | 69 | 0.6184 | 0.7705 | 0.6861 | 61 | 0.8834 | 0.9412 | 0.9114 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.7297 | 0.8710 | 0.7941 | 31 | 0.7841 | 0.8815 | 0.8299 | 0.9628 | | 0.0498 | 41.0 | 4346 | 0.1392 | 0.8026 | 0.8841 | 0.8414 | 69 | 0.6329 | 0.8197 | 0.7143 | 61 | 0.8727 | 0.9412 | 0.9057 | 153 | 0.7027 | 0.8125 | 0.7536 | 32 | 0.8710 | 0.8710 | 0.8710 | 31 | 0.7938 | 0.8902 | 0.8392 | 0.9631 | | 0.048 | 42.0 | 4452 | 0.1464 | 0.8133 | 0.8841 | 0.8472 | 69 | 0.5854 | 0.7869 | 0.6713 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.6944 | 0.7812 | 0.7353 | 32 | 0.7812 | 0.8065 | 0.7937 | 31 | 0.7758 | 0.8699 | 0.8202 | 0.9599 | | 0.0514 | 43.0 | 4558 | 0.1435 | 0.7308 | 0.8261 | 0.7755 | 69 | 0.6316 | 0.7869 | 0.7007 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7143 | 0.7812 | 0.7463 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7760 | 0.8613 | 0.8164 | 0.9596 | | 0.0482 | 44.0 | 4664 | 0.1486 | 0.7654 | 0.8986 | 0.8267 | 69 | 0.625 | 0.8197 | 0.7092 | 61 | 0.8727 | 0.9412 | 0.9057 | 153 | 0.6944 | 0.7812 | 0.7353 | 32 | 0.7429 | 0.8387 | 0.7879 | 31 | 0.7733 | 0.8873 | 0.8264 | 0.9604 | | 0.0453 | 45.0 | 4770 | 0.1501 | 0.7692 | 0.8696 | 0.8163 | 69 | 0.6125 | 0.8033 | 0.6950 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.6857 | 0.75 | 0.7164 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7763 | 0.8728 | 0.8218 | 0.9596 | | 0.0444 | 46.0 | 4876 | 0.1433 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.6 | 0.7869 | 0.6809 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.6757 | 0.7812 | 0.7246 | 32 | 0.8710 | 0.8710 | 0.8710 | 31 | 0.7835 | 0.8786 | 0.8283 | 0.9633 | | 0.0428 | 47.0 | 4982 | 0.1480 | 0.7821 | 0.8841 | 0.8299 | 69 | 0.5679 | 0.7541 | 0.6479 | 61 | 0.8773 | 0.9346 | 0.9051 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7763 | 0.8728 | 0.8218 | 0.9616 | | 0.0416 | 48.0 | 5088 | 0.1479 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.6184 | 0.7705 | 0.6861 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.65 | 0.8125 | 0.7222 | 32 | 0.8387 | 0.8387 | 0.8387 | 31 | 0.7809 | 0.8757 | 0.8256 | 0.9619 | | 0.0434 | 49.0 | 5194 | 0.1513 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6104 | 0.7705 | 0.6812 | 61 | 0.8667 | 0.9346 | 0.8994 | 153 | 0.7105 | 0.8438 | 0.7714 | 32 | 0.7778 | 0.9032 | 0.8358 | 31 | 0.7801 | 0.8815 | 0.8277 | 0.9619 | | 0.0421 | 50.0 | 5300 | 0.1492 | 0.7821 | 0.8841 | 0.8299 | 69 | 0.6234 | 0.7869 | 0.6957 | 61 | 0.8727 | 0.9412 | 0.9057 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7861 | 0.8815 | 0.8311 | 0.9614 | | 0.0423 | 51.0 | 5406 | 0.1473 | 0.8026 | 0.8841 | 0.8414 | 69 | 0.6296 | 0.8361 | 0.7183 | 61 | 0.8788 | 0.9477 | 0.9119 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8438 | 0.8710 | 0.8571 | 31 | 0.7949 | 0.8960 | 0.8424 | 0.9646 | | 0.0421 | 52.0 | 5512 | 0.1539 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.5833 | 0.8033 | 0.6759 | 61 | 0.8773 | 0.9346 | 0.9051 | 153 | 0.75 | 0.8438 | 0.7941 | 32 | 0.8387 | 0.8387 | 0.8387 | 31 | 0.7821 | 0.8815 | 0.8288 | 0.9614 | | 0.0415 | 53.0 | 5618 | 0.1545 | 0.7662 | 0.8551 | 0.8082 | 69 | 0.5854 | 0.7869 | 0.6713 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7775 | 0.8786 | 0.8250 | 0.9621 | | 0.0396 | 54.0 | 5724 | 0.1586 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.5952 | 0.8197 | 0.6897 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7755 | 0.8786 | 0.8238 | 0.9631 | | 0.0375 | 55.0 | 5830 | 0.1563 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.6 | 0.7869 | 0.6809 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.7647 | 0.8387 | 0.8000 | 31 | 0.7763 | 0.8728 | 0.8218 | 0.9601 | | 0.0379 | 56.0 | 5936 | 0.1533 | 0.7867 | 0.8551 | 0.8194 | 69 | 0.5679 | 0.7541 | 0.6479 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7297 | 0.8438 | 0.7826 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7732 | 0.8671 | 0.8174 | 0.9614 | | 0.0354 | 57.0 | 6042 | 0.1612 | 0.7922 | 0.8841 | 0.8356 | 69 | 0.5897 | 0.7541 | 0.6619 | 61 | 0.8667 | 0.9346 | 0.8994 | 153 | 0.6842 | 0.8125 | 0.7429 | 32 | 0.8438 | 0.8710 | 0.8571 | 31 | 0.7769 | 0.8757 | 0.8234 | 0.9604 | | 0.0363 | 58.0 | 6148 | 0.1525 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.5663 | 0.7705 | 0.6528 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.75 | 0.8438 | 0.7941 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7749 | 0.8757 | 0.8223 | 0.9623 | | 0.0333 | 59.0 | 6254 | 0.1588 | 0.7722 | 0.8841 | 0.8243 | 69 | 0.6104 | 0.7705 | 0.6812 | 61 | 0.8727 | 0.9412 | 0.9057 | 153 | 0.7143 | 0.7812 | 0.7463 | 32 | 0.7879 | 0.8387 | 0.8125 | 31 | 0.7789 | 0.8757 | 0.8245 | 0.9619 | | 0.0352 | 60.0 | 6360 | 0.1654 | 0.7625 | 0.8841 | 0.8188 | 69 | 0.5647 | 0.7869 | 0.6575 | 61 | 0.8773 | 0.9346 | 0.9051 | 153 | 0.7353 | 0.7812 | 0.7576 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7696 | 0.8786 | 0.8205 | 0.9611 | | 0.035 | 61.0 | 6466 | 0.1560 | 0.7838 | 0.8406 | 0.8112 | 69 | 0.5875 | 0.7705 | 0.6667 | 61 | 0.8667 | 0.9346 | 0.8994 | 153 | 0.7576 | 0.7812 | 0.7692 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7792 | 0.8671 | 0.8208 | 0.9619 | | 0.0326 | 62.0 | 6572 | 0.1644 | 0.7922 | 0.8841 | 0.8356 | 69 | 0.5783 | 0.7869 | 0.6667 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.7353 | 0.7812 | 0.7576 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7755 | 0.8786 | 0.8238 | 0.9619 | | 0.0329 | 63.0 | 6678 | 0.1641 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6 | 0.7869 | 0.6809 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.7143 | 0.7812 | 0.7463 | 32 | 0.7568 | 0.9032 | 0.8235 | 31 | 0.7749 | 0.8757 | 0.8223 | 0.9616 | | 0.0335 | 64.0 | 6784 | 0.1627 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.6125 | 0.8033 | 0.6950 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7861 | 0.8815 | 0.8311 | 0.9638 | | 0.0322 | 65.0 | 6890 | 0.1623 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.5949 | 0.7705 | 0.6714 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7809 | 0.8757 | 0.8256 | 0.9621 | | 0.0332 | 66.0 | 6996 | 0.1601 | 0.8026 | 0.8841 | 0.8414 | 69 | 0.6049 | 0.8033 | 0.6901 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.75 | 0.8438 | 0.7941 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7872 | 0.8873 | 0.8342 | 0.9631 | | 0.0327 | 67.0 | 7102 | 0.1585 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6125 | 0.8033 | 0.6950 | 61 | 0.8765 | 0.9281 | 0.9016 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8438 | 0.8710 | 0.8571 | 31 | 0.7917 | 0.8786 | 0.8329 | 0.9616 | | 0.0327 | 68.0 | 7208 | 0.1642 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.6098 | 0.8197 | 0.6993 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7857 | 0.8902 | 0.8347 | 0.9626 | | 0.0331 | 69.0 | 7314 | 0.1594 | 0.8219 | 0.8696 | 0.8451 | 69 | 0.6234 | 0.7869 | 0.6957 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.6944 | 0.7812 | 0.7353 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7891 | 0.8757 | 0.8301 | 0.9619 | | 0.0311 | 70.0 | 7420 | 0.1673 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6026 | 0.7705 | 0.6763 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.6944 | 0.7812 | 0.7353 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7824 | 0.8728 | 0.8251 | 0.9606 | | 0.0302 | 71.0 | 7526 | 0.1654 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.6049 | 0.8033 | 0.6901 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7861 | 0.8815 | 0.8311 | 0.9626 | | 0.0276 | 72.0 | 7632 | 0.1676 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6125 | 0.8033 | 0.6950 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.7143 | 0.7812 | 0.7463 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7876 | 0.8786 | 0.8306 | 0.9636 | | 0.0304 | 73.0 | 7738 | 0.1573 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.6026 | 0.7705 | 0.6763 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7143 | 0.7812 | 0.7463 | 32 | 0.875 | 0.9032 | 0.8889 | 31 | 0.7911 | 0.8757 | 0.8313 | 0.9651 | | 0.029 | 74.0 | 7844 | 0.1682 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6 | 0.7869 | 0.6809 | 61 | 0.8765 | 0.9281 | 0.9016 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8387 | 0.8387 | 0.8387 | 31 | 0.7885 | 0.8728 | 0.8285 | 0.9626 | | 0.0293 | 75.0 | 7950 | 0.1699 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.6 | 0.7869 | 0.6809 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7855 | 0.8786 | 0.8295 | 0.9623 | | 0.0292 | 76.0 | 8056 | 0.1714 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.6098 | 0.8197 | 0.6993 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7852 | 0.8873 | 0.8331 | 0.9626 | | 0.0292 | 77.0 | 8162 | 0.1613 | 0.8 | 0.8696 | 0.8333 | 69 | 0.5949 | 0.7705 | 0.6714 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.7353 | 0.7812 | 0.7576 | 32 | 0.8710 | 0.8710 | 0.8710 | 31 | 0.7859 | 0.8699 | 0.8258 | 0.9631 | | 0.0259 | 78.0 | 8268 | 0.1647 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.6154 | 0.7869 | 0.6906 | 61 | 0.8773 | 0.9346 | 0.9051 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8529 | 0.9355 | 0.8923 | 31 | 0.7907 | 0.8844 | 0.8349 | 0.9638 | | 0.0274 | 79.0 | 8374 | 0.1649 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6104 | 0.7705 | 0.6812 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.7353 | 0.7812 | 0.7576 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7906 | 0.8728 | 0.8297 | 0.9636 | | 0.0269 | 80.0 | 8480 | 0.1669 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.5875 | 0.7705 | 0.6667 | 61 | 0.8780 | 0.9412 | 0.9085 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7815 | 0.8786 | 0.8272 | 0.9636 | | 0.028 | 81.0 | 8586 | 0.1671 | 0.7792 | 0.8696 | 0.8219 | 69 | 0.5949 | 0.7705 | 0.6714 | 61 | 0.8614 | 0.9346 | 0.8966 | 153 | 0.7059 | 0.75 | 0.7273 | 32 | 0.8 | 0.9032 | 0.8485 | 31 | 0.7724 | 0.8728 | 0.8195 | 0.9621 | | 0.0279 | 82.0 | 8692 | 0.1679 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.6098 | 0.8197 | 0.6993 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.7143 | 0.7812 | 0.7463 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7775 | 0.8786 | 0.8250 | 0.9623 | | 0.0258 | 83.0 | 8798 | 0.1649 | 0.8219 | 0.8696 | 0.8451 | 69 | 0.625 | 0.8197 | 0.7092 | 61 | 0.8773 | 0.9346 | 0.9051 | 153 | 0.7647 | 0.8125 | 0.7879 | 32 | 0.875 | 0.9032 | 0.8889 | 31 | 0.8037 | 0.8873 | 0.8434 | 0.9643 | | 0.0272 | 84.0 | 8904 | 0.1686 | 0.8 | 0.8696 | 0.8333 | 69 | 0.625 | 0.8197 | 0.7092 | 61 | 0.8773 | 0.9346 | 0.9051 | 153 | 0.7143 | 0.7812 | 0.7463 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7907 | 0.8844 | 0.8349 | 0.9636 | | 0.0261 | 85.0 | 9010 | 0.1691 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6173 | 0.8197 | 0.7042 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7866 | 0.8844 | 0.8327 | 0.9641 | | 0.0254 | 86.0 | 9116 | 0.1746 | 0.7821 | 0.8841 | 0.8299 | 69 | 0.5926 | 0.7869 | 0.6761 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7222 | 0.8125 | 0.7647 | 32 | 0.7941 | 0.8710 | 0.8308 | 31 | 0.7761 | 0.8815 | 0.8254 | 0.9623 | | 0.028 | 87.0 | 9222 | 0.1669 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.5854 | 0.7869 | 0.6713 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.875 | 0.9032 | 0.8889 | 31 | 0.7902 | 0.8815 | 0.8333 | 0.9648 | | 0.0244 | 88.0 | 9328 | 0.1714 | 0.8026 | 0.8841 | 0.8414 | 69 | 0.6049 | 0.8033 | 0.6901 | 61 | 0.8773 | 0.9346 | 0.9051 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8438 | 0.8710 | 0.8571 | 31 | 0.7907 | 0.8844 | 0.8349 | 0.9636 | | 0.0241 | 89.0 | 9434 | 0.1706 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.5802 | 0.7705 | 0.6620 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7353 | 0.7812 | 0.7576 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7844 | 0.8728 | 0.8263 | 0.9631 | | 0.0243 | 90.0 | 9540 | 0.1695 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.5897 | 0.7541 | 0.6619 | 61 | 0.8712 | 0.9281 | 0.8987 | 153 | 0.7353 | 0.7812 | 0.7576 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7848 | 0.8642 | 0.8226 | 0.9628 | | 0.0275 | 91.0 | 9646 | 0.1680 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.5854 | 0.7869 | 0.6713 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8125 | 0.8387 | 0.8254 | 31 | 0.7829 | 0.8757 | 0.8267 | 0.9638 | | 0.0255 | 92.0 | 9752 | 0.1681 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6173 | 0.8197 | 0.7042 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8387 | 0.8387 | 0.8387 | 31 | 0.7876 | 0.8786 | 0.8306 | 0.9633 | | 0.0263 | 93.0 | 9858 | 0.1713 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6098 | 0.8197 | 0.6993 | 61 | 0.8659 | 0.9281 | 0.8959 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.8387 | 0.8387 | 0.8387 | 31 | 0.7881 | 0.8815 | 0.8322 | 0.9633 | | 0.0241 | 94.0 | 9964 | 0.1685 | 0.8 | 0.8696 | 0.8333 | 69 | 0.5854 | 0.7869 | 0.6713 | 61 | 0.8606 | 0.9281 | 0.8931 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.8387 | 0.8387 | 0.8387 | 31 | 0.7809 | 0.8757 | 0.8256 | 0.9636 | | 0.0226 | 95.0 | 10070 | 0.1730 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.6098 | 0.8197 | 0.6993 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.8182 | 0.8710 | 0.8438 | 31 | 0.7872 | 0.8873 | 0.8342 | 0.9641 | | 0.0255 | 96.0 | 10176 | 0.1723 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.5904 | 0.8033 | 0.6806 | 61 | 0.8667 | 0.9346 | 0.8994 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7786 | 0.8844 | 0.8281 | 0.9633 | | 0.0235 | 97.0 | 10282 | 0.1719 | 0.8108 | 0.8696 | 0.8392 | 69 | 0.6173 | 0.8197 | 0.7042 | 61 | 0.8667 | 0.9346 | 0.8994 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.8235 | 0.9032 | 0.8615 | 31 | 0.7918 | 0.8902 | 0.8381 | 0.9646 | | 0.0247 | 98.0 | 10388 | 0.1728 | 0.8 | 0.8696 | 0.8333 | 69 | 0.6173 | 0.8197 | 0.7042 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7714 | 0.8438 | 0.8060 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7938 | 0.8902 | 0.8392 | 0.9643 | | 0.0249 | 99.0 | 10494 | 0.1731 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.6173 | 0.8197 | 0.7042 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7892 | 0.8873 | 0.8354 | 0.9636 | | 0.0219 | 100.0 | 10600 | 0.1730 | 0.7895 | 0.8696 | 0.8276 | 69 | 0.6173 | 0.8197 | 0.7042 | 61 | 0.8720 | 0.9346 | 0.9022 | 153 | 0.7429 | 0.8125 | 0.7761 | 32 | 0.8485 | 0.9032 | 0.875 | 31 | 0.7892 | 0.8873 | 0.8354 | 0.9636 | ### Framework versions - Transformers 4.39.3 - Pytorch 2.3.0+cu121 - Datasets 2.19.1 - Tokenizers 0.15.2