nerui-pt-pl30-1 / README.md
apwic's picture
End of training
b2c1429 verified
|
raw
history blame
36.4 kB
metadata
language:
  - id
license: mit
base_model: indolem/indobert-base-uncased
tags:
  - generated_from_trainer
model-index:
  - name: nerui-pt-pl30-1
    results: []

nerui-pt-pl30-1

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0541
  • Location Precision: 0.9244
  • Location Recall: 0.9483
  • Location F1: 0.9362
  • Location Number: 116
  • Organization Precision: 0.9608
  • Organization Recall: 0.9304
  • Organization F1: 0.9453
  • Organization Number: 158
  • Person Precision: 0.9762
  • Person Recall: 0.9919
  • Person F1: 0.9840
  • Person Number: 124
  • Overall Precision: 0.9548
  • Overall Recall: 0.9548
  • Overall F1: 0.9548
  • Overall Accuracy: 0.9907

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 16
  • eval_batch_size: 64
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100.0

Training results

Training Loss Epoch Step Validation Loss Location Precision Location Recall Location F1 Location Number Organization Precision Organization Recall Organization F1 Organization Number Person Precision Person Recall Person F1 Person Number Overall Precision Overall Recall Overall F1 Overall Accuracy
0.8833 1.0 96 0.4193 0.0 0.0 0.0 116 0.2982 0.1076 0.1581 158 0.2830 0.1210 0.1695 124 0.2857 0.0804 0.1255 0.8501
0.3788 2.0 192 0.2375 0.344 0.3707 0.3568 116 0.5535 0.5570 0.5552 158 0.5562 0.7581 0.6416 124 0.4967 0.5653 0.5288 0.9286
0.2233 3.0 288 0.1220 0.7008 0.7672 0.7325 116 0.6649 0.7785 0.7172 158 0.8897 0.9758 0.9308 124 0.7433 0.8367 0.7872 0.9618
0.1473 4.0 384 0.0942 0.7609 0.9052 0.8268 116 0.7403 0.8481 0.7906 158 0.976 0.9839 0.9799 124 0.8131 0.9070 0.8575 0.9712
0.118 5.0 480 0.0602 0.9027 0.8793 0.8908 116 0.8452 0.8987 0.8712 158 0.9683 0.9839 0.976 124 0.8993 0.9196 0.9093 0.9822
0.1004 6.0 576 0.0580 0.8254 0.8966 0.8595 116 0.8903 0.8734 0.8818 158 0.9457 0.9839 0.9644 124 0.8878 0.9146 0.9010 0.9808
0.0894 7.0 672 0.0506 0.9091 0.8621 0.8850 116 0.8563 0.9051 0.88 158 0.9762 0.9919 0.9840 124 0.9082 0.9196 0.9139 0.9824
0.078 8.0 768 0.0490 0.8618 0.9138 0.8870 116 0.9091 0.8861 0.8974 158 0.976 0.9839 0.9799 124 0.9154 0.9246 0.92 0.9841
0.0717 9.0 864 0.0516 0.8770 0.9224 0.8992 116 0.8780 0.9114 0.8944 158 0.9839 0.9839 0.9839 124 0.9098 0.9372 0.9233 0.9849
0.067 10.0 960 0.0548 0.8421 0.9655 0.8996 116 0.9252 0.8608 0.8918 158 0.9389 0.9919 0.9647 124 0.9027 0.9322 0.9172 0.9805
0.065 11.0 1056 0.0423 0.8740 0.9569 0.9136 116 0.9295 0.9177 0.9236 158 0.984 0.9919 0.9880 124 0.9289 0.9523 0.9404 0.9871
0.0574 12.0 1152 0.0379 0.8992 0.9224 0.9106 116 0.9467 0.8987 0.9221 158 0.984 0.9919 0.9880 124 0.9442 0.9347 0.9394 0.9890
0.0559 13.0 1248 0.0406 0.9237 0.9397 0.9316 116 0.9245 0.9304 0.9274 158 0.984 0.9919 0.9880 124 0.9428 0.9523 0.9475 0.9882
0.0508 14.0 1344 0.0465 0.9016 0.9483 0.9244 116 0.9408 0.9051 0.9226 158 0.9762 0.9919 0.9840 124 0.94 0.9447 0.9424 0.9876
0.0474 15.0 1440 0.0408 0.9328 0.9569 0.9447 116 0.925 0.9367 0.9308 158 0.9762 0.9919 0.9840 124 0.9432 0.9598 0.9514 0.9876
0.0458 16.0 1536 0.0388 0.9322 0.9483 0.9402 116 0.9484 0.9304 0.9393 158 0.9762 0.9919 0.9840 124 0.9524 0.9548 0.9536 0.9901
0.0456 17.0 1632 0.0464 0.9083 0.9397 0.9237 116 0.9080 0.9367 0.9221 158 0.9762 0.9919 0.9840 124 0.9291 0.9548 0.9418 0.9876
0.0436 18.0 1728 0.0398 0.9322 0.9483 0.9402 116 0.9673 0.9367 0.9518 158 0.9762 0.9919 0.9840 124 0.9597 0.9573 0.9585 0.9901
0.0412 19.0 1824 0.0421 0.9478 0.9397 0.9437 116 0.925 0.9367 0.9308 158 0.9685 0.9919 0.9801 124 0.9453 0.9548 0.95 0.9890
0.0384 20.0 1920 0.0467 0.8908 0.9138 0.9021 116 0.8982 0.9494 0.9231 158 0.9685 0.9919 0.9801 124 0.9177 0.9523 0.9346 0.9874
0.0369 21.0 2016 0.0414 0.9083 0.9397 0.9237 116 0.9308 0.9367 0.9338 158 0.9685 0.9919 0.9801 124 0.9360 0.9548 0.9453 0.9893
0.0332 22.0 2112 0.0409 0.9 0.9310 0.9153 116 0.9423 0.9304 0.9363 158 0.9762 0.9919 0.9840 124 0.9403 0.9497 0.9450 0.9887
0.035 23.0 2208 0.0373 0.9244 0.9483 0.9362 116 0.9610 0.9367 0.9487 158 0.9762 0.9919 0.9840 124 0.9549 0.9573 0.9561 0.9909
0.0338 24.0 2304 0.0418 0.9091 0.9483 0.9283 116 0.9434 0.9494 0.9464 158 0.9762 0.9919 0.9840 124 0.9433 0.9623 0.9527 0.9885
0.0331 25.0 2400 0.0457 0.9160 0.9397 0.9277 116 0.9226 0.9051 0.9137 158 0.9609 0.9919 0.9762 124 0.9328 0.9422 0.9375 0.9876
0.0287 26.0 2496 0.0488 0.9091 0.9483 0.9283 116 0.9412 0.9114 0.9260 158 0.9685 0.9919 0.9801 124 0.9401 0.9472 0.9437 0.9882
0.0282 27.0 2592 0.0468 0.9160 0.9397 0.9277 116 0.9474 0.9114 0.9290 158 0.9683 0.9839 0.976 124 0.9446 0.9422 0.9434 0.9879
0.0282 28.0 2688 0.0433 0.9076 0.9310 0.9191 116 0.9494 0.9494 0.9494 158 0.9685 0.9919 0.9801 124 0.9431 0.9573 0.9501 0.9896
0.0267 29.0 2784 0.0432 0.9076 0.9310 0.9191 116 0.9371 0.9430 0.9401 158 0.9609 0.9919 0.9762 124 0.9360 0.9548 0.9453 0.9885
0.0252 30.0 2880 0.0444 0.9231 0.9310 0.9270 116 0.9255 0.9430 0.9342 158 0.9762 0.9919 0.9840 124 0.9406 0.9548 0.9476 0.9890
0.0238 31.0 2976 0.0432 0.9316 0.9397 0.9356 116 0.9487 0.9367 0.9427 158 0.9762 0.9919 0.9840 124 0.9524 0.9548 0.9536 0.9896
0.0228 32.0 3072 0.0406 0.9237 0.9397 0.9316 116 0.9487 0.9367 0.9427 158 0.9762 0.9919 0.9840 124 0.95 0.9548 0.9524 0.9896
0.0231 33.0 3168 0.0506 0.9091 0.9483 0.9283 116 0.9477 0.9177 0.9325 158 0.976 0.9839 0.9799 124 0.9449 0.9472 0.9460 0.9893
0.0219 34.0 3264 0.0470 0.9310 0.9310 0.9310 116 0.9494 0.9494 0.9494 158 0.9603 0.9758 0.9680 124 0.9475 0.9523 0.9499 0.9901
0.021 35.0 3360 0.0477 0.9316 0.9397 0.9356 116 0.9487 0.9367 0.9427 158 0.9683 0.9839 0.976 124 0.9499 0.9523 0.9511 0.9901
0.0192 36.0 3456 0.0530 0.9098 0.9569 0.9328 116 0.9603 0.9177 0.9385 158 0.9683 0.9839 0.976 124 0.9474 0.9497 0.9486 0.9890
0.0208 37.0 3552 0.0456 0.9083 0.9397 0.9237 116 0.9416 0.9177 0.9295 158 0.9762 0.9919 0.9840 124 0.9425 0.9472 0.9449 0.9893
0.0193 38.0 3648 0.0423 0.9091 0.9483 0.9283 116 0.9610 0.9367 0.9487 158 0.9762 0.9919 0.9840 124 0.9501 0.9573 0.9537 0.9909
0.0181 39.0 3744 0.0417 0.9244 0.9483 0.9362 116 0.9613 0.9430 0.9521 158 0.9762 0.9919 0.9840 124 0.955 0.9598 0.9574 0.9907
0.0196 40.0 3840 0.0464 0.9160 0.9397 0.9277 116 0.9494 0.9494 0.9494 158 0.9762 0.9919 0.9840 124 0.9479 0.9598 0.9538 0.9898
0.0179 41.0 3936 0.0444 0.9083 0.9397 0.9237 116 0.9484 0.9304 0.9393 158 0.9762 0.9919 0.9840 124 0.9451 0.9523 0.9487 0.9896
0.018 42.0 4032 0.0539 0.9076 0.9310 0.9191 116 0.9542 0.9241 0.9389 158 0.9685 0.9919 0.9801 124 0.9449 0.9472 0.9460 0.9890
0.017 43.0 4128 0.0420 0.9391 0.9310 0.9351 116 0.9554 0.9494 0.9524 158 0.9685 0.9919 0.9801 124 0.9549 0.9573 0.9561 0.9915
0.0153 44.0 4224 0.0505 0.9231 0.9310 0.9270 116 0.9545 0.9304 0.9423 158 0.9609 0.9919 0.9762 124 0.9474 0.9497 0.9486 0.9907
0.0162 45.0 4320 0.0496 0.8992 0.9224 0.9106 116 0.9551 0.9430 0.9490 158 0.9762 0.9919 0.9840 124 0.9451 0.9523 0.9487 0.9898
0.0162 46.0 4416 0.0479 0.9244 0.9483 0.9362 116 0.9605 0.9241 0.9419 158 0.9685 0.9919 0.9801 124 0.9523 0.9523 0.9523 0.9898
0.018 47.0 4512 0.0466 0.9231 0.9310 0.9270 116 0.9177 0.9177 0.9177 158 0.9762 0.9919 0.9840 124 0.9377 0.9447 0.9412 0.9890
0.0164 48.0 4608 0.0476 0.9237 0.9397 0.9316 116 0.9542 0.9241 0.9389 158 0.9762 0.9919 0.9840 124 0.9521 0.9497 0.9509 0.9896
0.015 49.0 4704 0.0472 0.9237 0.9397 0.9316 116 0.9613 0.9430 0.9521 158 0.9762 0.9919 0.9840 124 0.9549 0.9573 0.9561 0.9909
0.0138 50.0 4800 0.0471 0.9316 0.9397 0.9356 116 0.9545 0.9304 0.9423 158 0.9762 0.9919 0.9840 124 0.9547 0.9523 0.9535 0.9904
0.0149 51.0 4896 0.0501 0.9160 0.9397 0.9277 116 0.9671 0.9304 0.9484 158 0.9762 0.9919 0.9840 124 0.9547 0.9523 0.9535 0.9901
0.0148 52.0 4992 0.0433 0.9244 0.9483 0.9362 116 0.9545 0.9304 0.9423 158 0.9762 0.9919 0.9840 124 0.9524 0.9548 0.9536 0.9909
0.0149 53.0 5088 0.0447 0.9153 0.9310 0.9231 116 0.9542 0.9241 0.9389 158 0.9685 0.9919 0.9801 124 0.9472 0.9472 0.9472 0.9898
0.0144 54.0 5184 0.0460 0.9322 0.9483 0.9402 116 0.9610 0.9367 0.9487 158 0.9685 0.9919 0.9801 124 0.9549 0.9573 0.9561 0.9901
0.0135 55.0 5280 0.0508 0.9310 0.9310 0.9310 116 0.9434 0.9494 0.9464 158 0.9762 0.9919 0.9840 124 0.9501 0.9573 0.9537 0.9904
0.0132 56.0 5376 0.0471 0.9244 0.9483 0.9362 116 0.9542 0.9241 0.9389 158 0.9762 0.9919 0.9840 124 0.9523 0.9523 0.9523 0.9907
0.0125 57.0 5472 0.0480 0.9231 0.9310 0.9270 116 0.9613 0.9430 0.9521 158 0.9762 0.9919 0.9840 124 0.9548 0.9548 0.9548 0.9909
0.0137 58.0 5568 0.0482 0.9167 0.9483 0.9322 116 0.9671 0.9304 0.9484 158 0.9685 0.9919 0.9801 124 0.9524 0.9548 0.9536 0.9909
0.0113 59.0 5664 0.0461 0.9237 0.9397 0.9316 116 0.9673 0.9367 0.9518 158 0.9762 0.9919 0.9840 124 0.9572 0.9548 0.9560 0.9901
0.0122 60.0 5760 0.0477 0.9160 0.9397 0.9277 116 0.9671 0.9304 0.9484 158 0.9762 0.9919 0.9840 124 0.9547 0.9523 0.9535 0.9904
0.0112 61.0 5856 0.0491 0.9316 0.9397 0.9356 116 0.9610 0.9367 0.9487 158 0.9762 0.9919 0.9840 124 0.9572 0.9548 0.9560 0.9907
0.0103 62.0 5952 0.0535 0.9231 0.9310 0.9270 116 0.9548 0.9367 0.9457 158 0.9762 0.9919 0.9840 124 0.9523 0.9523 0.9523 0.9893
0.012 63.0 6048 0.0495 0.9244 0.9483 0.9362 116 0.9548 0.9367 0.9457 158 0.9762 0.9919 0.9840 124 0.9525 0.9573 0.9549 0.9896
0.0117 64.0 6144 0.0491 0.9231 0.9310 0.9270 116 0.9304 0.9304 0.9304 158 0.9685 0.9919 0.9801 124 0.9403 0.9497 0.9450 0.9904
0.0103 65.0 6240 0.0559 0.9076 0.9310 0.9191 116 0.9484 0.9304 0.9393 158 0.9762 0.9919 0.9840 124 0.945 0.9497 0.9474 0.9887
0.0116 66.0 6336 0.0506 0.9076 0.9310 0.9191 116 0.9490 0.9430 0.9460 158 0.9762 0.9919 0.9840 124 0.9453 0.9548 0.95 0.9904
0.0105 67.0 6432 0.0469 0.9244 0.9483 0.9362 116 0.9545 0.9304 0.9423 158 0.9762 0.9919 0.9840 124 0.9524 0.9548 0.9536 0.9909
0.0097 68.0 6528 0.0497 0.925 0.9569 0.9407 116 0.9608 0.9304 0.9453 158 0.976 0.9839 0.9799 124 0.9548 0.9548 0.9548 0.9909
0.0093 69.0 6624 0.0479 0.9316 0.9397 0.9356 116 0.9610 0.9367 0.9487 158 0.9762 0.9919 0.9840 124 0.9572 0.9548 0.9560 0.9901
0.0093 70.0 6720 0.0478 0.9316 0.9397 0.9356 116 0.9610 0.9367 0.9487 158 0.9762 0.9919 0.9840 124 0.9572 0.9548 0.9560 0.9901
0.01 71.0 6816 0.0444 0.9244 0.9483 0.9362 116 0.9613 0.9430 0.9521 158 0.9762 0.9919 0.9840 124 0.955 0.9598 0.9574 0.9912
0.0096 72.0 6912 0.0423 0.9478 0.9397 0.9437 116 0.9490 0.9430 0.9460 158 0.9762 0.9919 0.9840 124 0.9573 0.9573 0.9573 0.9918
0.0088 73.0 7008 0.0462 0.9322 0.9483 0.9402 116 0.9673 0.9367 0.9518 158 0.9762 0.9919 0.9840 124 0.9597 0.9573 0.9585 0.9907
0.01 74.0 7104 0.0477 0.9316 0.9397 0.9356 116 0.9490 0.9430 0.9460 158 0.9762 0.9919 0.9840 124 0.9525 0.9573 0.9549 0.9915
0.0083 75.0 7200 0.0490 0.9244 0.9483 0.9362 116 0.9542 0.9241 0.9389 158 0.9762 0.9919 0.9840 124 0.9523 0.9523 0.9523 0.9907
0.0085 76.0 7296 0.0482 0.9167 0.9483 0.9322 116 0.9487 0.9367 0.9427 158 0.9762 0.9919 0.9840 124 0.9478 0.9573 0.9525 0.9909
0.0091 77.0 7392 0.0496 0.9244 0.9483 0.9362 116 0.9610 0.9367 0.9487 158 0.9762 0.9919 0.9840 124 0.9549 0.9573 0.9561 0.9912
0.0083 78.0 7488 0.0476 0.9237 0.9397 0.9316 116 0.9673 0.9367 0.9518 158 0.9683 0.9839 0.976 124 0.9547 0.9523 0.9535 0.9904
0.0087 79.0 7584 0.0494 0.9316 0.9397 0.9356 116 0.9423 0.9304 0.9363 158 0.9762 0.9919 0.9840 124 0.9499 0.9523 0.9511 0.9898
0.0077 80.0 7680 0.0506 0.9316 0.9397 0.9356 116 0.9548 0.9367 0.9457 158 0.9762 0.9919 0.9840 124 0.9548 0.9548 0.9548 0.9901
0.0086 81.0 7776 0.0518 0.9160 0.9397 0.9277 116 0.9299 0.9241 0.9270 158 0.9685 0.9919 0.9801 124 0.9380 0.9497 0.9438 0.9901
0.0072 82.0 7872 0.0560 0.9167 0.9483 0.9322 116 0.9477 0.9177 0.9325 158 0.9685 0.9919 0.9801 124 0.945 0.9497 0.9474 0.9896
0.008 83.0 7968 0.0515 0.9076 0.9310 0.9191 116 0.9548 0.9367 0.9457 158 0.9762 0.9919 0.9840 124 0.9475 0.9523 0.9499 0.9904
0.0062 84.0 8064 0.0530 0.9076 0.9310 0.9191 116 0.9613 0.9430 0.9521 158 0.9762 0.9919 0.9840 124 0.95 0.9548 0.9524 0.9904
0.0071 85.0 8160 0.0524 0.9237 0.9397 0.9316 116 0.9673 0.9367 0.9518 158 0.9683 0.9839 0.976 124 0.9547 0.9523 0.9535 0.9904
0.007 86.0 8256 0.0543 0.9231 0.9310 0.9270 116 0.9548 0.9367 0.9457 158 0.9683 0.9839 0.976 124 0.9497 0.9497 0.9497 0.9907
0.0075 87.0 8352 0.0545 0.9237 0.9397 0.9316 116 0.9545 0.9304 0.9423 158 0.976 0.9839 0.9799 124 0.9521 0.9497 0.9509 0.9901
0.0085 88.0 8448 0.0537 0.9244 0.9483 0.9362 116 0.9608 0.9304 0.9453 158 0.9762 0.9919 0.9840 124 0.9548 0.9548 0.9548 0.9904
0.009 89.0 8544 0.0536 0.9244 0.9483 0.9362 116 0.9542 0.9241 0.9389 158 0.9762 0.9919 0.9840 124 0.9523 0.9523 0.9523 0.9904
0.0081 90.0 8640 0.0544 0.9244 0.9483 0.9362 116 0.9542 0.9241 0.9389 158 0.9762 0.9919 0.9840 124 0.9523 0.9523 0.9523 0.9901
0.0083 91.0 8736 0.0534 0.9322 0.9483 0.9402 116 0.9608 0.9304 0.9453 158 0.9762 0.9919 0.9840 124 0.9572 0.9548 0.9560 0.9907
0.0077 92.0 8832 0.0539 0.9322 0.9483 0.9402 116 0.9673 0.9367 0.9518 158 0.9762 0.9919 0.9840 124 0.9597 0.9573 0.9585 0.9907
0.0071 93.0 8928 0.0541 0.9244 0.9483 0.9362 116 0.9605 0.9241 0.9419 158 0.9762 0.9919 0.9840 124 0.9547 0.9523 0.9535 0.9901
0.0066 94.0 9024 0.0537 0.9244 0.9483 0.9362 116 0.9608 0.9304 0.9453 158 0.9762 0.9919 0.9840 124 0.9548 0.9548 0.9548 0.9904
0.0073 95.0 9120 0.0551 0.925 0.9569 0.9407 116 0.9671 0.9304 0.9484 158 0.9762 0.9919 0.9840 124 0.9573 0.9573 0.9573 0.9904
0.006 96.0 9216 0.0550 0.9244 0.9483 0.9362 116 0.9608 0.9304 0.9453 158 0.9762 0.9919 0.9840 124 0.9548 0.9548 0.9548 0.9904
0.0068 97.0 9312 0.0545 0.9244 0.9483 0.9362 116 0.9542 0.9241 0.9389 158 0.9762 0.9919 0.9840 124 0.9523 0.9523 0.9523 0.9901
0.0072 98.0 9408 0.0549 0.9244 0.9483 0.9362 116 0.9608 0.9304 0.9453 158 0.9762 0.9919 0.9840 124 0.9548 0.9548 0.9548 0.9904
0.0062 99.0 9504 0.0542 0.9244 0.9483 0.9362 116 0.9608 0.9304 0.9453 158 0.9762 0.9919 0.9840 124 0.9548 0.9548 0.9548 0.9907
0.0061 100.0 9600 0.0541 0.9244 0.9483 0.9362 116 0.9608 0.9304 0.9453 158 0.9762 0.9919 0.9840 124 0.9548 0.9548 0.9548 0.9907

Framework versions

  • Transformers 4.39.3
  • Pytorch 2.3.0+cu121
  • Datasets 2.19.1
  • Tokenizers 0.15.2