Hugging Face's logo

apwic
/
nerui-pt-pl20-1

TensorBoard
Indonesian
Generated from Trainer
Model card Files Metrics Community
nerui-pt-pl20-1 / README.md
apwic's picture
apwic
End of training
3ac1b63 verified
preview code
|
raw
history blame
36.4 kB
metadata
language:
  - id
license: mit
base_model: indolem/indobert-base-uncased
tags:
  - generated_from_trainer
model-index:
  - name: nerui-pt-pl20-1
    results: []

nerui-pt-pl20-1

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0494
  • Location Precision: 0.9091
  • Location Recall: 0.9483
  • Location F1: 0.9283
  • Location Number: 116
  • Organization Precision: 0.9801
  • Organization Recall: 0.9367
  • Organization F1: 0.9579
  • Organization Number: 158
  • Person Precision: 0.976
  • Person Recall: 0.9839
  • Person F1: 0.9799
  • Person Number: 124
  • Overall Precision: 0.9572
  • Overall Recall: 0.9548
  • Overall F1: 0.9560
  • Overall Accuracy: 0.9912

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 16
  • eval_batch_size: 64
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100.0

Training results

Training Loss Epoch Step Validation Loss Location Precision Location Recall Location F1 Location Number Organization Precision Organization Recall Organization F1 Organization Number Person Precision Person Recall Person F1 Person Number Overall Precision Overall Recall Overall F1 Overall Accuracy
0.8462 1.0 96 0.3964 0.0 0.0 0.0 116 0.2258 0.3101 0.2613 158 0.2653 0.3145 0.2878 124 0.2398 0.2211 0.2301 0.8663
0.3755 2.0 192 0.2420 0.4016 0.4224 0.4118 116 0.5724 0.5253 0.5479 158 0.4852 0.6613 0.5597 124 0.4908 0.5377 0.5132 0.9251
0.2104 3.0 288 0.0953 0.8407 0.8190 0.8297 116 0.7308 0.8418 0.7824 158 0.9248 0.9919 0.9572 124 0.8201 0.8819 0.8499 0.9717
0.1323 4.0 384 0.0760 0.7704 0.8966 0.8287 116 0.7624 0.8734 0.8142 158 0.9462 0.9919 0.9685 124 0.8184 0.9171 0.8649 0.9745
0.1138 5.0 480 0.0559 0.8889 0.8276 0.8571 116 0.875 0.9304 0.9018 158 0.9685 0.9919 0.9801 124 0.9082 0.9196 0.9139 0.9830
0.0958 6.0 576 0.0495 0.8140 0.9052 0.8571 116 0.9133 0.8671 0.8896 158 0.984 0.9919 0.9880 124 0.9035 0.9171 0.9102 0.9846
0.0842 7.0 672 0.0435 0.9259 0.8621 0.8929 116 0.8555 0.9367 0.8943 158 0.984 0.9919 0.9880 124 0.9138 0.9322 0.9229 0.9860
0.0741 8.0 768 0.0411 0.872 0.9397 0.9046 116 0.9276 0.8924 0.9097 158 0.984 0.9919 0.9880 124 0.9279 0.9372 0.9325 0.9871
0.0704 9.0 864 0.0379 0.9256 0.9655 0.9451 116 0.9202 0.9494 0.9346 158 0.9762 0.9919 0.9840 124 0.9390 0.9673 0.9530 0.9896
0.063 10.0 960 0.0403 0.8550 0.9655 0.9069 116 0.9536 0.9114 0.9320 158 0.984 0.9919 0.9880 124 0.9312 0.9523 0.9416 0.9865
0.0579 11.0 1056 0.0379 0.9083 0.9397 0.9237 116 0.9130 0.9304 0.9216 158 0.9685 0.9919 0.9801 124 0.9289 0.9523 0.9404 0.9885
0.053 12.0 1152 0.0353 0.9091 0.9483 0.9283 116 0.9801 0.9367 0.9579 158 0.984 0.9919 0.9880 124 0.9597 0.9573 0.9585 0.9904
0.0512 13.0 1248 0.0365 0.9008 0.9397 0.9198 116 0.96 0.9114 0.9351 158 0.984 0.9919 0.9880 124 0.9495 0.9447 0.9471 0.9890
0.0478 14.0 1344 0.0315 0.8974 0.9052 0.9013 116 0.9423 0.9304 0.9363 158 0.984 0.9919 0.9880 124 0.9422 0.9422 0.9422 0.9890
0.0459 15.0 1440 0.0356 0.9160 0.9397 0.9277 116 0.9363 0.9304 0.9333 158 0.9762 0.9919 0.9840 124 0.9428 0.9523 0.9475 0.9893
0.0442 16.0 1536 0.0345 0.8934 0.9397 0.9160 116 0.9477 0.9177 0.9325 158 0.984 0.9919 0.9880 124 0.9425 0.9472 0.9449 0.9896
0.0388 17.0 1632 0.0335 0.9174 0.9569 0.9367 116 0.9419 0.9241 0.9329 158 0.9685 0.9919 0.9801 124 0.9429 0.9548 0.9488 0.9901
0.0394 18.0 1728 0.0329 0.9407 0.9569 0.9487 116 0.9608 0.9304 0.9453 158 0.9762 0.9919 0.9840 124 0.9597 0.9573 0.9585 0.9904
0.0367 19.0 1824 0.0338 0.925 0.9569 0.9407 116 0.9796 0.9114 0.9443 158 0.9762 0.9919 0.9840 124 0.9618 0.9497 0.9558 0.9904
0.0348 20.0 1920 0.0384 0.9407 0.9569 0.9487 116 0.9231 0.9114 0.9172 158 0.9762 0.9919 0.9840 124 0.945 0.9497 0.9474 0.9887
0.0334 21.0 2016 0.0353 0.9091 0.9483 0.9283 116 0.9539 0.9177 0.9355 158 0.9609 0.9919 0.9762 124 0.9426 0.9497 0.9462 0.9890
0.0308 22.0 2112 0.0351 0.9262 0.9741 0.9496 116 0.9795 0.9051 0.9408 158 0.9609 0.9919 0.9762 124 0.9571 0.9523 0.9547 0.9893
0.0303 23.0 2208 0.0354 0.9256 0.9655 0.9451 116 0.9733 0.9241 0.9481 158 0.9839 0.9839 0.9839 124 0.9620 0.9548 0.9584 0.9912
0.0282 24.0 2304 0.0345 0.9316 0.9397 0.9356 116 0.9434 0.9494 0.9464 158 0.9609 0.9919 0.9762 124 0.9455 0.9598 0.9526 0.9898
0.0295 25.0 2400 0.0395 0.9244 0.9483 0.9362 116 0.9671 0.9304 0.9484 158 0.9609 0.9919 0.9762 124 0.9524 0.9548 0.9536 0.9901
0.0275 26.0 2496 0.0399 0.9106 0.9655 0.9372 116 0.9864 0.9177 0.9508 158 0.9609 0.9919 0.9762 124 0.9548 0.9548 0.9548 0.9896
0.0255 27.0 2592 0.0363 0.9402 0.9483 0.9442 116 0.9290 0.9114 0.9201 158 0.9609 0.9919 0.9762 124 0.9425 0.9472 0.9449 0.9896
0.0245 28.0 2688 0.0439 0.9167 0.9483 0.9322 116 0.9367 0.9367 0.9367 158 0.9762 0.9919 0.9840 124 0.9431 0.9573 0.9501 0.9890
0.0233 29.0 2784 0.0421 0.896 0.9655 0.9295 116 0.9866 0.9304 0.9577 158 0.9762 0.9919 0.9840 124 0.955 0.9598 0.9574 0.9896
0.023 30.0 2880 0.0435 0.9138 0.9138 0.9138 116 0.9481 0.9241 0.9359 158 0.984 0.9919 0.9880 124 0.9494 0.9422 0.9458 0.9885
0.0238 31.0 2976 0.0374 0.9076 0.9310 0.9191 116 0.9667 0.9177 0.9416 158 0.9762 0.9919 0.9840 124 0.9519 0.9447 0.9483 0.9893
0.0214 32.0 3072 0.0383 0.9237 0.9397 0.9316 116 0.9737 0.9367 0.9548 158 0.984 0.9919 0.9880 124 0.9620 0.9548 0.9584 0.9915
0.021 33.0 3168 0.0385 0.9231 0.9310 0.9270 116 0.9539 0.9177 0.9355 158 0.984 0.9919 0.9880 124 0.9543 0.9447 0.9495 0.9907
0.0219 34.0 3264 0.0514 0.8952 0.9569 0.925 116 0.9533 0.9051 0.9286 158 0.9609 0.9919 0.9762 124 0.9378 0.9472 0.9425 0.9871
0.0204 35.0 3360 0.0407 0.9244 0.9483 0.9362 116 0.9733 0.9241 0.9481 158 0.984 0.9919 0.9880 124 0.9619 0.9523 0.9571 0.9907
0.0186 36.0 3456 0.0408 0.9174 0.9569 0.9367 116 0.9669 0.9241 0.9450 158 0.984 0.9919 0.9880 124 0.9572 0.9548 0.9560 0.9907
0.0198 37.0 3552 0.0467 0.9310 0.9310 0.9310 116 0.96 0.9114 0.9351 158 0.9535 0.9919 0.9723 124 0.9494 0.9422 0.9458 0.9890
0.0193 38.0 3648 0.0431 0.9328 0.9569 0.9447 116 0.9730 0.9114 0.9412 158 0.9685 0.9919 0.9801 124 0.9594 0.9497 0.9545 0.9901
0.0187 39.0 3744 0.0480 0.9174 0.9569 0.9367 116 0.9724 0.8924 0.9307 158 0.9609 0.9919 0.9762 124 0.9518 0.9422 0.9470 0.9885
0.0189 40.0 3840 0.0398 0.9091 0.9483 0.9283 116 0.9726 0.8987 0.9342 158 0.9762 0.9919 0.9840 124 0.9542 0.9422 0.9482 0.9904
0.0163 41.0 3936 0.0398 0.9237 0.9397 0.9316 116 0.9539 0.9177 0.9355 158 0.9683 0.9839 0.976 124 0.9495 0.9447 0.9471 0.9898
0.0181 42.0 4032 0.0466 0.9194 0.9828 0.95 116 0.9722 0.8861 0.9272 158 0.984 0.9919 0.9880 124 0.9593 0.9472 0.9532 0.9896
0.0153 43.0 4128 0.0451 0.9244 0.9483 0.9362 116 0.9660 0.8987 0.9311 158 0.984 0.9919 0.9880 124 0.9591 0.9422 0.9506 0.9896
0.017 44.0 4224 0.0465 0.925 0.9569 0.9407 116 0.9416 0.9177 0.9295 158 0.976 0.9839 0.9799 124 0.9474 0.9497 0.9486 0.9885
0.0159 45.0 4320 0.0450 0.9167 0.9483 0.9322 116 0.9662 0.9051 0.9346 158 0.976 0.9839 0.9799 124 0.9542 0.9422 0.9482 0.9898
0.0156 46.0 4416 0.0498 0.9256 0.9655 0.9451 116 0.9595 0.8987 0.9281 158 0.976 0.9839 0.9799 124 0.9543 0.9447 0.9495 0.9890
0.0168 47.0 4512 0.0470 0.9244 0.9483 0.9362 116 0.9603 0.9177 0.9385 158 0.9683 0.9839 0.976 124 0.9520 0.9472 0.9496 0.9896
0.0146 48.0 4608 0.0455 0.925 0.9569 0.9407 116 0.9664 0.9114 0.9381 158 0.984 0.9919 0.9880 124 0.9594 0.9497 0.9545 0.9907
0.013 49.0 4704 0.0444 0.9091 0.9483 0.9283 116 0.9865 0.9241 0.9542 158 0.984 0.9919 0.9880 124 0.9619 0.9523 0.9571 0.9909
0.0142 50.0 4800 0.0456 0.9083 0.9397 0.9237 116 0.9735 0.9304 0.9515 158 0.984 0.9919 0.9880 124 0.9571 0.9523 0.9547 0.9901
0.012 51.0 4896 0.0444 0.925 0.9569 0.9407 116 0.9796 0.9114 0.9443 158 0.984 0.9919 0.9880 124 0.9643 0.9497 0.9570 0.9912
0.0141 52.0 4992 0.0458 0.9256 0.9655 0.9451 116 0.9667 0.9177 0.9416 158 0.984 0.9919 0.9880 124 0.9596 0.9548 0.9572 0.9893
0.0121 53.0 5088 0.0470 0.9091 0.9483 0.9283 116 0.9664 0.9114 0.9381 158 0.984 0.9919 0.9880 124 0.9544 0.9472 0.9508 0.9893
0.0121 54.0 5184 0.0464 0.9167 0.9483 0.9322 116 0.9419 0.9241 0.9329 158 0.984 0.9919 0.9880 124 0.9475 0.9523 0.9499 0.9896
0.0114 55.0 5280 0.0443 0.9091 0.9483 0.9283 116 0.9796 0.9114 0.9443 158 0.9685 0.9919 0.9801 124 0.9544 0.9472 0.9508 0.9901
0.0124 56.0 5376 0.0467 0.9083 0.9397 0.9237 116 0.9671 0.9304 0.9484 158 0.9609 0.9919 0.9762 124 0.9475 0.9523 0.9499 0.9893
0.0125 57.0 5472 0.0461 0.9091 0.9483 0.9283 116 0.9732 0.9177 0.9446 158 0.9762 0.9919 0.9840 124 0.9545 0.9497 0.9521 0.9896
0.0106 58.0 5568 0.0608 0.9008 0.9397 0.9198 116 0.9726 0.8987 0.9342 158 0.9683 0.9839 0.976 124 0.9491 0.9372 0.9431 0.9876
0.0113 59.0 5664 0.0470 0.925 0.9569 0.9407 116 0.9730 0.9114 0.9412 158 0.976 0.9839 0.9799 124 0.9593 0.9472 0.9532 0.9912
0.0104 60.0 5760 0.0456 0.925 0.9569 0.9407 116 0.9866 0.9304 0.9577 158 0.984 0.9919 0.9880 124 0.9670 0.9573 0.9621 0.9918
0.0117 61.0 5856 0.0517 0.9167 0.9483 0.9322 116 0.9795 0.9051 0.9408 158 0.976 0.9839 0.9799 124 0.9591 0.9422 0.9506 0.9901
0.0117 62.0 5952 0.0467 0.9083 0.9397 0.9237 116 0.9735 0.9304 0.9515 158 0.976 0.9839 0.9799 124 0.9545 0.9497 0.9521 0.9907
0.0117 63.0 6048 0.0538 0.9174 0.9569 0.9367 116 0.9728 0.9051 0.9377 158 0.976 0.9839 0.9799 124 0.9567 0.9447 0.9507 0.9901
0.0096 64.0 6144 0.0606 0.9153 0.9310 0.9231 116 0.9597 0.9051 0.9316 158 0.9683 0.9839 0.976 124 0.9491 0.9372 0.9431 0.9887
0.0087 65.0 6240 0.0552 0.9083 0.9397 0.9237 116 0.9863 0.9114 0.9474 158 0.976 0.9839 0.9799 124 0.9591 0.9422 0.9506 0.9901
0.0105 66.0 6336 0.0522 0.9160 0.9397 0.9277 116 0.9664 0.9114 0.9381 158 0.976 0.9839 0.9799 124 0.9542 0.9422 0.9482 0.9896
0.0097 67.0 6432 0.0492 0.925 0.9569 0.9407 116 0.9932 0.9304 0.9608 158 0.976 0.9839 0.9799 124 0.9669 0.9548 0.9608 0.9915
0.0096 68.0 6528 0.0522 0.9167 0.9483 0.9322 116 0.9796 0.9114 0.9443 158 0.976 0.9839 0.9799 124 0.9592 0.9447 0.9519 0.9904
0.0092 69.0 6624 0.0520 0.9167 0.9483 0.9322 116 0.9865 0.9241 0.9542 158 0.9683 0.9839 0.976 124 0.9594 0.9497 0.9545 0.9901
0.008 70.0 6720 0.0481 0.925 0.9569 0.9407 116 0.9735 0.9304 0.9515 158 0.976 0.9839 0.9799 124 0.9596 0.9548 0.9572 0.9907
0.0085 71.0 6816 0.0497 0.9180 0.9655 0.9412 116 0.9865 0.9241 0.9542 158 0.984 0.9919 0.9880 124 0.9646 0.9573 0.9609 0.9909
0.0105 72.0 6912 0.0475 0.9310 0.9310 0.9310 116 0.9735 0.9304 0.9515 158 0.9606 0.9839 0.9721 124 0.9569 0.9472 0.9520 0.9898
0.0089 73.0 7008 0.0460 0.9167 0.9483 0.9322 116 0.9737 0.9367 0.9548 158 0.976 0.9839 0.9799 124 0.9572 0.9548 0.9560 0.9909
0.009 74.0 7104 0.0479 0.9160 0.9397 0.9277 116 0.9737 0.9367 0.9548 158 0.976 0.9839 0.9799 124 0.9571 0.9523 0.9547 0.9907
0.0077 75.0 7200 0.0490 0.9098 0.9569 0.9328 116 0.98 0.9304 0.9545 158 0.9683 0.9839 0.976 124 0.9548 0.9548 0.9548 0.9907
0.0078 76.0 7296 0.0445 0.9098 0.9569 0.9328 116 0.9801 0.9367 0.9579 158 0.984 0.9919 0.9880 124 0.9598 0.9598 0.9598 0.9909
0.007 77.0 7392 0.0459 0.9167 0.9483 0.9322 116 0.9669 0.9241 0.9450 158 0.984 0.9919 0.9880 124 0.9571 0.9523 0.9547 0.9898
0.0071 78.0 7488 0.0476 0.9167 0.9483 0.9322 116 0.9603 0.9177 0.9385 158 0.9683 0.9839 0.976 124 0.9496 0.9472 0.9484 0.9898
0.0073 79.0 7584 0.0486 0.9167 0.9483 0.9322 116 0.9737 0.9367 0.9548 158 0.976 0.9839 0.9799 124 0.9572 0.9548 0.9560 0.9912
0.0075 80.0 7680 0.0487 0.9174 0.9569 0.9367 116 0.9735 0.9304 0.9515 158 0.976 0.9839 0.9799 124 0.9572 0.9548 0.9560 0.9907
0.0085 81.0 7776 0.0458 0.9083 0.9397 0.9237 116 0.9613 0.9430 0.9521 158 0.984 0.9919 0.9880 124 0.9525 0.9573 0.9549 0.9896
0.0075 82.0 7872 0.0458 0.9098 0.9569 0.9328 116 0.9803 0.9430 0.9613 158 0.984 0.9919 0.9880 124 0.9599 0.9623 0.9611 0.9912
0.0069 83.0 7968 0.0459 0.9091 0.9483 0.9283 116 0.9866 0.9304 0.9577 158 0.984 0.9919 0.9880 124 0.9620 0.9548 0.9584 0.9909
0.006 84.0 8064 0.0484 0.9180 0.9655 0.9412 116 0.9803 0.9430 0.9613 158 0.984 0.9919 0.9880 124 0.9624 0.9648 0.9636 0.9912
0.0074 85.0 8160 0.0501 0.9256 0.9655 0.9451 116 0.9667 0.9177 0.9416 158 0.976 0.9839 0.9799 124 0.9571 0.9523 0.9547 0.9904
0.0066 86.0 8256 0.0489 0.9098 0.9569 0.9328 116 0.9733 0.9241 0.9481 158 0.984 0.9919 0.9880 124 0.9572 0.9548 0.9560 0.9898
0.0073 87.0 8352 0.0469 0.9174 0.9569 0.9367 116 0.9801 0.9367 0.9579 158 0.984 0.9919 0.9880 124 0.9622 0.9598 0.9610 0.9912
0.0064 88.0 8448 0.0463 0.9091 0.9483 0.9283 116 0.9801 0.9367 0.9579 158 0.984 0.9919 0.9880 124 0.9597 0.9573 0.9585 0.9907
0.0055 89.0 8544 0.0489 0.9091 0.9483 0.9283 116 0.9801 0.9367 0.9579 158 0.9762 0.9919 0.9840 124 0.9573 0.9573 0.9573 0.9907
0.0068 90.0 8640 0.0476 0.9167 0.9483 0.9322 116 0.9735 0.9304 0.9515 158 0.9683 0.9839 0.976 124 0.9547 0.9523 0.9535 0.9907
0.0066 91.0 8736 0.0467 0.9174 0.9569 0.9367 116 0.9803 0.9430 0.9613 158 0.984 0.9919 0.9880 124 0.9623 0.9623 0.9623 0.9915
0.0069 92.0 8832 0.0483 0.9091 0.9483 0.9283 116 0.9799 0.9241 0.9511 158 0.976 0.9839 0.9799 124 0.9570 0.9497 0.9533 0.9909
0.0064 93.0 8928 0.0483 0.9091 0.9483 0.9283 116 0.9737 0.9367 0.9548 158 0.976 0.9839 0.9799 124 0.9548 0.9548 0.9548 0.9909
0.0065 94.0 9024 0.0488 0.9174 0.9569 0.9367 116 0.9737 0.9367 0.9548 158 0.976 0.9839 0.9799 124 0.9573 0.9573 0.9573 0.9912
0.0059 95.0 9120 0.0492 0.9091 0.9483 0.9283 116 0.9866 0.9304 0.9577 158 0.976 0.9839 0.9799 124 0.9595 0.9523 0.9559 0.9912
0.0054 96.0 9216 0.0488 0.9091 0.9483 0.9283 116 0.9737 0.9367 0.9548 158 0.9683 0.9839 0.976 124 0.9524 0.9548 0.9536 0.9907
0.0062 97.0 9312 0.0492 0.9091 0.9483 0.9283 116 0.9867 0.9367 0.9610 158 0.9683 0.9839 0.976 124 0.9572 0.9548 0.9560 0.9912
0.0064 98.0 9408 0.0498 0.9091 0.9483 0.9283 116 0.9801 0.9367 0.9579 158 0.9683 0.9839 0.976 124 0.9548 0.9548 0.9548 0.9909
0.0058 99.0 9504 0.0493 0.9091 0.9483 0.9283 116 0.9801 0.9367 0.9579 158 0.9683 0.9839 0.976 124 0.9548 0.9548 0.9548 0.9909
0.0059 100.0 9600 0.0494 0.9091 0.9483 0.9283 116 0.9801 0.9367 0.9579 158 0.976 0.9839 0.9799 124 0.9572 0.9548 0.9560 0.9912

Framework versions

  • Transformers 4.39.3
  • Pytorch 2.3.0+cu121
  • Datasets 2.19.1
  • Tokenizers 0.15.2