nerui-pt-pl10-0 / README.md
apwic's picture
End of training
cd322e8 verified
|
raw
history blame
36.4 kB
metadata
language:
  - id
license: mit
base_model: indolem/indobert-base-uncased
tags:
  - generated_from_trainer
model-index:
  - name: nerui-pt-pl10-0
    results: []

nerui-pt-pl10-0

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0530
  • Location Precision: 0.8447
  • Location Recall: 0.9255
  • Location F1: 0.8832
  • Location Number: 94
  • Organization Precision: 0.9198
  • Organization Recall: 0.8922
  • Organization F1: 0.9058
  • Organization Number: 167
  • Person Precision: 0.9926
  • Person Recall: 0.9781
  • Person F1: 0.9853
  • Person Number: 137
  • Overall Precision: 0.925
  • Overall Recall: 0.9296
  • Overall F1: 0.9273
  • Overall Accuracy: 0.9859

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 5e-05
  • train_batch_size: 16
  • eval_batch_size: 64
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 100.0

Training results

Training Loss Epoch Step Validation Loss Location Precision Location Recall Location F1 Location Number Organization Precision Organization Recall Organization F1 Organization Number Person Precision Person Recall Person F1 Person Number Overall Precision Overall Recall Overall F1 Overall Accuracy
0.8344 1.0 96 0.3987 0.375 0.0319 0.0588 94 0.2115 0.2874 0.2437 167 0.2775 0.3869 0.3232 137 0.2441 0.2613 0.2524 0.8663
0.359 2.0 192 0.2302 0.39 0.4149 0.4021 94 0.5145 0.7425 0.6078 167 0.8037 0.9562 0.8733 137 0.5833 0.7387 0.6519 0.9373
0.1857 3.0 288 0.1083 0.7579 0.7660 0.7619 94 0.6919 0.8204 0.7507 167 0.9574 0.9854 0.9712 137 0.7926 0.8643 0.8269 0.9635
0.1288 4.0 384 0.0742 0.8155 0.8936 0.8528 94 0.7921 0.8443 0.8174 167 0.9708 0.9708 0.9708 137 0.8565 0.8995 0.8775 0.9740
0.108 5.0 480 0.0655 0.81 0.8617 0.8351 94 0.8631 0.8683 0.8657 167 0.9854 0.9854 0.9854 137 0.8914 0.9070 0.8991 0.9765
0.0921 6.0 576 0.0532 0.8208 0.9255 0.8700 94 0.8521 0.8623 0.8571 167 0.9926 0.9854 0.9890 137 0.8905 0.9196 0.9048 0.9812
0.0824 7.0 672 0.0591 0.7857 0.9362 0.8544 94 0.8774 0.8144 0.8447 167 0.9926 0.9854 0.9890 137 0.8908 0.9020 0.8964 0.9771
0.0751 8.0 768 0.0534 0.7692 0.9574 0.8531 94 0.8598 0.8443 0.8520 167 0.9926 0.9854 0.9890 137 0.8777 0.9196 0.8982 0.9804
0.0697 9.0 864 0.0415 0.86 0.9149 0.8866 94 0.8844 0.9162 0.9 167 1.0 0.9854 0.9926 137 0.9167 0.9397 0.9280 0.9865
0.0657 10.0 960 0.0403 0.8958 0.9149 0.9053 94 0.8708 0.9281 0.8986 167 1.0 0.9854 0.9926 137 0.9193 0.9447 0.9318 0.9867
0.0639 11.0 1056 0.0430 0.8812 0.9468 0.9128 94 0.8976 0.8922 0.8949 167 1.0 0.9854 0.9926 137 0.9279 0.9372 0.9325 0.9856
0.0571 12.0 1152 0.0544 0.8349 0.9681 0.8966 94 0.9308 0.8862 0.9080 167 1.0 0.9854 0.9926 137 0.9280 0.9397 0.9338 0.9840
0.0546 13.0 1248 0.0453 0.8558 0.9468 0.8990 94 0.8929 0.8982 0.8955 167 1.0 0.9854 0.9926 137 0.9189 0.9397 0.9292 0.9859
0.0494 14.0 1344 0.0392 0.9175 0.9468 0.9319 94 0.8715 0.9341 0.9017 167 0.9926 0.9781 0.9853 137 0.9221 0.9523 0.9370 0.9881
0.0491 15.0 1440 0.0368 0.8788 0.9255 0.9016 94 0.8935 0.9042 0.8988 167 0.9926 0.9781 0.9853 137 0.9231 0.9347 0.9288 0.9876
0.0486 16.0 1536 0.0391 0.8969 0.9255 0.9110 94 0.9157 0.9102 0.9129 167 0.9854 0.9854 0.9854 137 0.935 0.9397 0.9373 0.9878
0.0467 17.0 1632 0.0396 0.8738 0.9574 0.9137 94 0.9059 0.9222 0.9139 167 0.9853 0.9781 0.9817 137 0.9242 0.9497 0.9368 0.9870
0.0401 18.0 1728 0.0443 0.9082 0.9468 0.9271 94 0.9030 0.8922 0.8976 167 1.0 0.9854 0.9926 137 0.9372 0.9372 0.9372 0.9867
0.0414 19.0 1824 0.0476 0.8288 0.9787 0.8976 94 0.9363 0.8802 0.9074 167 0.9781 0.9781 0.9781 137 0.9210 0.9372 0.9290 0.9851
0.0404 20.0 1920 0.0459 0.8411 0.9574 0.8955 94 0.9217 0.9162 0.9189 167 1.0 0.9854 0.9926 137 0.9265 0.9497 0.9380 0.9873
0.0411 21.0 2016 0.0429 0.875 0.9681 0.9192 94 0.9394 0.9281 0.9337 167 1.0 0.9854 0.9926 137 0.9431 0.9573 0.9501 0.9887
0.0354 22.0 2112 0.0412 0.9082 0.9468 0.9271 94 0.8786 0.9102 0.8941 167 1.0 0.9854 0.9926 137 0.9261 0.9447 0.9353 0.9876
0.0343 23.0 2208 0.0573 0.8476 0.9468 0.8945 94 0.9026 0.8323 0.8660 167 0.9640 0.9781 0.9710 137 0.9095 0.9095 0.9095 0.9804
0.0337 24.0 2304 0.0420 0.8911 0.9574 0.9231 94 0.9107 0.9162 0.9134 167 1.0 0.9854 0.9926 137 0.9356 0.9497 0.9426 0.9887
0.0321 25.0 2400 0.0474 0.8824 0.9574 0.9184 94 0.9112 0.9222 0.9167 167 1.0 0.9854 0.9926 137 0.9335 0.9523 0.9428 0.9873
0.0334 26.0 2496 0.0418 0.9158 0.9255 0.9206 94 0.9 0.9162 0.9080 167 1.0 0.9854 0.9926 137 0.9375 0.9422 0.9398 0.9887
0.0319 27.0 2592 0.0404 0.9255 0.9255 0.9255 94 0.9337 0.9281 0.9309 167 1.0 0.9854 0.9926 137 0.9544 0.9472 0.9508 0.9898
0.0342 28.0 2688 0.0398 0.8922 0.9681 0.9286 94 0.95 0.9102 0.9297 167 0.9853 0.9781 0.9817 137 0.9472 0.9472 0.9472 0.9895
0.0322 29.0 2784 0.0495 0.8365 0.9255 0.8788 94 0.9024 0.8862 0.8943 167 1.0 0.9854 0.9926 137 0.9181 0.9296 0.9238 0.9851
0.0285 30.0 2880 0.0434 0.8990 0.9468 0.9223 94 0.9053 0.9162 0.9107 167 0.9926 0.9781 0.9853 137 0.9330 0.9447 0.9388 0.9878
0.0281 31.0 2976 0.0395 0.8990 0.9468 0.9223 94 0.9107 0.9162 0.9134 167 0.9853 0.9781 0.9817 137 0.9330 0.9447 0.9388 0.9884
0.0261 32.0 3072 0.0441 0.8571 0.9574 0.9045 94 0.9264 0.9042 0.9152 167 0.9853 0.9781 0.9817 137 0.9282 0.9422 0.9352 0.9876
0.0267 33.0 3168 0.0412 0.8969 0.9255 0.9110 94 0.9264 0.9042 0.9152 167 0.9853 0.9781 0.9817 137 0.9394 0.9347 0.9370 0.9878
0.0254 34.0 3264 0.0474 0.9255 0.9255 0.9255 94 0.8663 0.8922 0.8791 167 0.9853 0.9781 0.9817 137 0.9204 0.9296 0.925 0.9862
0.0234 35.0 3360 0.0434 0.8990 0.9468 0.9223 94 0.9152 0.9042 0.9096 167 0.9779 0.9708 0.9744 137 0.9325 0.9372 0.9348 0.9881
0.0248 36.0 3456 0.0449 0.8889 0.9362 0.9119 94 0.9075 0.9401 0.9235 167 1.0 0.9781 0.9889 137 0.9335 0.9523 0.9428 0.9892
0.0227 37.0 3552 0.0458 0.8889 0.9362 0.9119 94 0.9212 0.9102 0.9157 167 0.9852 0.9708 0.9779 137 0.9348 0.9372 0.9360 0.9876
0.0232 38.0 3648 0.0487 0.8812 0.9468 0.9128 94 0.9030 0.8922 0.8976 167 0.9853 0.9781 0.9817 137 0.9254 0.9347 0.93 0.9862
0.0217 39.0 3744 0.0493 0.8627 0.9362 0.8980 94 0.9264 0.9042 0.9152 167 0.9926 0.9854 0.9890 137 0.9327 0.9397 0.9362 0.9870
0.0228 40.0 3840 0.0473 0.8725 0.9468 0.9082 94 0.925 0.8862 0.9052 167 0.9852 0.9708 0.9779 137 0.9320 0.9296 0.9308 0.9867
0.0216 41.0 3936 0.0429 0.8725 0.9468 0.9082 94 0.9212 0.9102 0.9157 167 0.9926 0.9781 0.9853 137 0.9328 0.9422 0.9375 0.9881
0.0195 42.0 4032 0.0459 0.8738 0.9574 0.9137 94 0.9363 0.8802 0.9074 167 0.9926 0.9854 0.9890 137 0.9394 0.9347 0.9370 0.9884
0.0217 43.0 4128 0.0496 0.88 0.9362 0.9072 94 0.9125 0.8743 0.8930 167 1.0 0.9854 0.9926 137 0.9342 0.9271 0.9306 0.9859
0.0182 44.0 4224 0.0518 0.8654 0.9574 0.9091 94 0.9313 0.8922 0.9113 167 1.0 0.9854 0.9926 137 0.9373 0.9397 0.9385 0.9873
0.0202 45.0 4320 0.0446 0.9062 0.9255 0.9158 94 0.9255 0.8922 0.9085 167 0.9926 0.9854 0.9890 137 0.9440 0.9322 0.9381 0.9884
0.0192 46.0 4416 0.0466 0.8476 0.9468 0.8945 94 0.9255 0.8922 0.9085 167 1.0 0.9854 0.9926 137 0.9302 0.9372 0.9337 0.9865
0.0185 47.0 4512 0.0456 0.8812 0.9468 0.9128 94 0.9325 0.9102 0.9212 167 0.9778 0.9635 0.9706 137 0.9348 0.9372 0.9360 0.9878
0.0191 48.0 4608 0.0458 0.88 0.9362 0.9072 94 0.9321 0.9042 0.9179 167 0.9853 0.9781 0.9817 137 0.9372 0.9372 0.9372 0.9878
0.0177 49.0 4704 0.0496 0.8812 0.9468 0.9128 94 0.9264 0.9042 0.9152 167 1.0 0.9854 0.9926 137 0.9398 0.9422 0.9410 0.9870
0.0176 50.0 4800 0.0473 0.8558 0.9468 0.8990 94 0.9112 0.9222 0.9167 167 1.0 0.9854 0.9926 137 0.9265 0.9497 0.9380 0.9870
0.0167 51.0 4896 0.0466 0.8738 0.9574 0.9137 94 0.8922 0.8922 0.8922 167 1.0 0.9854 0.9926 137 0.9235 0.9397 0.9315 0.9873
0.0162 52.0 4992 0.0431 0.8969 0.9255 0.9110 94 0.9202 0.8982 0.9091 167 0.9779 0.9708 0.9744 137 0.9343 0.9296 0.9320 0.9878
0.0154 53.0 5088 0.0494 0.8462 0.9362 0.8889 94 0.9102 0.9102 0.9102 167 1.0 0.9854 0.9926 137 0.9236 0.9422 0.9328 0.9867
0.0161 54.0 5184 0.0438 0.8713 0.9362 0.9026 94 0.9102 0.9102 0.9102 167 1.0 0.9781 0.9889 137 0.9303 0.9397 0.9350 0.9881
0.014 55.0 5280 0.0494 0.8878 0.9255 0.9062 94 0.9259 0.8982 0.9119 167 1.0 0.9854 0.9926 137 0.9418 0.9347 0.9382 0.9878
0.0149 56.0 5376 0.0460 0.8812 0.9468 0.9128 94 0.9379 0.9042 0.9207 167 1.0 0.9781 0.9889 137 0.9444 0.9397 0.9421 0.9887
0.0126 57.0 5472 0.0443 0.8911 0.9574 0.9231 94 0.9141 0.8922 0.9030 167 0.9926 0.9781 0.9853 137 0.9348 0.9372 0.9360 0.9873
0.0148 58.0 5568 0.0479 0.8980 0.9362 0.9167 94 0.9273 0.9162 0.9217 167 1.0 0.9781 0.9889 137 0.9446 0.9422 0.9434 0.9870
0.0136 59.0 5664 0.0509 0.8641 0.9468 0.9036 94 0.9102 0.9102 0.9102 167 1.0 0.9781 0.9889 137 0.9282 0.9422 0.9352 0.9865
0.0141 60.0 5760 0.0581 0.8476 0.9468 0.8945 94 0.9329 0.9162 0.9245 167 1.0 0.9781 0.9889 137 0.9330 0.9447 0.9388 0.9856
0.0135 61.0 5856 0.0474 0.8725 0.9468 0.9082 94 0.9217 0.9162 0.9189 167 0.9926 0.9781 0.9853 137 0.9330 0.9447 0.9388 0.9887
0.0135 62.0 5952 0.0525 0.8812 0.9468 0.9128 94 0.9259 0.8982 0.9119 167 0.9853 0.9781 0.9817 137 0.9348 0.9372 0.9360 0.9865
0.0125 63.0 6048 0.0510 0.8878 0.9255 0.9062 94 0.9202 0.8982 0.9091 167 0.9779 0.9708 0.9744 137 0.9320 0.9296 0.9308 0.9856
0.0142 64.0 6144 0.0533 0.8812 0.9468 0.9128 94 0.9198 0.8922 0.9058 167 0.9926 0.9781 0.9853 137 0.9347 0.9347 0.9347 0.9862
0.0137 65.0 6240 0.0534 0.8431 0.9149 0.8776 94 0.9198 0.8922 0.9058 167 0.9926 0.9781 0.9853 137 0.9248 0.9271 0.9260 0.9856
0.0132 66.0 6336 0.0523 0.87 0.9255 0.8969 94 0.9548 0.8862 0.9193 167 0.9853 0.9781 0.9817 137 0.9437 0.9271 0.9354 0.9865
0.0136 67.0 6432 0.0542 0.8447 0.9255 0.8832 94 0.9141 0.8922 0.9030 167 0.9852 0.9708 0.9779 137 0.9202 0.9271 0.9237 0.9851
0.0113 68.0 6528 0.0497 0.8776 0.9149 0.8958 94 0.9042 0.9042 0.9042 167 0.9926 0.9781 0.9853 137 0.9275 0.9322 0.9298 0.9859
0.0121 69.0 6624 0.0473 0.8641 0.9468 0.9036 94 0.9367 0.8862 0.9108 167 0.9926 0.9781 0.9853 137 0.9369 0.9322 0.9345 0.9884
0.0124 70.0 6720 0.0438 0.8788 0.9255 0.9016 94 0.9321 0.9042 0.9179 167 1.0 0.9854 0.9926 137 0.9419 0.9372 0.9395 0.9887
0.0132 71.0 6816 0.0438 0.87 0.9255 0.8969 94 0.9162 0.9162 0.9162 167 0.9926 0.9781 0.9853 137 0.9303 0.9397 0.9350 0.9881
0.0127 72.0 6912 0.0513 0.8627 0.9362 0.8980 94 0.9277 0.9222 0.9249 167 1.0 0.9781 0.9889 137 0.9353 0.9447 0.94 0.9876
0.0107 73.0 7008 0.0499 0.8476 0.9468 0.8945 94 0.9308 0.8862 0.9080 167 0.9926 0.9781 0.9853 137 0.9298 0.9322 0.9310 0.9876
0.0114 74.0 7104 0.0467 0.8889 0.9362 0.9119 94 0.9264 0.9042 0.9152 167 0.9779 0.9708 0.9744 137 0.9347 0.9347 0.9347 0.9890
0.0103 75.0 7200 0.0486 0.8654 0.9574 0.9091 94 0.9259 0.8982 0.9119 167 1.0 0.9854 0.9926 137 0.9352 0.9422 0.9387 0.9887
0.0101 76.0 7296 0.0512 0.8544 0.9362 0.8934 94 0.925 0.8862 0.9052 167 1.0 0.9854 0.9926 137 0.9322 0.9322 0.9322 0.9873
0.0101 77.0 7392 0.0530 0.8447 0.9255 0.8832 94 0.9130 0.8802 0.8963 167 1.0 0.9854 0.9926 137 0.9248 0.9271 0.9260 0.9862
0.0094 78.0 7488 0.0495 0.8878 0.9255 0.9062 94 0.9212 0.9102 0.9157 167 1.0 0.9854 0.9926 137 0.9397 0.9397 0.9397 0.9887
0.0099 79.0 7584 0.0508 0.9158 0.9255 0.9206 94 0.9281 0.9281 0.9281 167 1.0 0.9854 0.9926 137 0.9496 0.9472 0.9484 0.9887
0.0097 80.0 7680 0.0553 0.8614 0.9255 0.8923 94 0.9268 0.9102 0.9184 167 1.0 0.9854 0.9926 137 0.935 0.9397 0.9373 0.9870
0.009 81.0 7776 0.0551 0.8447 0.9255 0.8832 94 0.9259 0.8982 0.9119 167 0.9926 0.9854 0.9890 137 0.9277 0.9347 0.9312 0.9865
0.0096 82.0 7872 0.0544 0.8878 0.9255 0.9062 94 0.9157 0.9102 0.9129 167 0.9926 0.9854 0.9890 137 0.935 0.9397 0.9373 0.9873
0.0103 83.0 7968 0.0530 0.8713 0.9362 0.9026 94 0.9268 0.9102 0.9184 167 0.9926 0.9781 0.9853 137 0.935 0.9397 0.9373 0.9873
0.0094 84.0 8064 0.0547 0.8544 0.9362 0.8934 94 0.9259 0.8982 0.9119 167 1.0 0.9781 0.9889 137 0.9323 0.9347 0.9335 0.9862
0.0087 85.0 8160 0.0532 0.8713 0.9362 0.9026 94 0.9202 0.8982 0.9091 167 1.0 0.9781 0.9889 137 0.9347 0.9347 0.9347 0.9870
0.0094 86.0 8256 0.0555 0.8627 0.9362 0.8980 94 0.9255 0.8922 0.9085 167 0.9926 0.9781 0.9853 137 0.9322 0.9322 0.9322 0.9865
0.0092 87.0 8352 0.0544 0.8333 0.9574 0.8911 94 0.9317 0.8982 0.9146 167 0.9926 0.9781 0.9853 137 0.9257 0.9397 0.9327 0.9870
0.0098 88.0 8448 0.0556 0.8529 0.9255 0.8878 94 0.9308 0.8862 0.9080 167 0.9926 0.9781 0.9853 137 0.9318 0.9271 0.9295 0.9859
0.008 89.0 8544 0.0557 0.8447 0.9255 0.8832 94 0.9317 0.8982 0.9146 167 0.9926 0.9781 0.9853 137 0.9298 0.9322 0.9310 0.9862
0.0087 90.0 8640 0.0531 0.8544 0.9362 0.8934 94 0.9317 0.8982 0.9146 167 0.9926 0.9781 0.9853 137 0.9323 0.9347 0.9335 0.9873
0.0094 91.0 8736 0.0544 0.8529 0.9255 0.8878 94 0.9193 0.8862 0.9024 167 0.9853 0.9781 0.9817 137 0.9248 0.9271 0.9260 0.9862
0.0083 92.0 8832 0.0591 0.8529 0.9255 0.8878 94 0.9375 0.8982 0.9174 167 1.0 0.9781 0.9889 137 0.9369 0.9322 0.9345 0.9859
0.0081 93.0 8928 0.0565 0.8447 0.9255 0.8832 94 0.9264 0.9042 0.9152 167 1.0 0.9781 0.9889 137 0.93 0.9347 0.9323 0.9862
0.0083 94.0 9024 0.0543 0.8529 0.9255 0.8878 94 0.9255 0.8922 0.9085 167 0.9926 0.9781 0.9853 137 0.9296 0.9296 0.9296 0.9865
0.0084 95.0 9120 0.0516 0.8725 0.9468 0.9082 94 0.9207 0.9042 0.9124 167 1.0 0.9781 0.9889 137 0.935 0.9397 0.9373 0.9873
0.0089 96.0 9216 0.0520 0.8627 0.9362 0.8980 94 0.9141 0.8922 0.9030 167 0.9926 0.9781 0.9853 137 0.9275 0.9322 0.9298 0.9867
0.0076 97.0 9312 0.0528 0.8544 0.9362 0.8934 94 0.9141 0.8922 0.9030 167 0.9926 0.9781 0.9853 137 0.9252 0.9322 0.9287 0.9865
0.0091 98.0 9408 0.0530 0.8447 0.9255 0.8832 94 0.9141 0.8922 0.9030 167 0.9926 0.9781 0.9853 137 0.9227 0.9296 0.9262 0.9862
0.0089 99.0 9504 0.0528 0.8544 0.9362 0.8934 94 0.9198 0.8922 0.9058 167 0.9926 0.9781 0.9853 137 0.9275 0.9322 0.9298 0.9862
0.0083 100.0 9600 0.0530 0.8447 0.9255 0.8832 94 0.9198 0.8922 0.9058 167 0.9926 0.9781 0.9853 137 0.925 0.9296 0.9273 0.9859

Framework versions

  • Transformers 4.39.3
  • Pytorch 2.3.0+cu121
  • Datasets 2.19.1
  • Tokenizers 0.15.2