nerui-pt-pl10-4

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.0582
• Location Precision: 0.9182
• Location Recall: 0.9806
• Location F1: 0.9484
• Location Number: 103
• Organization Precision: 0.9325
• Organization Recall: 0.8889
• Organization F1: 0.9102
• Organization Number: 171
• Person Precision: 0.9549
• Person Recall: 0.9695
• Person F1: 0.9621
• Person Number: 131
• Overall Precision: 0.9360
• Overall Recall: 0.9383
• Overall F1: 0.9371
• Overall Accuracy: 0.9884

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.8413	1.0	96	0.3861	0.6667	0.0388	0.0734	103	0.2460	0.3626	0.2931	171	0.2866	0.3435	0.3125	131	0.2675	0.2741	0.2707	0.8702
0.3574	2.0	192	0.2100	0.392	0.4757	0.4298	103	0.6425	0.6725	0.6571	171	0.6398	0.7863	0.7055	131	0.5742	0.6593	0.6138	0.9384
0.1857	3.0	288	0.1032	0.8172	0.7379	0.7755	103	0.7581	0.8246	0.7899	171	0.9474	0.9618	0.9545	131	0.8325	0.8469	0.8397	0.9674
0.1252	4.0	384	0.0721	0.8	0.8544	0.8263	103	0.8054	0.8713	0.8371	171	0.9556	0.9847	0.9699	131	0.8512	0.9037	0.8766	0.9749
0.1047	5.0	480	0.0612	0.89	0.8641	0.8768	103	0.8258	0.8596	0.8424	171	0.9485	0.9847	0.9663	131	0.8816	0.9012	0.8913	0.9801
0.0891	6.0	576	0.0622	0.7402	0.9126	0.8174	103	0.8831	0.7953	0.8369	171	0.9847	0.9847	0.9847	131	0.8714	0.8864	0.8788	0.9796
0.0819	7.0	672	0.0523	0.9032	0.8155	0.8571	103	0.8441	0.9181	0.8796	171	0.9773	0.9847	0.9810	131	0.9002	0.9136	0.9069	0.9848
0.077	8.0	768	0.0469	0.8611	0.9029	0.8815	103	0.8701	0.9006	0.8851	171	0.9846	0.9771	0.9808	131	0.9036	0.9259	0.9146	0.9859
0.0726	9.0	864	0.0482	0.9029	0.9029	0.9029	103	0.8674	0.9181	0.8920	171	0.9847	0.9847	0.9847	131	0.9133	0.9358	0.9244	0.9859
0.0664	10.0	960	0.0503	0.8	0.9320	0.8610	103	0.8571	0.8421	0.8496	171	0.9847	0.9847	0.9847	131	0.8807	0.9111	0.8956	0.9815
0.0571	11.0	1056	0.0422	0.8505	0.8835	0.8667	103	0.8686	0.8889	0.8786	171	0.9846	0.9771	0.9808	131	0.9005	0.9160	0.9082	0.9862
0.0572	12.0	1152	0.0457	0.8835	0.8835	0.8835	103	0.8889	0.8889	0.8889	171	0.9695	0.9695	0.9695	131	0.9136	0.9136	0.9136	0.9865
0.0526	13.0	1248	0.0499	0.8220	0.9417	0.8778	103	0.9119	0.8480	0.8788	171	0.9846	0.9771	0.9808	131	0.9091	0.9136	0.9113	0.9832
0.0525	14.0	1344	0.0471	0.9118	0.9029	0.9073	103	0.9059	0.9006	0.9032	171	0.9846	0.9771	0.9808	131	0.9328	0.9259	0.9294	0.9881
0.0496	15.0	1440	0.0403	0.8981	0.9417	0.9194	103	0.9042	0.8830	0.8935	171	0.9846	0.9771	0.9808	131	0.9284	0.9284	0.9284	0.9884
0.046	16.0	1536	0.0440	0.8807	0.9320	0.9057	103	0.8647	0.8596	0.8622	171	0.9846	0.9771	0.9808	131	0.9071	0.9160	0.9115	0.9856
0.0451	17.0	1632	0.0445	0.9293	0.8932	0.9109	103	0.8889	0.9357	0.9117	171	0.9697	0.9771	0.9734	131	0.9246	0.9383	0.9314	0.9873
0.0424	18.0	1728	0.0390	0.9038	0.9126	0.9082	103	0.8814	0.9123	0.8966	171	0.9846	0.9771	0.9808	131	0.9197	0.9333	0.9265	0.9870
0.0414	19.0	1824	0.0425	0.8889	0.9320	0.9100	103	0.9202	0.8772	0.8982	171	0.9695	0.9695	0.9695	131	0.9279	0.9210	0.9244	0.9870
0.0396	20.0	1920	0.0424	0.9135	0.9223	0.9179	103	0.8827	0.9240	0.9029	171	0.9769	0.9695	0.9732	131	0.9201	0.9383	0.9291	0.9873
0.0374	21.0	2016	0.0446	0.8362	0.9417	0.8858	103	0.8951	0.8480	0.8709	171	0.9846	0.9771	0.9808	131	0.9069	0.9136	0.9102	0.9851
0.0366	22.0	2112	0.0452	0.8584	0.9417	0.8981	103	0.8876	0.8772	0.8824	171	0.9846	0.9771	0.9808	131	0.9102	0.9259	0.9180	0.9859
0.0347	23.0	2208	0.0434	0.8899	0.9417	0.9151	103	0.9152	0.8830	0.8988	171	0.9846	0.9771	0.9808	131	0.9307	0.9284	0.9295	0.9870
0.0317	24.0	2304	0.0429	0.8981	0.9417	0.9194	103	0.9102	0.8889	0.8994	171	0.9621	0.9695	0.9658	131	0.9238	0.9284	0.9261	0.9870
0.0312	25.0	2400	0.0556	0.8333	0.9709	0.8969	103	0.9262	0.8070	0.8625	171	0.9695	0.9695	0.9695	131	0.9125	0.9012	0.9068	0.9843
0.0306	26.0	2496	0.0394	0.9057	0.9320	0.9187	103	0.8941	0.8889	0.8915	171	0.9846	0.9771	0.9808	131	0.9261	0.9284	0.9273	0.9878
0.0287	27.0	2592	0.0505	0.8522	0.9515	0.8991	103	0.8931	0.8304	0.8606	171	0.9695	0.9695	0.9695	131	0.9062	0.9062	0.9062	0.9845
0.0278	28.0	2688	0.0344	0.9592	0.9126	0.9353	103	0.9091	0.9357	0.9222	171	0.9695	0.9695	0.9695	131	0.9407	0.9407	0.9407	0.9906
0.0276	29.0	2784	0.0428	0.875	0.9515	0.9116	103	0.8951	0.8480	0.8709	171	0.9695	0.9695	0.9695	131	0.9136	0.9136	0.9136	0.9848
0.0261	30.0	2880	0.0423	0.95	0.9223	0.9360	103	0.8715	0.9123	0.8914	171	0.9549	0.9695	0.9621	131	0.9175	0.9333	0.9253	0.9876
0.0262	31.0	2976	0.0451	0.8673	0.9515	0.9074	103	0.9182	0.8538	0.8848	171	0.9549	0.9695	0.9621	131	0.9160	0.9160	0.9160	0.9854
0.026	32.0	3072	0.0398	0.8739	0.9417	0.9065	103	0.9375	0.8772	0.9063	171	0.9618	0.9618	0.9618	131	0.9279	0.9210	0.9244	0.9867
0.0265	33.0	3168	0.0440	0.9057	0.9320	0.9187	103	0.9	0.8947	0.8974	171	0.9618	0.9618	0.9618	131	0.9214	0.9259	0.9236	0.9862
0.0258	34.0	3264	0.0424	0.8818	0.9417	0.9108	103	0.9012	0.9064	0.9038	171	0.9618	0.9618	0.9618	131	0.9153	0.9333	0.9242	0.9859
0.0257	35.0	3360	0.0474	0.8909	0.9515	0.9202	103	0.8841	0.8480	0.8657	171	0.9621	0.9695	0.9658	131	0.9113	0.9136	0.9125	0.9840
0.0249	36.0	3456	0.0481	0.8376	0.9515	0.8909	103	0.8987	0.8304	0.8632	171	0.9549	0.9695	0.9621	131	0.8995	0.9062	0.9028	0.9845
0.0232	37.0	3552	0.0395	0.9515	0.9515	0.9515	103	0.8902	0.9006	0.8953	171	0.9621	0.9695	0.9658	131	0.9289	0.9358	0.9323	0.9887
0.0221	38.0	3648	0.0503	0.9074	0.9515	0.9289	103	0.9437	0.8830	0.9124	171	0.9618	0.9618	0.9618	131	0.9398	0.9259	0.9328	0.9876
0.0215	39.0	3744	0.0458	0.9151	0.9417	0.9282	103	0.9042	0.8830	0.8935	171	0.9618	0.9618	0.9618	131	0.9257	0.9235	0.9246	0.9854
0.0206	40.0	3840	0.0452	0.9091	0.9709	0.9390	103	0.9268	0.8889	0.9075	171	0.9618	0.9618	0.9618	131	0.9333	0.9333	0.9333	0.9876
0.0208	41.0	3936	0.0527	0.9333	0.9515	0.9423	103	0.9325	0.8889	0.9102	171	0.9545	0.9618	0.9582	131	0.94	0.9284	0.9342	0.9870
0.0189	42.0	4032	0.0430	0.9252	0.9612	0.9429	103	0.9325	0.8889	0.9102	171	0.9695	0.9695	0.9695	131	0.9426	0.9333	0.9380	0.9884
0.0196	43.0	4128	0.0431	0.9167	0.9612	0.9384	103	0.9281	0.9064	0.9172	171	0.9618	0.9618	0.9618	131	0.9360	0.9383	0.9371	0.9876
0.0197	44.0	4224	0.0536	0.8899	0.9417	0.9151	103	0.8757	0.8655	0.8706	171	0.9621	0.9695	0.9658	131	0.9073	0.9185	0.9129	0.9832
0.0199	45.0	4320	0.0587	0.8621	0.9709	0.9132	103	0.9231	0.8421	0.8807	171	0.9545	0.9618	0.9582	131	0.9158	0.9136	0.9147	0.9840
0.0193	46.0	4416	0.0530	0.8684	0.9612	0.9124	103	0.9130	0.8596	0.8855	171	0.9549	0.9695	0.9621	131	0.9142	0.9210	0.9176	0.9840
0.0173	47.0	4512	0.0459	0.9423	0.9515	0.9469	103	0.9006	0.9006	0.9006	171	0.9549	0.9695	0.9621	131	0.9289	0.9358	0.9323	0.9878
0.0197	48.0	4608	0.0593	0.9009	0.9709	0.9346	103	0.9119	0.8480	0.8788	171	0.9549	0.9695	0.9621	131	0.9231	0.9185	0.9208	0.9848
0.0164	49.0	4704	0.0491	0.9167	0.9612	0.9384	103	0.9085	0.8713	0.8896	171	0.9545	0.9618	0.9582	131	0.9257	0.9235	0.9246	0.9859
0.0174	50.0	4800	0.0476	0.9259	0.9709	0.9479	103	0.9053	0.8947	0.9000	171	0.9621	0.9695	0.9658	131	0.9291	0.9383	0.9337	0.9870
0.0176	51.0	4896	0.0621	0.8938	0.9806	0.9352	103	0.9551	0.8713	0.9113	171	0.9545	0.9618	0.9582	131	0.9377	0.9284	0.9330	0.9848
0.0162	52.0	4992	0.0519	0.9340	0.9612	0.9474	103	0.9212	0.8889	0.9048	171	0.9545	0.9618	0.9582	131	0.9355	0.9309	0.9332	0.9867
0.0161	53.0	5088	0.0469	0.9151	0.9417	0.9282	103	0.8960	0.9064	0.9012	171	0.9549	0.9695	0.9621	131	0.9199	0.9358	0.9278	0.9862
0.0149	54.0	5184	0.0454	0.8929	0.9709	0.9302	103	0.9012	0.9064	0.9038	171	0.9621	0.9695	0.9658	131	0.9183	0.9432	0.9306	0.9867
0.0167	55.0	5280	0.0463	0.9259	0.9709	0.9479	103	0.9329	0.8947	0.9134	171	0.9621	0.9695	0.9658	131	0.9406	0.9383	0.9394	0.9881
0.0143	56.0	5376	0.0430	0.9266	0.9806	0.9528	103	0.9506	0.9006	0.9249	171	0.9621	0.9695	0.9658	131	0.9479	0.9432	0.9455	0.9884
0.015	57.0	5472	0.0459	0.9340	0.9612	0.9474	103	0.9207	0.8830	0.9015	171	0.9695	0.9695	0.9695	131	0.9401	0.9309	0.9355	0.9881
0.0145	58.0	5568	0.0456	0.8929	0.9709	0.9302	103	0.9268	0.8889	0.9075	171	0.9695	0.9695	0.9695	131	0.9312	0.9358	0.9335	0.9870
0.0146	59.0	5664	0.0427	0.8991	0.9515	0.9245	103	0.9059	0.9006	0.9032	171	0.9695	0.9695	0.9695	131	0.9244	0.9358	0.9301	0.9876
0.0134	60.0	5760	0.0471	0.9107	0.9903	0.9488	103	0.9286	0.9123	0.9204	171	0.9695	0.9695	0.9695	131	0.9367	0.9506	0.9436	0.9878
0.0147	61.0	5856	0.0444	0.9320	0.9320	0.9320	103	0.9064	0.9064	0.9064	171	0.9549	0.9695	0.9621	131	0.9287	0.9333	0.9310	0.9881
0.0135	62.0	5952	0.0478	0.9167	0.9612	0.9384	103	0.8966	0.9123	0.9043	171	0.9621	0.9695	0.9658	131	0.9227	0.9432	0.9328	0.9867
0.0134	63.0	6048	0.0512	0.9159	0.9515	0.9333	103	0.9053	0.8947	0.9000	171	0.9771	0.9771	0.9771	131	0.9312	0.9358	0.9335	0.9873
0.0126	64.0	6144	0.0531	0.9167	0.9612	0.9384	103	0.9212	0.8889	0.9048	171	0.9621	0.9695	0.9658	131	0.9333	0.9333	0.9333	0.9876
0.0123	65.0	6240	0.0489	0.9327	0.9417	0.9372	103	0.9222	0.9006	0.9112	171	0.9549	0.9695	0.9621	131	0.9356	0.9333	0.9345	0.9876
0.0136	66.0	6336	0.0506	0.9182	0.9806	0.9484	103	0.9333	0.9006	0.9167	171	0.9549	0.9695	0.9621	131	0.9363	0.9432	0.9397	0.9870
0.0118	67.0	6432	0.0492	0.9182	0.9806	0.9484	103	0.9329	0.8947	0.9134	171	0.9549	0.9695	0.9621	131	0.9361	0.9407	0.9384	0.9873
0.0114	68.0	6528	0.0553	0.9107	0.9903	0.9488	103	0.9383	0.8889	0.9129	171	0.9549	0.9695	0.9621	131	0.9361	0.9407	0.9384	0.9865
0.0118	69.0	6624	0.0585	0.9182	0.9806	0.9484	103	0.9444	0.8947	0.9189	171	0.9549	0.9695	0.9621	131	0.9407	0.9407	0.9407	0.9865
0.0114	70.0	6720	0.0514	0.9	0.9612	0.9296	103	0.8988	0.8830	0.8909	171	0.9549	0.9695	0.9621	131	0.9173	0.9309	0.9240	0.9859
0.0112	71.0	6816	0.0511	0.9083	0.9612	0.9340	103	0.8947	0.8947	0.8947	171	0.9549	0.9695	0.9621	131	0.9177	0.9358	0.9267	0.9862
0.0096	72.0	6912	0.0667	0.8938	0.9806	0.9352	103	0.9367	0.8655	0.8997	171	0.9621	0.9695	0.9658	131	0.9330	0.9284	0.9307	0.9856
0.0113	73.0	7008	0.0530	0.8829	0.9515	0.9159	103	0.9329	0.8947	0.9134	171	0.9695	0.9695	0.9695	131	0.9310	0.9333	0.9322	0.9876
0.0124	74.0	7104	0.0508	0.9083	0.9612	0.9340	103	0.9167	0.9006	0.9086	171	0.9621	0.9695	0.9658	131	0.9291	0.9383	0.9337	0.9873
0.0116	75.0	7200	0.0496	0.9083	0.9612	0.9340	103	0.9329	0.8947	0.9134	171	0.9621	0.9695	0.9658	131	0.9358	0.9358	0.9358	0.9881
0.0116	76.0	7296	0.0528	0.9167	0.9612	0.9384	103	0.8960	0.9064	0.9012	171	0.9621	0.9695	0.9658	131	0.9225	0.9407	0.9315	0.9878
0.0103	77.0	7392	0.0657	0.8870	0.9903	0.9358	103	0.9487	0.8655	0.9052	171	0.9621	0.9695	0.9658	131	0.9355	0.9309	0.9332	0.9865
0.0106	78.0	7488	0.0540	0.8899	0.9417	0.9151	103	0.9048	0.8889	0.8968	171	0.9621	0.9695	0.9658	131	0.9193	0.9284	0.9238	0.9867
0.0089	79.0	7584	0.0556	0.9182	0.9806	0.9484	103	0.9444	0.8947	0.9189	171	0.9621	0.9695	0.9658	131	0.9431	0.9407	0.9419	0.9884
0.0103	80.0	7680	0.0562	0.9009	0.9709	0.9346	103	0.9217	0.8947	0.9080	171	0.9618	0.9618	0.9618	131	0.9289	0.9358	0.9323	0.9870
0.0089	81.0	7776	0.0528	0.9167	0.9612	0.9384	103	0.9012	0.9064	0.9038	171	0.9618	0.9618	0.9618	131	0.9246	0.9383	0.9314	0.9873
0.0096	82.0	7872	0.0590	0.9099	0.9806	0.9439	103	0.9207	0.8830	0.9015	171	0.9545	0.9618	0.9582	131	0.9287	0.9333	0.9310	0.9859
0.0092	83.0	7968	0.0577	0.9009	0.9709	0.9346	103	0.9146	0.8772	0.8955	171	0.9618	0.9618	0.9618	131	0.9261	0.9284	0.9273	0.9867
0.0092	84.0	8064	0.0562	0.8991	0.9515	0.9245	103	0.8837	0.8889	0.8863	171	0.9545	0.9618	0.9582	131	0.9104	0.9284	0.9193	0.9854
0.0095	85.0	8160	0.0574	0.9159	0.9515	0.9333	103	0.8994	0.8889	0.8941	171	0.9618	0.9618	0.9618	131	0.9238	0.9284	0.9261	0.9862
0.0084	86.0	8256	0.0568	0.9083	0.9612	0.9340	103	0.9202	0.8772	0.8982	171	0.9549	0.9695	0.9621	131	0.9284	0.9284	0.9284	0.9867
0.008	87.0	8352	0.0562	0.9182	0.9806	0.9484	103	0.9325	0.8889	0.9102	171	0.9549	0.9695	0.9621	131	0.9360	0.9383	0.9371	0.9876
0.0081	88.0	8448	0.0545	0.9091	0.9709	0.9390	103	0.9217	0.8947	0.9080	171	0.9549	0.9695	0.9621	131	0.9291	0.9383	0.9337	0.9873
0.0096	89.0	8544	0.0530	0.9009	0.9709	0.9346	103	0.9059	0.9006	0.9032	171	0.9549	0.9695	0.9621	131	0.9203	0.9407	0.9304	0.9867
0.0081	90.0	8640	0.0564	0.9009	0.9709	0.9346	103	0.9146	0.8772	0.8955	171	0.9549	0.9695	0.9621	131	0.9240	0.9309	0.9274	0.9859
0.0073	91.0	8736	0.0562	0.9009	0.9709	0.9346	103	0.9053	0.8947	0.9000	171	0.9549	0.9695	0.9621	131	0.9201	0.9383	0.9291	0.9873
0.0078	92.0	8832	0.0591	0.9099	0.9806	0.9439	103	0.9379	0.8830	0.9096	171	0.9549	0.9695	0.9621	131	0.9358	0.9358	0.9358	0.9876
0.0082	93.0	8928	0.0602	0.9099	0.9806	0.9439	103	0.9437	0.8830	0.9124	171	0.9549	0.9695	0.9621	131	0.9381	0.9358	0.9370	0.9876
0.0062	94.0	9024	0.0583	0.9182	0.9806	0.9484	103	0.9277	0.9006	0.9139	171	0.9549	0.9695	0.9621	131	0.9340	0.9432	0.9386	0.9884
0.0083	95.0	9120	0.0589	0.9099	0.9806	0.9439	103	0.9325	0.8889	0.9102	171	0.9549	0.9695	0.9621	131	0.9337	0.9383	0.9360	0.9881
0.0072	96.0	9216	0.0584	0.9099	0.9806	0.9439	103	0.9264	0.8830	0.9042	171	0.9549	0.9695	0.9621	131	0.9312	0.9358	0.9335	0.9878
0.009	97.0	9312	0.0584	0.9099	0.9806	0.9439	103	0.9264	0.8830	0.9042	171	0.9549	0.9695	0.9621	131	0.9312	0.9358	0.9335	0.9878
0.0066	98.0	9408	0.0587	0.9099	0.9806	0.9439	103	0.9325	0.8889	0.9102	171	0.9549	0.9695	0.9621	131	0.9337	0.9383	0.9360	0.9884
0.007	99.0	9504	0.0584	0.9182	0.9806	0.9484	103	0.9325	0.8889	0.9102	171	0.9549	0.9695	0.9621	131	0.9360	0.9383	0.9371	0.9881
0.009	100.0	9600	0.0582	0.9182	0.9806	0.9484	103	0.9325	0.8889	0.9102	171	0.9549	0.9695	0.9621	131	0.9360	0.9383	0.9371	0.9884

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2