nerui-pt-pl20-1

This model is a fine-tuned version of indolem/indobert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.0469
• Location Precision: 0.9328
• Location Recall: 0.9569
• Location F1: 0.9447
• Location Number: 116
• Organization Precision: 0.9669
• Organization Recall: 0.9241
• Organization F1: 0.9450
• Organization Number: 158
• Person Precision: 0.9762
• Person Recall: 0.9919
• Person F1: 0.9840
• Person Number: 124
• Overall Precision: 0.9596
• Overall Recall: 0.9548
• Overall F1: 0.9572
• Overall Accuracy: 0.9912

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 16
• eval_batch_size: 64
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100.0

Training results

Training Loss	Epoch	Step	Validation Loss	Location Precision	Location Recall	Location F1	Location Number	Organization Precision	Organization Recall	Organization F1	Organization Number	Person Precision	Person Recall	Person F1	Person Number	Overall Precision	Overall Recall	Overall F1	Overall Accuracy
0.8553	1.0	96	0.4029	0.0	0.0	0.0	116	0.2697	0.2595	0.2645	158	0.2832	0.2581	0.2700	124	0.2724	0.1834	0.2192	0.8644
0.3858	2.0	192	0.2569	0.3727	0.3534	0.3628	116	0.5401	0.4684	0.5017	158	0.4053	0.6210	0.4904	124	0.4394	0.4824	0.4599	0.9163
0.2184	3.0	288	0.1100	0.7154	0.7586	0.7364	116	0.6961	0.7975	0.7434	158	0.9242	0.9839	0.9531	124	0.7706	0.8442	0.8058	0.9654
0.1431	4.0	384	0.0817	0.7891	0.8707	0.8279	116	0.8140	0.8861	0.8485	158	0.9685	0.9919	0.9801	124	0.8525	0.9146	0.8824	0.9750
0.1164	5.0	480	0.0710	0.88	0.7586	0.8148	116	0.8103	0.8924	0.8494	158	0.976	0.9839	0.9799	124	0.8797	0.8819	0.8808	0.9778
0.1025	6.0	576	0.0525	0.8359	0.9224	0.8770	116	0.8875	0.8987	0.8931	158	0.9535	0.9919	0.9723	124	0.8921	0.9347	0.9129	0.9841
0.089	7.0	672	0.0429	0.9052	0.9052	0.9052	116	0.8757	0.9367	0.9052	158	0.9685	0.9919	0.9801	124	0.9126	0.9447	0.9284	0.9868
0.0784	8.0	768	0.0461	0.8571	0.9310	0.8926	116	0.8961	0.8734	0.8846	158	0.984	0.9919	0.9880	124	0.9111	0.9271	0.9191	0.9846
0.0736	9.0	864	0.0367	0.9091	0.9483	0.9283	116	0.9074	0.9304	0.9187	158	0.976	0.9839	0.9799	124	0.9289	0.9523	0.9404	0.9887
0.0645	10.0	960	0.0383	0.875	0.9655	0.9180	116	0.9416	0.9177	0.9295	158	0.9685	0.9919	0.9801	124	0.9291	0.9548	0.9418	0.9879
0.0601	11.0	1056	0.0351	0.9262	0.9741	0.9496	116	0.9375	0.9494	0.9434	158	0.984	0.9919	0.9880	124	0.9484	0.9698	0.9590	0.9901
0.059	12.0	1152	0.0355	0.8983	0.9138	0.9060	116	0.9423	0.9304	0.9363	158	0.9609	0.9919	0.9762	124	0.9353	0.9447	0.94	0.9893
0.0534	13.0	1248	0.0377	0.9145	0.9224	0.9185	116	0.9618	0.9557	0.9587	158	0.9685	0.9919	0.9801	124	0.9501	0.9573	0.9537	0.9904
0.0502	14.0	1344	0.0308	0.9391	0.9310	0.9351	116	0.9554	0.9494	0.9524	158	0.9685	0.9919	0.9801	124	0.9549	0.9573	0.9561	0.9912
0.0454	15.0	1440	0.0347	0.8992	0.9224	0.9106	116	0.9423	0.9304	0.9363	158	0.9685	0.9919	0.9801	124	0.9378	0.9472	0.9425	0.9896
0.0451	16.0	1536	0.0302	0.9244	0.9483	0.9362	116	0.9608	0.9304	0.9453	158	0.9762	0.9919	0.9840	124	0.9548	0.9548	0.9548	0.9909
0.0436	17.0	1632	0.0330	0.9091	0.9483	0.9283	116	0.9542	0.9241	0.9389	158	0.9762	0.9919	0.9840	124	0.9475	0.9523	0.9499	0.9904
0.0407	18.0	1728	0.0355	0.9167	0.9483	0.9322	116	0.9542	0.9241	0.9389	158	0.984	0.9919	0.9880	124	0.9523	0.9523	0.9523	0.9909
0.0385	19.0	1824	0.0362	0.9145	0.9224	0.9185	116	0.9481	0.9241	0.9359	158	0.9762	0.9919	0.9840	124	0.9471	0.9447	0.9459	0.9887
0.0351	20.0	1920	0.0373	0.9402	0.9483	0.9442	116	0.9367	0.9367	0.9367	158	0.9762	0.9919	0.9840	124	0.9501	0.9573	0.9537	0.9896
0.0353	21.0	2016	0.0340	0.9244	0.9483	0.9362	116	0.9673	0.9367	0.9518	158	0.9762	0.9919	0.9840	124	0.9573	0.9573	0.9573	0.9912
0.0332	22.0	2112	0.0351	0.9231	0.9310	0.9270	116	0.9419	0.9241	0.9329	158	0.9762	0.9919	0.9840	124	0.9472	0.9472	0.9472	0.9901
0.0329	23.0	2208	0.0311	0.9316	0.9397	0.9356	116	0.9613	0.9430	0.9521	158	0.9762	0.9919	0.9840	124	0.9573	0.9573	0.9573	0.9912
0.0332	24.0	2304	0.0341	0.9333	0.9655	0.9492	116	0.9481	0.9241	0.9359	158	0.984	0.9919	0.9880	124	0.9549	0.9573	0.9561	0.9904
0.0302	25.0	2400	0.0358	0.9231	0.9310	0.9270	116	0.9487	0.9367	0.9427	158	0.9762	0.9919	0.9840	124	0.9499	0.9523	0.9511	0.9907
0.0314	26.0	2496	0.0319	0.9402	0.9483	0.9442	116	0.9554	0.9494	0.9524	158	0.9685	0.9919	0.9801	124	0.9551	0.9623	0.9587	0.9912
0.0297	27.0	2592	0.0327	0.9322	0.9483	0.9402	116	0.9545	0.9304	0.9423	158	0.984	0.9919	0.9880	124	0.9572	0.9548	0.9560	0.9912
0.0265	28.0	2688	0.0388	0.9091	0.9483	0.9283	116	0.9359	0.9241	0.9299	158	0.984	0.9919	0.9880	124	0.9428	0.9523	0.9475	0.9904
0.027	29.0	2784	0.0404	0.9091	0.9483	0.9283	116	0.9539	0.9177	0.9355	158	0.9762	0.9919	0.9840	124	0.9474	0.9497	0.9486	0.9898
0.0273	30.0	2880	0.0402	0.9469	0.9224	0.9345	116	0.9551	0.9430	0.9490	158	0.9762	0.9919	0.9840	124	0.9595	0.9523	0.9559	0.9909
0.0245	31.0	2976	0.0348	0.9328	0.9569	0.9447	116	0.9605	0.9241	0.9419	158	0.9762	0.9919	0.9840	124	0.9572	0.9548	0.9560	0.9907
0.0221	32.0	3072	0.0366	0.9316	0.9397	0.9356	116	0.9481	0.9241	0.9359	158	0.984	0.9919	0.9880	124	0.9545	0.9497	0.9521	0.9909
0.023	33.0	3168	0.0401	0.9402	0.9483	0.9442	116	0.9799	0.9241	0.9511	158	0.9762	0.9919	0.9840	124	0.9668	0.9523	0.9595	0.9893
0.0219	34.0	3264	0.0348	0.9407	0.9569	0.9487	116	0.9551	0.9430	0.9490	158	0.9685	0.9919	0.9801	124	0.9551	0.9623	0.9587	0.9915
0.0227	35.0	3360	0.0399	0.9310	0.9310	0.9310	116	0.9605	0.9241	0.9419	158	0.9685	0.9919	0.9801	124	0.9544	0.9472	0.9508	0.9882
0.0194	36.0	3456	0.0370	0.92	0.9914	0.9544	116	0.9737	0.9367	0.9548	158	0.984	0.9919	0.9880	124	0.9602	0.9698	0.965	0.9915
0.0204	37.0	3552	0.0382	0.9333	0.9655	0.9492	116	0.98	0.9304	0.9545	158	0.9762	0.9919	0.9840	124	0.9646	0.9598	0.9622	0.9904
0.0193	38.0	3648	0.0404	0.9237	0.9397	0.9316	116	0.9608	0.9304	0.9453	158	0.9762	0.9919	0.9840	124	0.9547	0.9523	0.9535	0.9896
0.0193	39.0	3744	0.0359	0.9487	0.9569	0.9528	116	0.9675	0.9430	0.9551	158	0.984	0.9919	0.9880	124	0.9672	0.9623	0.9647	0.9923
0.0191	40.0	3840	0.0344	0.9391	0.9310	0.9351	116	0.9551	0.9430	0.9490	158	0.9762	0.9919	0.9840	124	0.9572	0.9548	0.9560	0.9920
0.0183	41.0	3936	0.0376	0.9008	0.9397	0.9198	116	0.9419	0.9241	0.9329	158	0.9762	0.9919	0.9840	124	0.9403	0.9497	0.9450	0.9901
0.0181	42.0	4032	0.0334	0.925	0.9569	0.9407	116	0.9434	0.9494	0.9464	158	0.9762	0.9919	0.9840	124	0.9481	0.9648	0.9564	0.9923
0.016	43.0	4128	0.0330	0.9478	0.9397	0.9437	116	0.9430	0.9430	0.9430	158	0.9762	0.9919	0.9840	124	0.9549	0.9573	0.9561	0.9918
0.0173	44.0	4224	0.0468	0.9316	0.9397	0.9356	116	0.9733	0.9241	0.9481	158	0.9685	0.9919	0.9801	124	0.9594	0.9497	0.9545	0.9879
0.0154	45.0	4320	0.0409	0.9322	0.9483	0.9402	116	0.9539	0.9177	0.9355	158	0.9762	0.9919	0.9840	124	0.9545	0.9497	0.9521	0.9893
0.0155	46.0	4416	0.0379	0.9487	0.9569	0.9528	116	0.9542	0.9241	0.9389	158	0.9762	0.9919	0.9840	124	0.9596	0.9548	0.9572	0.9904
0.0145	47.0	4512	0.0426	0.9328	0.9569	0.9447	116	0.9542	0.9241	0.9389	158	0.9762	0.9919	0.9840	124	0.9548	0.9548	0.9548	0.9904
0.0154	48.0	4608	0.0398	0.9322	0.9483	0.9402	116	0.9477	0.9177	0.9325	158	0.984	0.9919	0.9880	124	0.9545	0.9497	0.9521	0.9907
0.0151	49.0	4704	0.0425	0.9322	0.9483	0.9402	116	0.9669	0.9241	0.9450	158	0.984	0.9919	0.9880	124	0.9619	0.9523	0.9571	0.9904
0.0138	50.0	4800	0.0427	0.9106	0.9655	0.9372	116	0.9474	0.9114	0.9290	158	0.9762	0.9919	0.9840	124	0.9451	0.9523	0.9487	0.9901
0.015	51.0	4896	0.0398	0.9268	0.9828	0.9540	116	0.9735	0.9304	0.9515	158	0.9762	0.9919	0.9840	124	0.96	0.9648	0.9624	0.9918
0.0146	52.0	4992	0.0378	0.9402	0.9483	0.9442	116	0.9484	0.9304	0.9393	158	0.9762	0.9919	0.9840	124	0.9548	0.9548	0.9548	0.9912
0.0121	53.0	5088	0.0450	0.9328	0.9569	0.9447	116	0.9542	0.9241	0.9389	158	0.9762	0.9919	0.9840	124	0.9548	0.9548	0.9548	0.9898
0.0136	54.0	5184	0.0422	0.9328	0.9569	0.9447	116	0.9542	0.9241	0.9389	158	0.9762	0.9919	0.9840	124	0.9548	0.9548	0.9548	0.9901
0.0135	55.0	5280	0.0438	0.9328	0.9569	0.9447	116	0.9474	0.9114	0.9290	158	0.984	0.9919	0.9880	124	0.9545	0.9497	0.9521	0.9904
0.012	56.0	5376	0.0425	0.9407	0.9569	0.9487	116	0.9481	0.9241	0.9359	158	0.9762	0.9919	0.9840	124	0.9548	0.9548	0.9548	0.9909
0.0136	57.0	5472	0.0422	0.9402	0.9483	0.9442	116	0.9474	0.9114	0.9290	158	0.9762	0.9919	0.9840	124	0.9544	0.9472	0.9508	0.9907
0.0133	58.0	5568	0.0454	0.9328	0.9569	0.9447	116	0.9539	0.9177	0.9355	158	0.9762	0.9919	0.9840	124	0.9547	0.9523	0.9535	0.9907
0.0119	59.0	5664	0.0445	0.9339	0.9741	0.9536	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9598	0.9598	0.9598	0.9915
0.0112	60.0	5760	0.0496	0.9417	0.9741	0.9576	116	0.9539	0.9177	0.9355	158	0.9762	0.9919	0.9840	124	0.9573	0.9573	0.9573	0.9898
0.0116	61.0	5856	0.0454	0.9417	0.9741	0.9576	116	0.9608	0.9304	0.9453	158	0.9762	0.9919	0.9840	124	0.9599	0.9623	0.9611	0.9907
0.0128	62.0	5952	0.0498	0.9106	0.9655	0.9372	116	0.9603	0.9177	0.9385	158	0.9762	0.9919	0.9840	124	0.95	0.9548	0.9524	0.9890
0.0103	63.0	6048	0.0450	0.9417	0.9741	0.9576	116	0.9675	0.9430	0.9551	158	0.9762	0.9919	0.9840	124	0.9625	0.9673	0.9649	0.9915
0.0121	64.0	6144	0.0455	0.9487	0.9569	0.9528	116	0.9539	0.9177	0.9355	158	0.9762	0.9919	0.9840	124	0.9595	0.9523	0.9559	0.9901
0.0122	65.0	6240	0.0478	0.9262	0.9741	0.9496	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9574	0.9598	0.9586	0.9898
0.0104	66.0	6336	0.0490	0.9412	0.9655	0.9532	116	0.9363	0.9304	0.9333	158	0.9762	0.9919	0.9840	124	0.9502	0.9598	0.9550	0.9904
0.0092	67.0	6432	0.0465	0.9496	0.9741	0.9617	116	0.9542	0.9241	0.9389	158	0.9685	0.9919	0.9801	124	0.9574	0.9598	0.9586	0.9898
0.0112	68.0	6528	0.0434	0.9492	0.9655	0.9573	116	0.9490	0.9430	0.9460	158	0.9762	0.9919	0.9840	124	0.9576	0.9648	0.9612	0.9909
0.0104	69.0	6624	0.0477	0.9402	0.9483	0.9442	116	0.9416	0.9177	0.9295	158	0.9762	0.9919	0.9840	124	0.9521	0.9497	0.9509	0.9893
0.0095	70.0	6720	0.0432	0.9417	0.9741	0.9576	116	0.98	0.9304	0.9545	158	0.9762	0.9919	0.9840	124	0.9672	0.9623	0.9647	0.9918
0.0095	71.0	6816	0.0426	0.9478	0.9397	0.9437	116	0.9545	0.9304	0.9423	158	0.9685	0.9919	0.9801	124	0.9571	0.9523	0.9547	0.9904
0.0086	72.0	6912	0.0440	0.925	0.9569	0.9407	116	0.9539	0.9177	0.9355	158	0.9762	0.9919	0.9840	124	0.9523	0.9523	0.9523	0.9904
0.0091	73.0	7008	0.0508	0.9333	0.9655	0.9492	116	0.9658	0.8924	0.9276	158	0.984	0.9919	0.9880	124	0.9616	0.9447	0.9531	0.9890
0.0088	74.0	7104	0.0479	0.9402	0.9483	0.9442	116	0.9605	0.9241	0.9419	158	0.9762	0.9919	0.9840	124	0.9595	0.9523	0.9559	0.9901
0.0082	75.0	7200	0.0475	0.9407	0.9569	0.9487	116	0.9419	0.9241	0.9329	158	0.9762	0.9919	0.9840	124	0.9524	0.9548	0.9536	0.9907
0.0085	76.0	7296	0.0492	0.9328	0.9569	0.9447	116	0.9419	0.9241	0.9329	158	0.9762	0.9919	0.9840	124	0.95	0.9548	0.9524	0.9901
0.0078	77.0	7392	0.0510	0.9407	0.9569	0.9487	116	0.9481	0.9241	0.9359	158	0.9762	0.9919	0.9840	124	0.9548	0.9548	0.9548	0.9904
0.0092	78.0	7488	0.0500	0.9322	0.9483	0.9402	116	0.9477	0.9177	0.9325	158	0.9762	0.9919	0.9840	124	0.9521	0.9497	0.9509	0.9898
0.0082	79.0	7584	0.0487	0.9397	0.9397	0.9397	116	0.9545	0.9304	0.9423	158	0.9685	0.9919	0.9801	124	0.9547	0.9523	0.9535	0.9907
0.0087	80.0	7680	0.0482	0.9402	0.9483	0.9442	116	0.9542	0.9241	0.9389	158	0.9762	0.9919	0.9840	124	0.9571	0.9523	0.9547	0.9909
0.0076	81.0	7776	0.0457	0.9402	0.9483	0.9442	116	0.9542	0.9241	0.9389	158	0.9762	0.9919	0.9840	124	0.9571	0.9523	0.9547	0.9909
0.007	82.0	7872	0.0472	0.9402	0.9483	0.9442	116	0.9605	0.9241	0.9419	158	0.9762	0.9919	0.9840	124	0.9595	0.9523	0.9559	0.9907
0.0063	83.0	7968	0.0459	0.9402	0.9483	0.9442	116	0.9671	0.9304	0.9484	158	0.9762	0.9919	0.9840	124	0.9620	0.9548	0.9584	0.9909
0.0075	84.0	8064	0.0462	0.9407	0.9569	0.9487	116	0.9542	0.9241	0.9389	158	0.9762	0.9919	0.9840	124	0.9572	0.9548	0.9560	0.9909
0.0077	85.0	8160	0.0500	0.9316	0.9397	0.9356	116	0.9605	0.9241	0.9419	158	0.9762	0.9919	0.9840	124	0.9570	0.9497	0.9533	0.9901
0.0084	86.0	8256	0.0504	0.9328	0.9569	0.9447	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9596	0.9548	0.9572	0.9904
0.0089	87.0	8352	0.0507	0.9407	0.9569	0.9487	116	0.9671	0.9304	0.9484	158	0.9762	0.9919	0.9840	124	0.9621	0.9573	0.9597	0.9901
0.007	88.0	8448	0.0485	0.9402	0.9483	0.9442	116	0.9603	0.9177	0.9385	158	0.9762	0.9919	0.9840	124	0.9594	0.9497	0.9545	0.9907
0.0075	89.0	8544	0.0471	0.9316	0.9397	0.9356	116	0.9605	0.9241	0.9419	158	0.9762	0.9919	0.9840	124	0.9570	0.9497	0.9533	0.9904
0.0074	90.0	8640	0.0485	0.9407	0.9569	0.9487	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9620	0.9548	0.9584	0.9909
0.0067	91.0	8736	0.0497	0.9322	0.9483	0.9402	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9595	0.9523	0.9559	0.9907
0.0074	92.0	8832	0.0492	0.9328	0.9569	0.9447	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9596	0.9548	0.9572	0.9912
0.0067	93.0	8928	0.0466	0.9328	0.9569	0.9447	116	0.9671	0.9304	0.9484	158	0.9762	0.9919	0.9840	124	0.9597	0.9573	0.9585	0.9912
0.0076	94.0	9024	0.0460	0.9407	0.9569	0.9487	116	0.9671	0.9304	0.9484	158	0.9762	0.9919	0.9840	124	0.9621	0.9573	0.9597	0.9918
0.0063	95.0	9120	0.0467	0.9328	0.9569	0.9447	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9596	0.9548	0.9572	0.9912
0.0064	96.0	9216	0.0467	0.9412	0.9655	0.9532	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9621	0.9573	0.9597	0.9912
0.0068	97.0	9312	0.0470	0.9412	0.9655	0.9532	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9621	0.9573	0.9597	0.9912
0.0061	98.0	9408	0.0471	0.9328	0.9569	0.9447	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9596	0.9548	0.9572	0.9912
0.0068	99.0	9504	0.0470	0.9328	0.9569	0.9447	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9596	0.9548	0.9572	0.9912
0.0068	100.0	9600	0.0469	0.9328	0.9569	0.9447	116	0.9669	0.9241	0.9450	158	0.9762	0.9919	0.9840	124	0.9596	0.9548	0.9572	0.9912

Framework versions

• Transformers 4.39.3
• Pytorch 2.3.0+cu121
• Datasets 2.19.1
• Tokenizers 0.15.2