v5_llama_lora

This model is a fine-tuned version of Daewon0808/prm800k_llama_fulltune on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.1427
• Prm accuracy: 0.9412
• Prm precision: 0.9589
• Prm recall: 0.9589
• Prm specificty: 0.8966
• Prm npv: 0.8966
• Prm f1: 0.9589
• Prm f1 neg: 0.8966
• Prm f1 auc: 0.9277
• Prm f1 auc (fixed): 0.9773

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 2
• eval_batch_size: 4
• seed: 908932403
• distributed_type: multi-GPU
• num_devices: 8
• gradient_accumulation_steps: 2
• total_train_batch_size: 32
• total_eval_batch_size: 32
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: cosine
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	Prm accuracy	Prm precision	Prm recall	Prm specificty	Prm npv	Prm f1	Prm f1 neg	Prm f1 auc	Prm f1 auc (fixed)
No log	0	0	0.2324	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9752
0.3412	0.0024	5	0.2326	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9750
0.3274	0.0048	10	0.2306	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9750
0.3267	0.0071	15	0.2270	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9759
0.3831	0.0095	20	0.2192	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9769
0.4057	0.0119	25	0.2108	0.9216	0.9333	0.9589	0.8276	0.8889	0.9459	0.8571	0.8932	0.9806
0.3588	0.0143	30	0.2038	0.9216	0.9333	0.9589	0.8276	0.8889	0.9459	0.8571	0.8932	0.9858
0.2883	0.0167	35	0.1976	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9872
0.3183	0.0190	40	0.1947	0.9216	0.9452	0.9452	0.8621	0.8621	0.9452	0.8621	0.9036	0.9887
0.4676	0.0214	45	0.1976	0.9216	0.9452	0.9452	0.8621	0.8621	0.9452	0.8621	0.9036	0.9891
0.237	0.0238	50	0.2050	0.9020	0.9437	0.9178	0.8621	0.8065	0.9306	0.8333	0.8899	0.9868
0.3717	0.0262	55	0.1960	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9877
0.2588	0.0286	60	0.1956	0.9216	0.9452	0.9452	0.8621	0.8621	0.9452	0.8621	0.9036	0.9858
0.2656	0.0309	65	0.2088	0.9118	0.9444	0.9315	0.8621	0.8333	0.9379	0.8475	0.8968	0.9830
0.2475	0.0333	70	0.2106	0.9118	0.9444	0.9315	0.8621	0.8333	0.9379	0.8475	0.8968	0.9830
0.2811	0.0357	75	0.2002	0.9118	0.9444	0.9315	0.8621	0.8333	0.9379	0.8475	0.8968	0.9830
0.3639	0.0381	80	0.2020	0.9020	0.9437	0.9178	0.8621	0.8065	0.9306	0.8333	0.8899	0.9816
0.2557	0.0405	85	0.2187	0.8922	0.9429	0.9041	0.8621	0.7812	0.9231	0.8197	0.8831	0.9761
0.3097	0.0428	90	0.1803	0.9118	0.9324	0.9452	0.8276	0.8571	0.9388	0.8421	0.8864	0.9802
0.1938	0.0452	95	0.1845	0.9118	0.9444	0.9315	0.8621	0.8333	0.9379	0.8475	0.8968	0.9797
0.248	0.0476	100	0.1910	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9828
0.3104	0.0500	105	0.2060	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9802
0.2862	0.0524	110	0.2220	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9787
0.2756	0.0547	115	0.1929	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9839
0.3027	0.0571	120	0.1736	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9854
0.2188	0.0595	125	0.1572	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9844
0.326	0.0619	130	0.1676	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9821
0.2641	0.0643	135	0.1933	0.9216	0.9851	0.9041	0.9655	0.8	0.9429	0.875	0.9348	0.9769
0.2567	0.0667	140	0.1768	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9761
0.2604	0.0690	145	0.1837	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9764
0.2425	0.0714	150	0.1962	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9731
0.1888	0.0738	155	0.1834	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9766
0.2772	0.0762	160	0.1711	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9804
0.2214	0.0786	165	0.1520	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9839
0.2852	0.0809	170	0.1535	0.9314	0.9853	0.9178	0.9655	0.8235	0.9504	0.8889	0.9417	0.9872
0.274	0.0833	175	0.1535	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9863
0.2467	0.0857	180	0.1838	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9821
0.1723	0.0881	185	0.1795	0.9118	0.9444	0.9315	0.8621	0.8333	0.9379	0.8475	0.8968	0.9783
0.2	0.0905	190	0.1877	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9799
0.2006	0.0928	195	0.1658	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9854
0.2318	0.0952	200	0.1711	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9835
0.1513	0.0976	205	0.1798	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9816
0.2376	0.1000	210	0.1747	0.9216	0.9452	0.9452	0.8621	0.8621	0.9452	0.8621	0.9036	0.9799
0.3682	0.1024	215	0.1629	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9804
0.1909	0.1047	220	0.1809	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9766
0.1854	0.1071	225	0.1953	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9733
0.2458	0.1095	230	0.2155	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9688
0.2604	0.1119	235	0.2225	0.9020	0.92	0.9452	0.7931	0.8519	0.9324	0.8214	0.8692	0.9662
0.2207	0.1143	240	0.1918	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9731
0.216	0.1166	245	0.1603	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9825
0.2908	0.1190	250	0.1521	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9825
0.2616	0.1214	255	0.1807	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9731
0.2395	0.1238	260	0.1645	0.9216	0.9333	0.9589	0.8276	0.8889	0.9459	0.8571	0.8932	0.9740
0.2251	0.1262	265	0.1947	0.9118	0.9444	0.9315	0.8621	0.8333	0.9379	0.8475	0.8968	0.9624
0.213	0.1285	270	0.1747	0.9020	0.9437	0.9178	0.8621	0.8065	0.9306	0.8333	0.8899	0.9676
0.32	0.1309	275	0.1531	0.9314	0.9853	0.9178	0.9655	0.8235	0.9504	0.8889	0.9417	0.9780
0.1751	0.1333	280	0.1533	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9804
0.2379	0.1357	285	0.1728	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9813
0.2046	0.1381	290	0.1737	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9818
0.2154	0.1404	295	0.1434	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9856
0.1992	0.1428	300	0.1610	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9825
0.2481	0.1452	305	0.1646	0.9020	0.9565	0.9041	0.8966	0.7879	0.9296	0.8387	0.9003	0.9839
0.2831	0.1476	310	0.1690	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9830
0.2078	0.1500	315	0.1797	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9837
0.1987	0.1523	320	0.1525	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9863
0.2441	0.1547	325	0.1558	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9830
0.1866	0.1571	330	0.1887	0.9020	0.9701	0.8904	0.9310	0.7714	0.9286	0.8438	0.9107	0.9750
0.2417	0.1595	335	0.1801	0.9020	0.9437	0.9178	0.8621	0.8065	0.9306	0.8333	0.8899	0.9724
0.2755	0.1619	340	0.1806	0.9020	0.9437	0.9178	0.8621	0.8065	0.9306	0.8333	0.8899	0.9752
0.1561	0.1642	345	0.1867	0.9020	0.9701	0.8904	0.9310	0.7714	0.9286	0.8438	0.9107	0.9750
0.1601	0.1666	350	0.1957	0.9020	0.9701	0.8904	0.9310	0.7714	0.9286	0.8438	0.9107	0.9721
0.1707	0.1690	355	0.1836	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9709
0.3043	0.1714	360	0.1837	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9700
0.2048	0.1738	365	0.1811	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9811
0.2686	0.1761	370	0.1712	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9835
0.1319	0.1785	375	0.1463	0.9314	0.9342	0.9726	0.8276	0.9231	0.9530	0.8727	0.9001	0.9851
0.2472	0.1809	380	0.1570	0.9412	0.9855	0.9315	0.9655	0.8485	0.9577	0.9032	0.9485	0.9790
0.1624	0.1833	385	0.1572	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9830
0.181	0.1857	390	0.1714	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9816
0.2199	0.1881	395	0.1644	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9821
0.2665	0.1904	400	0.1628	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9783
0.251	0.1928	405	0.1504	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9747
0.272	0.1952	410	0.1715	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9662
0.2569	0.1976	415	0.1809	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9735
0.2587	0.2000	420	0.1705	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9785
0.2477	0.2023	425	0.1794	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9740
0.2026	0.2047	430	0.1720	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9719
0.1589	0.2071	435	0.1645	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9743
0.2425	0.2095	440	0.1986	0.8922	0.9697	0.8767	0.9310	0.75	0.9209	0.8308	0.9039	0.9721
0.1838	0.2119	445	0.1722	0.8922	0.9559	0.8904	0.8966	0.7647	0.9220	0.8254	0.8935	0.9754
0.1662	0.2142	450	0.1735	0.9118	0.9444	0.9315	0.8621	0.8333	0.9379	0.8475	0.8968	0.9759
0.1518	0.2166	455	0.1899	0.9020	0.9565	0.9041	0.8966	0.7879	0.9296	0.8387	0.9003	0.9738
0.1336	0.2190	460	0.1658	0.9118	0.9444	0.9315	0.8621	0.8333	0.9379	0.8475	0.8968	0.9773
0.1789	0.2214	465	0.1611	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9776
0.2392	0.2238	470	0.1740	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9750
0.2177	0.2261	475	0.1635	0.9020	0.9437	0.9178	0.8621	0.8065	0.9306	0.8333	0.8899	0.9721
0.1375	0.2285	480	0.1605	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9698
0.1644	0.2309	485	0.1678	0.9020	0.9565	0.9041	0.8966	0.7879	0.9296	0.8387	0.9003	0.9646
0.2586	0.2333	490	0.1520	0.9020	0.9565	0.9041	0.8966	0.7879	0.9296	0.8387	0.9003	0.9740
0.293	0.2357	495	0.1347	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9851
0.2431	0.2380	500	0.1380	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9851
0.2246	0.2404	505	0.1449	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9837
0.2114	0.2428	510	0.1594	0.9314	0.9231	0.9863	0.7931	0.9583	0.9536	0.8679	0.8897	0.9828
0.2587	0.2452	515	0.1535	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9821
0.1454	0.2476	520	0.1410	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9849
0.2098	0.2499	525	0.1356	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9846
0.1874	0.2523	530	0.1393	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9858
0.3493	0.2547	535	0.1509	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9825
0.1816	0.2571	540	0.1559	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9821
0.145	0.2595	545	0.1491	0.9510	0.9474	0.9863	0.8621	0.9615	0.9664	0.9091	0.9242	0.9832
0.1753	0.2618	550	0.1377	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9858
0.1902	0.2642	555	0.1537	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9806
0.1587	0.2666	560	0.2026	0.9314	0.9125	1.0	0.7586	1.0	0.9542	0.8627	0.8793	0.9802
0.1981	0.2690	565	0.1806	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9795
0.1888	0.2714	570	0.1720	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9809
0.1374	0.2737	575	0.1489	0.9314	0.9342	0.9726	0.8276	0.9231	0.9530	0.8727	0.9001	0.9830
0.2847	0.2761	580	0.1581	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9830
0.183	0.2785	585	0.1673	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9809
0.2612	0.2809	590	0.1595	0.9216	0.9333	0.9589	0.8276	0.8889	0.9459	0.8571	0.8932	0.9811
0.1522	0.2833	595	0.1988	0.8922	0.9429	0.9041	0.8621	0.7812	0.9231	0.8197	0.8831	0.9603
0.2189	0.2856	600	0.1995	0.8922	0.9429	0.9041	0.8621	0.7812	0.9231	0.8197	0.8831	0.9558
0.1599	0.2880	605	0.1788	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9684
0.2197	0.2904	610	0.1733	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9707
0.2997	0.2928	615	0.1434	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9804
0.2346	0.2952	620	0.1328	0.9314	0.9342	0.9726	0.8276	0.9231	0.9530	0.8727	0.9001	0.9851
0.2068	0.2975	625	0.1284	0.9216	0.9452	0.9452	0.8621	0.8621	0.9452	0.8621	0.9036	0.9849
0.1953	0.2999	630	0.1406	0.9412	0.9855	0.9315	0.9655	0.8485	0.9577	0.9032	0.9485	0.9799
0.1934	0.3023	635	0.1690	0.9314	0.9853	0.9178	0.9655	0.8235	0.9504	0.8889	0.9417	0.9757
0.1215	0.3047	640	0.1598	0.9608	0.9726	0.9726	0.9310	0.9310	0.9726	0.9310	0.9518	0.9799
0.1678	0.3071	645	0.1453	0.9608	0.9726	0.9726	0.9310	0.9310	0.9726	0.9310	0.9518	0.9818
0.2591	0.3095	650	0.1618	0.9020	0.9846	0.8767	0.9655	0.7568	0.9275	0.8485	0.9211	0.9783
0.2293	0.3118	655	0.1454	0.9608	0.9726	0.9726	0.9310	0.9310	0.9726	0.9310	0.9518	0.9806
0.1362	0.3142	660	0.1534	0.9608	0.9726	0.9726	0.9310	0.9310	0.9726	0.9310	0.9518	0.9785
0.2474	0.3166	665	0.1669	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9735
0.1957	0.3190	670	0.1820	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9684
0.1768	0.3214	675	0.2025	0.9020	0.9701	0.8904	0.9310	0.7714	0.9286	0.8438	0.9107	0.9653
0.2122	0.3237	680	0.1633	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9766
0.189	0.3261	685	0.1615	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9792
0.165	0.3285	690	0.1678	0.9314	0.9853	0.9178	0.9655	0.8235	0.9504	0.8889	0.9417	0.9792
0.2268	0.3309	695	0.1481	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9799
0.2107	0.3333	700	0.1490	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9787
0.2123	0.3356	705	0.1543	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9771
0.1752	0.3380	710	0.1604	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9771
0.2156	0.3404	715	0.1574	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9735
0.1936	0.3428	720	0.1610	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9726
0.1909	0.3452	725	0.1657	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9721
0.1682	0.3475	730	0.1679	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9728
0.3411	0.3499	735	0.1784	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9759
0.1859	0.3523	740	0.1869	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9757
0.1523	0.3547	745	0.1827	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9735
0.1565	0.3571	750	0.1571	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9747
0.1906	0.3594	755	0.1505	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9731
0.1875	0.3618	760	0.1448	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9740
0.2222	0.3642	765	0.1611	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9733
0.2101	0.3666	770	0.1770	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9721
0.249	0.3690	775	0.1825	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9726
0.1484	0.3713	780	0.1650	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9747
0.1929	0.3737	785	0.1303	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9821
0.2232	0.3761	790	0.1288	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9806
0.1933	0.3785	795	0.1404	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9806
0.3073	0.3809	800	0.1449	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9799
0.2223	0.3832	805	0.1628	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9766
0.1968	0.3856	810	0.1609	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9776
0.2124	0.3880	815	0.1502	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9728
0.1622	0.3904	820	0.1402	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9743
0.1201	0.3928	825	0.1289	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9759
0.2415	0.3951	830	0.1348	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9757
0.1904	0.3975	835	0.1512	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9752
0.1557	0.3999	840	0.1714	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9750
0.1365	0.4023	845	0.1797	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9726
0.2643	0.4047	850	0.1655	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9790
0.2311	0.4070	855	0.1690	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9728
0.2216	0.4094	860	0.1616	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9764
0.1772	0.4118	865	0.1516	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9783
0.1762	0.4142	870	0.1528	0.9510	0.9722	0.9589	0.9310	0.9	0.9655	0.9153	0.9450	0.9792
0.1448	0.4166	875	0.1548	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9783
0.2467	0.4189	880	0.1667	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9693
0.2155	0.4213	885	0.1638	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9700
0.1605	0.4237	890	0.1598	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9712
0.1778	0.4261	895	0.1635	0.9020	0.9701	0.8904	0.9310	0.7714	0.9286	0.8438	0.9107	0.9686
0.3527	0.4285	900	0.1733	0.9020	0.9701	0.8904	0.9310	0.7714	0.9286	0.8438	0.9107	0.9665
0.2309	0.4308	905	0.1690	0.9020	0.9701	0.8904	0.9310	0.7714	0.9286	0.8438	0.9107	0.9672
0.2565	0.4332	910	0.1638	0.9020	0.9701	0.8904	0.9310	0.7714	0.9286	0.8438	0.9107	0.9665
0.2284	0.4356	915	0.1540	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9688
0.1626	0.4380	920	0.1557	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9721
0.1578	0.4404	925	0.1473	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9787
0.183	0.4428	930	0.1436	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9835
0.2056	0.4451	935	0.1556	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9823
0.1834	0.4475	940	0.1641	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9792
0.1994	0.4499	945	0.1532	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9792
0.1792	0.4523	950	0.1560	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9797
0.2232	0.4547	955	0.1703	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9790
0.2112	0.4570	960	0.1776	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9757
0.1545	0.4594	965	0.1792	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9778
0.198	0.4618	970	0.1656	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9792
0.1718	0.4642	975	0.1632	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9776
0.1726	0.4666	980	0.1655	0.9020	0.9565	0.9041	0.8966	0.7879	0.9296	0.8387	0.9003	0.9750
0.1406	0.4689	985	0.1602	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9759
0.2231	0.4713	990	0.1620	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9752
0.1402	0.4737	995	0.1660	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9759
0.2259	0.4761	1000	0.1622	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9778
0.2042	0.4785	1005	0.1573	0.9216	0.9452	0.9452	0.8621	0.8621	0.9452	0.8621	0.9036	0.9797
0.1943	0.4808	1010	0.1505	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9802
0.2052	0.4832	1015	0.1377	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9830
0.3118	0.4856	1020	0.1324	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9849
0.2307	0.4880	1025	0.1397	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9858
0.1723	0.4904	1030	0.1422	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9851
0.2453	0.4927	1035	0.1431	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9825
0.1978	0.4951	1040	0.1541	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9792
0.2126	0.4975	1045	0.1528	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9813
0.1939	0.4999	1050	0.1561	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9799
0.1952	0.5023	1055	0.1592	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9792
0.3739	0.5046	1060	0.1557	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9790
0.1117	0.5070	1065	0.1519	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9804
0.1419	0.5094	1070	0.1491	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9811
0.1533	0.5118	1075	0.1535	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9813
0.1336	0.5142	1080	0.1625	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9797
0.1503	0.5165	1085	0.1681	0.9020	0.9565	0.9041	0.8966	0.7879	0.9296	0.8387	0.9003	0.9776
0.1769	0.5189	1090	0.1668	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9754
0.1784	0.5213	1095	0.1639	0.9314	0.9714	0.9315	0.9310	0.8438	0.9510	0.8852	0.9313	0.9771
0.3373	0.5237	1100	0.1580	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9790
0.1896	0.5261	1105	0.1668	0.9216	0.9452	0.9452	0.8621	0.8621	0.9452	0.8621	0.9036	0.9821
0.1829	0.5284	1110	0.1742	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9806
0.2779	0.5308	1115	0.1716	0.9314	0.9342	0.9726	0.8276	0.9231	0.9530	0.8727	0.9001	0.9797
0.1817	0.5332	1120	0.1657	0.9412	0.9467	0.9726	0.8621	0.9259	0.9595	0.8929	0.9173	0.9802
0.243	0.5356	1125	0.1700	0.9216	0.9452	0.9452	0.8621	0.8621	0.9452	0.8621	0.9036	0.9771
0.1945	0.5380	1130	0.1701	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9757
0.2049	0.5403	1135	0.1675	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9769
0.1902	0.5427	1140	0.1667	0.9314	0.9459	0.9589	0.8621	0.8929	0.9524	0.8772	0.9105	0.9764
0.2561	0.5451	1145	0.1641	0.9020	0.9437	0.9178	0.8621	0.8065	0.9306	0.8333	0.8899	0.9738
0.2043	0.5475	1150	0.1608	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9731
0.1927	0.5499	1155	0.1545	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9764
0.1925	0.5522	1160	0.1447	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9802
0.1788	0.5546	1165	0.1441	0.9314	0.9342	0.9726	0.8276	0.9231	0.9530	0.8727	0.9001	0.9811
0.2273	0.5570	1170	0.1418	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9806
0.184	0.5594	1175	0.1482	0.9216	0.9710	0.9178	0.9310	0.8182	0.9437	0.8710	0.9244	0.9771
0.2236	0.5618	1180	0.1520	0.9118	0.9706	0.9041	0.9310	0.7941	0.9362	0.8571	0.9176	0.9761
0.1493	0.5642	1185	0.1363	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9792
0.1708	0.5665	1190	0.1252	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.1162	0.5689	1195	0.1208	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.1538	0.5713	1200	0.1298	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.1961	0.5737	1205	0.1372	0.9412	0.9718	0.9452	0.9310	0.8710	0.9583	0.9	0.9381	0.9764
0.1872	0.5761	1210	0.1355	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9778
0.2066	0.5784	1215	0.1324	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9802
0.3204	0.5808	1220	0.1371	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9802
0.1734	0.5832	1225	0.1449	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9783
0.2838	0.5856	1230	0.1509	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9771
0.1977	0.5880	1235	0.1526	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9771
0.1838	0.5903	1240	0.1559	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9778
0.1269	0.5927	1245	0.1587	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9787
0.215	0.5951	1250	0.1606	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9797
0.1725	0.5975	1255	0.1602	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9802
0.168	0.5999	1260	0.1572	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9799
0.1655	0.6022	1265	0.1462	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9828
0.2104	0.6046	1270	0.1444	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9830
0.1406	0.6070	1275	0.1469	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9811
0.1477	0.6094	1280	0.1510	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9783
0.1558	0.6118	1285	0.1490	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9792
0.2126	0.6141	1290	0.1481	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9787
0.1614	0.6165	1295	0.1494	0.9608	0.96	0.9863	0.8966	0.9630	0.9730	0.9286	0.9414	0.9802
0.1092	0.6189	1300	0.1506	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1537	0.6213	1305	0.1508	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9783
0.2159	0.6237	1310	0.1495	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9790
0.2276	0.6260	1315	0.1504	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9795
0.2719	0.6284	1320	0.1525	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.2656	0.6308	1325	0.1484	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9802
0.1829	0.6332	1330	0.1462	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.1614	0.6356	1335	0.1454	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9790
0.191	0.6379	1340	0.1418	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.2046	0.6403	1345	0.1403	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9797
0.0831	0.6427	1350	0.1470	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9804
0.1295	0.6451	1355	0.1461	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9806
0.1822	0.6475	1360	0.1474	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9804
0.1732	0.6498	1365	0.1494	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9802
0.0842	0.6522	1370	0.1561	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9766
0.1401	0.6546	1375	0.1615	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9745
0.2127	0.6570	1380	0.1680	0.9020	0.9565	0.9041	0.8966	0.7879	0.9296	0.8387	0.9003	0.9733
0.255	0.6594	1385	0.1621	0.9118	0.9571	0.9178	0.8966	0.8125	0.9371	0.8525	0.9072	0.9759
0.2029	0.6617	1390	0.1573	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9773
0.0939	0.6641	1395	0.1566	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9783
0.1623	0.6665	1400	0.1553	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9764
0.1288	0.6689	1405	0.1532	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9764
0.1629	0.6713	1410	0.1554	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1754	0.6736	1415	0.1578	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9792
0.1797	0.6760	1420	0.1609	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.2662	0.6784	1425	0.1657	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.2386	0.6808	1430	0.1701	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1912	0.6832	1435	0.1726	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.173	0.6856	1440	0.1654	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9776
0.1492	0.6879	1445	0.1582	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.1237	0.6903	1450	0.1512	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.1944	0.6927	1455	0.1496	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9771
0.1704	0.6951	1460	0.1463	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.2002	0.6975	1465	0.1448	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.2655	0.6998	1470	0.1443	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1204	0.7022	1475	0.1434	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.1194	0.7046	1480	0.1426	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.2122	0.7070	1485	0.1466	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.1315	0.7094	1490	0.1506	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9769
0.0999	0.7117	1495	0.1561	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9787
0.0894	0.7141	1500	0.1603	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.2162	0.7165	1505	0.1648	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.181	0.7189	1510	0.1679	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9787
0.2623	0.7213	1515	0.1729	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9780
0.1177	0.7236	1520	0.1759	0.9510	0.9595	0.9726	0.8966	0.9286	0.9660	0.9123	0.9346	0.9778
0.1409	0.7260	1525	0.1739	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9769
0.1996	0.7284	1530	0.1694	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9745
0.2004	0.7308	1535	0.1658	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9754
0.1176	0.7332	1540	0.1622	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9759
0.2367	0.7355	1545	0.1605	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9757
0.3002	0.7379	1550	0.1577	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9754
0.1343	0.7403	1555	0.1559	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9757
0.1075	0.7427	1560	0.1545	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9761
0.1297	0.7451	1565	0.1570	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.1422	0.7474	1570	0.1596	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9769
0.1056	0.7498	1575	0.1602	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9769
0.155	0.7522	1580	0.1597	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1427	0.7546	1585	0.1595	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1929	0.7570	1590	0.1577	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.2216	0.7593	1595	0.1573	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9792
0.1749	0.7617	1600	0.1555	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.1113	0.7641	1605	0.1532	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9802
0.2123	0.7665	1610	0.1526	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9802
0.1728	0.7689	1615	0.1542	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9802
0.1226	0.7712	1620	0.1541	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9799
0.1422	0.7736	1625	0.1532	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9799
0.1726	0.7760	1630	0.1529	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.188	0.7784	1635	0.1556	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9802
0.2186	0.7808	1640	0.1574	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9802
0.1219	0.7831	1645	0.1595	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9802
0.1838	0.7855	1650	0.1598	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9776
0.2217	0.7879	1655	0.1596	0.9216	0.9577	0.9315	0.8966	0.8387	0.9444	0.8667	0.9140	0.9792
0.2035	0.7903	1660	0.1588	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9787
0.259	0.7927	1665	0.1617	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9783
0.1849	0.7950	1670	0.1610	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9783
0.1474	0.7974	1675	0.1610	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9778
0.2493	0.7998	1680	0.1578	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9780
0.1748	0.8022	1685	0.1568	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9776
0.1408	0.8046	1690	0.1568	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9778
0.1604	0.8070	1695	0.1567	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9773
0.192	0.8093	1700	0.1575	0.9314	0.9583	0.9452	0.8966	0.8667	0.9517	0.8814	0.9209	0.9773
0.2257	0.8117	1705	0.1576	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.149	0.8141	1710	0.1557	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1198	0.8165	1715	0.1544	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1801	0.8189	1720	0.1532	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9769
0.1742	0.8212	1725	0.1524	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9764
0.163	0.8236	1730	0.1519	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.2168	0.8260	1735	0.1515	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.1504	0.8284	1740	0.1514	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.2087	0.8308	1745	0.1503	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.2849	0.8331	1750	0.1505	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.2098	0.8355	1755	0.1499	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.1509	0.8379	1760	0.1517	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.0937	0.8403	1765	0.1520	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.1382	0.8427	1770	0.1523	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.2214	0.8450	1775	0.1516	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9769
0.1502	0.8474	1780	0.1508	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1982	0.8498	1785	0.1495	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9795
0.1427	0.8522	1790	0.1468	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9799
0.1448	0.8546	1795	0.1453	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9792
0.1351	0.8569	1800	0.1448	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.2132	0.8593	1805	0.1440	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1	0.8617	1810	0.1435	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.1861	0.8641	1815	0.1438	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.1795	0.8665	1820	0.1441	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9790
0.2896	0.8688	1825	0.1442	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9797
0.1282	0.8712	1830	0.1428	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9790
0.2494	0.8736	1835	0.1419	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9795
0.0913	0.8760	1840	0.1410	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1969	0.8784	1845	0.1393	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9792
0.1131	0.8807	1850	0.1407	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.1854	0.8831	1855	0.1400	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1408	0.8855	1860	0.1413	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.2496	0.8879	1865	0.1419	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.1829	0.8903	1870	0.1420	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9792
0.1736	0.8926	1875	0.1438	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1648	0.8950	1880	0.1433	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.235	0.8974	1885	0.1439	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.0922	0.8998	1890	0.1435	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.147	0.9022	1895	0.1435	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.197	0.9045	1900	0.1427	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1287	0.9069	1905	0.1418	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.157	0.9093	1910	0.1422	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1644	0.9117	1915	0.1416	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1538	0.9141	1920	0.1408	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9790
0.1701	0.9164	1925	0.1422	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1989	0.9188	1930	0.1416	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9783
0.1879	0.9212	1935	0.1418	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.0932	0.9236	1940	0.1419	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.1648	0.9260	1945	0.1417	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.2125	0.9284	1950	0.1423	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.1524	0.9307	1955	0.1421	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9771
0.1824	0.9331	1960	0.1428	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1988	0.9355	1965	0.1423	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.1318	0.9379	1970	0.1423	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1211	0.9403	1975	0.1424	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.2056	0.9426	1980	0.1429	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.2012	0.9450	1985	0.1414	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1442	0.9474	1990	0.1429	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1988	0.9498	1995	0.1419	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.155	0.9522	2000	0.1422	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9771
0.2738	0.9545	2005	0.1423	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1543	0.9569	2010	0.1421	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1172	0.9593	2015	0.1429	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9776
0.1207	0.9617	2020	0.1421	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773
0.1517	0.9641	2025	0.1421	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1789	0.9664	2030	0.1429	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9771
0.1139	0.9688	2035	0.1428	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.2244	0.9712	2040	0.1428	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.1151	0.9736	2045	0.1429	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9771
0.1176	0.9760	2050	0.1424	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.149	0.9783	2055	0.1421	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1612	0.9807	2060	0.1429	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.0997	0.9831	2065	0.1429	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9776
0.16	0.9855	2070	0.1421	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.1211	0.9879	2075	0.1418	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9787
0.1776	0.9902	2080	0.1417	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9780
0.2163	0.9926	2085	0.1431	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.1617	0.9950	2090	0.1424	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9778
0.1226	0.9974	2095	0.1422	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9785
0.2279	0.9998	2100	0.1427	0.9412	0.9589	0.9589	0.8966	0.8966	0.9589	0.8966	0.9277	0.9773

Framework versions

• PEFT 0.12.0
• Transformers 4.46.0
• Pytorch 2.4.0+cu118
• Datasets 3.0.0
• Tokenizers 0.20.1