--- license: apache-2.0 library_name: peft tags: - generated_from_trainer base_model: google/flan-t5-large model-index: - name: classification-flan-t5-large-enriched results: [] --- # classification-flan-t5-large-enriched This model is a fine-tuned version of [google/flan-t5-large](https://huggingface.co./google/flan-t5-large) on an unknown dataset. It achieves the following results on the evaluation set: - Loss: 0.3456 - Classification Report: precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11 accuracy 0.6500 100 macro avg 0.3476 0.3545 0.3244 100 weighted avg 0.6303 0.6500 0.6070 100 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0001 - train_batch_size: 7 - eval_batch_size: 7 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 20 ### Training results | Training Loss | Epoch | Step | Validation Loss | Classification Report | |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| | No log | 1.0 | 172 | 1.2904 | precision recall f1-score support ALLERGY 0.0000 0.0000 0.0000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.5000 0.1818 0.2667 22 Follow-up 0.0000 0.0000 0.0000 0 GENHX 0.1948 0.7500 0.3093 20 GYNHX 0.0000 0.0000 0.0000 1 HEALTH 0.0000 0.0000 0.0000 0 HEALTHCARE 0.0000 0.0000 0.0000 0 HISTORY 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICAL 0.0000 0.0000 0.0000 0 MEDICATIONS 0.0000 0.0000 0.0000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PAST-HELEN 0.0000 0.0000 0.0000 0 PAST-HELSOX 0.0000 0.0000 0.0000 0 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.0000 0.0000 0.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 accuracy 0.1900 100 macro avg 0.0257 0.0345 0.0213 100 weighted avg 0.1490 0.1900 0.1205 100 | | No log | 2.0 | 344 | 0.8167 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.7143 0.4545 0.5556 22 Follow-UP 0.0000 0.0000 0.0000 0 GENHX 0.2586 0.7500 0.3846 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICAL 0.0000 0.0000 0.0000 0 MEDICALHX 0.0000 0.0000 0.0000 0 MEDICATION 0.0000 0.0000 0.0000 0 MEDICATIONS 0.5000 0.4286 0.4615 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.5000 0.1250 0.2000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SSRI 0.0000 0.0000 0.0000 0 SURGICAL 0.0000 0.0000 0.0000 0 accuracy 0.3000 100 macro avg 0.1143 0.0772 0.0770 100 weighted avg 0.3239 0.3000 0.2635 100 | | 1.7766 | 3.0 | 516 | 0.6617 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8235 0.6364 0.7179 22 GENHX 0.3455 0.9500 0.5067 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICALHX 0.0000 0.0000 0.0000 0 MEDICATIONS 0.4545 0.7143 0.5556 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.0000 0.0000 0.0000 4 PASTSURGICAL 0.5000 0.2500 0.3333 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SSRI 0.0000 0.0000 0.0000 0 SURGICAL 0.0000 0.0000 0.0000 0 accuracy 0.4100 100 macro avg 0.1358 0.1218 0.1093 100 weighted avg 0.3621 0.4100 0.3408 100 | | 1.7766 | 4.0 | 688 | 0.5475 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8235 0.6364 0.7179 22 GENHX 0.3600 0.9000 0.5143 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5455 0.8571 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.1250 0.2500 0.1667 4 PASTSURGICAL 0.5714 0.5000 0.5333 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 SURGICAL 0.0000 0.0000 0.0000 0 accuracy 0.4400 100 macro avg 0.1631 0.1616 0.1428 100 weighted avg 0.3821 0.4400 0.3728 100 | | 1.7766 | 5.0 | 860 | 0.4635 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9000 0.8182 0.8571 22 GENHX 0.4186 0.9000 0.5714 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8571 0.7500 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3000 0.7500 0.4286 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 accuracy 0.5500 100 macro avg 0.2352 0.2231 0.2022 100 weighted avg 0.4815 0.5500 0.4788 100 | | 0.3502 | 6.0 | 1032 | 0.4271 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 1.0000 0.9091 0.9524 22 GENHX 0.5000 0.8500 0.6296 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5000 1.0000 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.0909 0.1667 11 accuracy 0.5900 100 macro avg 0.2818 0.2470 0.2171 100 weighted avg 0.6150 0.5900 0.5254 100 | | 0.3502 | 7.0 | 1204 | 0.4207 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 1.0000 0.8182 0.9000 22 GENHX 0.5517 0.8000 0.6531 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5385 1.0000 0.7000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.1818 1.0000 0.3077 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 1.0000 0.3333 0.5000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11 accuracy 0.5800 100 macro avg 0.3255 0.2902 0.2595 100 weighted avg 0.6364 0.5800 0.5401 100 | | 0.3502 | 8.0 | 1376 | 0.4131 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.4857 0.8500 0.6182 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5385 1.0000 0.7000 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6100 100 macro avg 0.3020 0.2966 0.2728 100 weighted avg 0.5827 0.6100 0.5534 100 | | 0.2592 | 9.0 | 1548 | 0.3828 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.2500 0.2222 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5152 0.8500 0.6415 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5833 1.0000 0.7368 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6200 100 macro avg 0.3069 0.3079 0.2806 100 weighted avg 0.5886 0.6200 0.5628 100 | | 0.2592 | 10.0 | 1720 | 0.3815 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.1667 0.2500 0.2000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5312 0.8500 0.6538 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.5000 0.3333 0.4000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6200 100 macro avg 0.3085 0.3079 0.2820 100 weighted avg 0.5942 0.6200 0.5672 100 | | 0.2592 | 11.0 | 1892 | 0.3728 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6300 100 macro avg 0.3204 0.3322 0.2996 100 weighted avg 0.6095 0.6300 0.5821 100 | | 0.2124 | 12.0 | 2064 | 0.3739 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6300 100 macro avg 0.3388 0.3480 0.3146 100 weighted avg 0.6166 0.6300 0.5850 100 | | 0.2124 | 13.0 | 2236 | 0.3561 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5714 0.8000 0.6667 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6364 1.0000 0.7778 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6300 100 macro avg 0.3204 0.3322 0.2996 100 weighted avg 0.6095 0.6300 0.5821 100 | | 0.2124 | 14.0 | 2408 | 0.3784 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.5862 0.8500 0.6939 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6400 100 macro avg 0.3295 0.3344 0.3049 100 weighted avg 0.6285 0.6400 0.5964 100 | | 0.1926 | 15.0 | 2580 | 0.3545 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9545 0.9545 0.9545 22 GENHX 0.5862 0.8500 0.6939 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7000 1.0000 0.8235 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 accuracy 0.6500 100 macro avg 0.3266 0.3365 0.3064 100 weighted avg 0.6196 0.6500 0.5981 100 | | 0.1926 | 16.0 | 2752 | 0.3393 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.1818 0.5000 0.2667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATION 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9524 0.9091 0.9302 22 GENHX 0.6250 0.7500 0.6818 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3333 1.0000 0.5000 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11 accuracy 0.6300 100 macro avg 0.3262 0.3340 0.3028 100 weighted avg 0.6332 0.6300 0.5982 100 | | 0.1926 | 17.0 | 2924 | 0.3464 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2222 0.5000 0.3077 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9545 0.9545 0.9545 22 GENHX 0.5769 0.7500 0.6522 20 GYNHX 0.0000 0.0000 0.0000 1 HOME 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.3636 0.5000 11 accuracy 0.6500 100 macro avg 0.3312 0.3402 0.3122 100 weighted avg 0.6338 0.6500 0.6131 100 | | 0.1771 | 18.0 | 3096 | 0.3489 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11 accuracy 0.6500 100 macro avg 0.3476 0.3545 0.3244 100 weighted avg 0.6303 0.6500 0.6070 100 | | 0.1771 | 19.0 | 3268 | 0.3489 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11 accuracy 0.6500 100 macro avg 0.3476 0.3545 0.3244 100 weighted avg 0.6303 0.6500 0.6070 100 | | 0.1771 | 20.0 | 3440 | 0.3456 | precision recall f1-score support ALLERGY 1.0000 0.2500 0.4000 4 ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2000 0.5000 0.2857 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EVALUATIONS 0.0000 0.0000 0.0000 0 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.9130 0.9545 0.9333 22 GENHX 0.5926 0.8000 0.6809 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 1.0000 1.0000 1.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7778 1.0000 0.8750 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.6667 0.6667 0.6667 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.2727 0.4000 11 accuracy 0.6500 100 macro avg 0.3476 0.3545 0.3244 100 weighted avg 0.6303 0.6500 0.6070 100 | ### Framework versions - PEFT 0.8.2 - Transformers 4.37.2 - Pytorch 2.1.0+cu121 - Datasets 2.17.1 - Tokenizers 0.15.2