Hugging Face's logo

sarahahtee
/
classification-flan-t5-large-enriched

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
classification-flan-t5-large-enriched / README.md
Sarah Tariq
End of training
9fcd74e verified
preview code
|
raw
history blame contribute delete
41.4 kB
---
license: apache-2.0
library_name: peft
tags:
- generated_from_trainer
base_model: google/flan-t5-large
model-index:
- name: classification-flan-t5-large-enriched
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# classification-flan-t5-large-enriched
This model is a fine-tuned version of [google/flan-t5-large](https://huggingface.co./google/flan-t5-large) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.3456
- Classification Report: precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2000 0.5000 0.2857 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATIONS 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9130 0.9545 0.9333 22
GENHX 0.5926 0.8000 0.6809 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7778 1.0000 0.8750 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.7500 0.2727 0.4000 11
accuracy 0.6500 100
macro avg 0.3476 0.3545 0.3244 100
weighted avg 0.6303 0.6500 0.6070 100
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 7
- eval_batch_size: 7
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 20
### Training results
| Training Loss | Epoch | Step | Validation Loss | Classification Report |
|:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
| No log | 1.0 | 172 | 1.2904 | precision recall f1-score support
ALLERGY 0.0000 0.0000 0.0000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.0000 0.0000 0.0000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.5000 0.1818 0.2667 22
Follow-up 0.0000 0.0000 0.0000 0
GENHX 0.1948 0.7500 0.3093 20
GYNHX 0.0000 0.0000 0.0000 1
HEALTH 0.0000 0.0000 0.0000 0
HEALTHCARE 0.0000 0.0000 0.0000 0
HISTORY 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.0000 0.0000 0.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICAL 0.0000 0.0000 0.0000 0
MEDICATIONS 0.0000 0.0000 0.0000 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PAST-HELEN 0.0000 0.0000 0.0000 0
PAST-HELSOX 0.0000 0.0000 0.0000 0
PASTMEDICALHX 0.0000 0.0000 0.0000 4
PASTSURGICAL 0.0000 0.0000 0.0000 8
PLAN 0.0000 0.0000 0.0000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.0000 0.0000 0.0000 11
accuracy 0.1900 100
macro avg 0.0257 0.0345 0.0213 100
weighted avg 0.1490 0.1900 0.1205 100
|
| No log | 2.0 | 344 | 0.8167 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.0000 0.0000 0.0000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.7143 0.4545 0.5556 22
Follow-UP 0.0000 0.0000 0.0000 0
GENHX 0.2586 0.7500 0.3846 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.0000 0.0000 0.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICAL 0.0000 0.0000 0.0000 0
MEDICALHX 0.0000 0.0000 0.0000 0
MEDICATION 0.0000 0.0000 0.0000 0
MEDICATIONS 0.5000 0.4286 0.4615 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.0000 0.0000 0.0000 4
PASTSURGICAL 0.5000 0.1250 0.2000 8
PLAN 0.0000 0.0000 0.0000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.0000 0.0000 0.0000 11
SSRI 0.0000 0.0000 0.0000 0
SURGICAL 0.0000 0.0000 0.0000 0
accuracy 0.3000 100
macro avg 0.1143 0.0772 0.0770 100
weighted avg 0.3239 0.3000 0.2635 100
|
| 1.7766 | 3.0 | 516 | 0.6617 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.0000 0.0000 0.0000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.8235 0.6364 0.7179 22
GENHX 0.3455 0.9500 0.5067 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.0000 0.0000 0.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICALHX 0.0000 0.0000 0.0000 0
MEDICATIONS 0.4545 0.7143 0.5556 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.0000 0.0000 0.0000 4
PASTSURGICAL 0.5000 0.2500 0.3333 8
PLAN 0.0000 0.0000 0.0000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.0000 0.0000 0.0000 11
SSRI 0.0000 0.0000 0.0000 0
SURGICAL 0.0000 0.0000 0.0000 0
accuracy 0.4100 100
macro avg 0.1358 0.1218 0.1093 100
weighted avg 0.3621 0.4100 0.3408 100
|
| 1.7766 | 4.0 | 688 | 0.5475 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.0000 0.0000 0.0000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.8235 0.6364 0.7179 22
GENHX 0.3600 0.9000 0.5143 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.0000 0.0000 0.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.5455 0.8571 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.1250 0.2500 0.1667 4
PASTSURGICAL 0.5714 0.5000 0.5333 8
PLAN 0.0000 0.0000 0.0000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.0000 0.0000 0.0000 11
SURGICAL 0.0000 0.0000 0.0000 0
accuracy 0.4400 100
macro avg 0.1631 0.1616 0.1428 100
weighted avg 0.3821 0.4400 0.3728 100
|
| 1.7766 | 5.0 | 860 | 0.4635 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.0000 0.0000 0.0000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9000 0.8182 0.8571 22
GENHX 0.4186 0.9000 0.5714 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.0000 0.0000 0.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6667 0.8571 0.7500 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.3000 0.7500 0.4286 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 1.0000 0.3333 0.5000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.0000 0.0000 0.0000 11
accuracy 0.5500 100
macro avg 0.2352 0.2231 0.2022 100
weighted avg 0.4815 0.5500 0.4788 100
|
| 0.3502 | 6.0 | 1032 | 0.4271 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.0000 0.0000 0.0000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 1.0000 0.9091 0.9524 22
GENHX 0.5000 0.8500 0.6296 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 0.0000 0.0000 0.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.5000 1.0000 0.6667 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8000 1.0000 0.8889 8
PLAN 1.0000 0.3333 0.5000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 1.0000 0.0909 0.1667 11
accuracy 0.5900 100
macro avg 0.2818 0.2470 0.2171 100
weighted avg 0.6150 0.5900 0.5254 100
|
| 0.3502 | 7.0 | 1204 | 0.4207 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.0000 0.0000 0.0000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 1.0000 0.8182 0.9000 22
GENHX 0.5517 0.8000 0.6531 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.5385 1.0000 0.7000 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.1818 1.0000 0.3077 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 1.0000 0.3333 0.5000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 1.0000 0.1818 0.3077 11
accuracy 0.5800 100
macro avg 0.3255 0.2902 0.2595 100
weighted avg 0.6364 0.5800 0.5401 100
|
| 0.3502 | 8.0 | 1376 | 0.4131 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.0000 0.0000 0.0000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9524 0.9091 0.9302 22
GENHX 0.4857 0.8500 0.6182 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.5385 1.0000 0.7000 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.5000 1.0000 0.6667 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.6667 0.1818 0.2857 11
accuracy 0.6100 100
macro avg 0.3020 0.2966 0.2728 100
weighted avg 0.5827 0.6100 0.5534 100
|
| 0.2592 | 9.0 | 1548 | 0.3828 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2000 0.2500 0.2222 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9524 0.9091 0.9302 22
GENHX 0.5152 0.8500 0.6415 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.5833 1.0000 0.7368 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4444 1.0000 0.6154 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.6667 0.1818 0.2857 11
accuracy 0.6200 100
macro avg 0.3069 0.3079 0.2806 100
weighted avg 0.5886 0.6200 0.5628 100
|
| 0.2592 | 10.0 | 1720 | 0.3815 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.1667 0.2500 0.2000 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9524 0.9091 0.9302 22
GENHX 0.5312 0.8500 0.6538 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6364 1.0000 0.7778 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4444 1.0000 0.6154 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.5000 0.3333 0.4000 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.6667 0.1818 0.2857 11
accuracy 0.6200 100
macro avg 0.3085 0.3079 0.2820 100
weighted avg 0.5942 0.6200 0.5672 100
|
| 0.2592 | 11.0 | 1892 | 0.3728 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2222 0.5000 0.3077 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9524 0.9091 0.9302 22
GENHX 0.5714 0.8000 0.6667 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6364 1.0000 0.7778 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4444 1.0000 0.6154 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.6667 0.1818 0.2857 11
accuracy 0.6300 100
macro avg 0.3204 0.3322 0.2996 100
weighted avg 0.6095 0.6300 0.5821 100
|
| 0.2124 | 12.0 | 2064 | 0.3739 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2222 0.5000 0.3077 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9524 0.9091 0.9302 22
GENHX 0.5714 0.8000 0.6667 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6364 1.0000 0.7778 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.6667 0.1818 0.2857 11
accuracy 0.6300 100
macro avg 0.3388 0.3480 0.3146 100
weighted avg 0.6166 0.6300 0.5850 100
|
| 0.2124 | 13.0 | 2236 | 0.3561 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2222 0.5000 0.3077 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9524 0.9091 0.9302 22
GENHX 0.5714 0.8000 0.6667 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.6364 1.0000 0.7778 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4444 1.0000 0.6154 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.6667 0.1818 0.2857 11
accuracy 0.6300 100
macro avg 0.3204 0.3322 0.2996 100
weighted avg 0.6095 0.6300 0.5821 100
|
| 0.2124 | 14.0 | 2408 | 0.3784 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2000 0.5000 0.2857 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9524 0.9091 0.9302 22
GENHX 0.5862 0.8500 0.6939 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7778 1.0000 0.8750 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.6667 0.1818 0.2857 11
accuracy 0.6400 100
macro avg 0.3295 0.3344 0.3049 100
weighted avg 0.6285 0.6400 0.5964 100
|
| 0.1926 | 15.0 | 2580 | 0.3545 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2222 0.5000 0.3077 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9545 0.9545 0.9545 22
GENHX 0.5862 0.8500 0.6939 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7000 1.0000 0.8235 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.5000 1.0000 0.6667 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.6667 0.1818 0.2857 11
accuracy 0.6500 100
macro avg 0.3266 0.3365 0.3064 100
weighted avg 0.6196 0.6500 0.5981 100
|
| 0.1926 | 16.0 | 2752 | 0.3393 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.1818 0.5000 0.2667 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATION 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9524 0.9091 0.9302 22
GENHX 0.6250 0.7500 0.6818 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7778 1.0000 0.8750 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.3333 1.0000 0.5000 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.7500 0.2727 0.4000 11
accuracy 0.6300 100
macro avg 0.3262 0.3340 0.3028 100
weighted avg 0.6332 0.6300 0.5982 100
|
| 0.1926 | 17.0 | 2924 | 0.3464 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2222 0.5000 0.3077 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATIONS 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9545 0.9545 0.9545 22
GENHX 0.5769 0.7500 0.6522 20
GYNHX 0.0000 0.0000 0.0000 1
HOME 0.0000 0.0000 0.0000 0
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7778 1.0000 0.8750 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 0.8889 1.0000 0.9412 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.8000 0.3636 0.5000 11
accuracy 0.6500 100
macro avg 0.3312 0.3402 0.3122 100
weighted avg 0.6338 0.6500 0.6131 100
|
| 0.1771 | 18.0 | 3096 | 0.3489 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2000 0.5000 0.2857 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATIONS 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9130 0.9545 0.9333 22
GENHX 0.5926 0.8000 0.6809 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7778 1.0000 0.8750 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.7500 0.2727 0.4000 11
accuracy 0.6500 100
macro avg 0.3476 0.3545 0.3244 100
weighted avg 0.6303 0.6500 0.6070 100
|
| 0.1771 | 19.0 | 3268 | 0.3489 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2000 0.5000 0.2857 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATIONS 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9130 0.9545 0.9333 22
GENHX 0.5926 0.8000 0.6809 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7778 1.0000 0.8750 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.7500 0.2727 0.4000 11
accuracy 0.6500 100
macro avg 0.3476 0.3545 0.3244 100
weighted avg 0.6303 0.6500 0.6070 100
|
| 0.1771 | 20.0 | 3440 | 0.3456 | precision recall f1-score support
ALLERGY 1.0000 0.2500 0.4000 4
ASSESSMENT 0.0000 0.0000 0.0000 4
CC 0.2000 0.5000 0.2857 4
DIAGNOSIS 0.0000 0.0000 0.0000 1
DISPOSITION 0.0000 0.0000 0.0000 2
EDCOURSE 0.0000 0.0000 0.0000 3
EVALUATIONS 0.0000 0.0000 0.0000 0
EXAM 0.0000 0.0000 0.0000 1
FAM/SOCHX 0.9130 0.9545 0.9333 22
GENHX 0.5926 0.8000 0.6809 20
GYNHX 0.0000 0.0000 0.0000 1
IMAGING 0.0000 0.0000 0.0000 1
IMMUNIZATIONS 1.0000 1.0000 1.0000 1
LABS 0.0000 0.0000 0.0000 1
MEDICATIONS 0.7778 1.0000 0.8750 7
OTHER_HISTORY 0.0000 0.0000 0.0000 1
PASTMEDICALHX 0.4000 1.0000 0.5714 4
PASTSURGICAL 1.0000 1.0000 1.0000 8
PLAN 0.6667 0.6667 0.6667 3
PROCEDURES 0.0000 0.0000 0.0000 1
ROS 0.7500 0.2727 0.4000 11
accuracy 0.6500 100
macro avg 0.3476 0.3545 0.3244 100
weighted avg 0.6303 0.6500 0.6070 100
|
### Framework versions
- PEFT 0.8.2
- Transformers 4.37.2
- Pytorch 2.1.0+cu121
- Datasets 2.17.1
- Tokenizers 0.15.2