|
--- |
|
license: apache-2.0 |
|
base_model: google/flan-t5-small |
|
tags: |
|
- generated_from_trainer |
|
model-index: |
|
- name: classification_flan_t5_enriched |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# classification_flan_t5_enriched |
|
|
|
This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co./google/flan-t5-small) on an unknown dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.5235 |
|
- Classification Report: precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.5000 0.0909 0.1538 11 |
|
CC 0.2400 0.5455 0.3333 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.2000 0.2857 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.6866 0.8679 0.7667 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.3333 1.0000 0.5000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.7692 1.0000 0.8696 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7273 0.5714 0.6400 14 |
|
PASTSURGICAL 0.7778 1.0000 0.8750 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6750 200 |
|
macro avg 0.3462 0.3640 0.3252 200 |
|
weighted avg 0.6557 0.6750 0.6372 200 |
|
|
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 0.0001 |
|
- train_batch_size: 7 |
|
- eval_batch_size: 7 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- num_epochs: 20 |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Classification Report | |
|
|:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| |
|
| No log | 1.0 | 172 | 0.5962 | precision recall f1-score support |
|
|
|
ALLERGY 0.6471 0.9167 0.7586 12 |
|
ASSESSMENT 0.1429 0.0909 0.1111 11 |
|
CC 0.0000 0.0000 0.0000 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.0000 0.0000 0.0000 5 |
|
FAM/SOCHX 0.7556 0.7556 0.7556 45 |
|
GENHX 0.5000 0.8113 0.6187 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIS 0.0000 0.0000 0.0000 0 |
|
IMMUNITIVES 0.0000 0.0000 0.0000 0 |
|
IMMUNIZATIONS 0.0000 0.0000 0.0000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.6667 0.4000 0.5000 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.2500 0.0714 0.1111 14 |
|
PASTSURGICAL 0.1739 0.5714 0.2667 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
Prevacid 0.0000 0.0000 0.0000 0 |
|
Psychiatric 0.0000 0.0000 0.0000 0 |
|
ROS 0.0000 0.0000 0.0000 17 |
|
Travel 0.0000 0.0000 0.0000 0 |
|
X 0.0000 0.0000 0.0000 0 |
|
|
|
accuracy 0.4900 200 |
|
macro avg 0.1206 0.1391 0.1201 200 |
|
weighted avg 0.4061 0.4900 0.4277 200 |
|
| |
|
| No log | 2.0 | 344 | 0.4113 | precision recall f1-score support |
|
|
|
ALLERGY 0.7857 0.9167 0.8462 12 |
|
ASSESSMENT 1.0000 0.0909 0.1667 11 |
|
CC 0.0000 0.0000 0.0000 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.0000 0.0000 0.0000 5 |
|
FAM/SOCHX 0.8444 0.8444 0.8444 45 |
|
GENHX 0.4706 0.9057 0.6194 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.0000 0.0000 0.0000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.6667 0.8000 0.7273 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.4545 0.3571 0.4000 14 |
|
PASTSURGICAL 0.6364 1.0000 0.7778 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.0000 0.0000 0.0000 17 |
|
|
|
accuracy 0.5900 200 |
|
macro avg 0.2429 0.2457 0.2191 200 |
|
weighted avg 0.5043 0.5900 0.5057 200 |
|
| |
|
| 0.6004 | 3.0 | 516 | 0.3643 | precision recall f1-score support |
|
|
|
ALLERGY 0.8462 0.9167 0.8800 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.2000 0.3636 0.2581 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.2500 1.0000 0.4000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 1.0000 0.2000 0.3333 5 |
|
FAM/SOCHX 0.8936 0.9333 0.9130 45 |
|
GENHX 0.6618 0.8491 0.7438 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.0000 0.0000 0.0000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8000 0.8000 0.8000 10 |
|
Medicine 0.0000 0.0000 0.0000 0 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.4211 0.5714 0.4848 14 |
|
PASTSURGICAL 0.6364 1.0000 0.7778 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.0000 0.0000 0.0000 17 |
|
|
|
accuracy 0.6350 200 |
|
macro avg 0.2719 0.3159 0.2662 200 |
|
weighted avg 0.5562 0.6350 0.5810 200 |
|
| |
|
| 0.6004 | 4.0 | 688 | 0.3429 | precision recall f1-score support |
|
|
|
ALLERGY 1.0000 0.9167 0.9565 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.5000 0.1818 0.2667 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.1250 1.0000 0.2222 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 1.0000 0.2000 0.3333 5 |
|
FAM/SOCHX 0.8750 0.9333 0.9032 45 |
|
GENHX 0.5897 0.8679 0.7023 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.0000 0.0000 0.0000 1 |
|
Intra-Algeria 0.0000 0.0000 0.0000 0 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.5294 0.6429 0.5806 14 |
|
PASTSURGICAL 0.8750 1.0000 0.9333 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.8000 0.2353 0.3636 17 |
|
|
|
accuracy 0.6650 200 |
|
macro avg 0.3394 0.3323 0.2939 200 |
|
weighted avg 0.6436 0.6650 0.6205 200 |
|
| |
|
| 0.6004 | 5.0 | 860 | 0.3425 | precision recall f1-score support |
|
|
|
ALLERGY 1.0000 0.9167 0.9565 12 |
|
ASSESSMENT 0.2000 0.0909 0.1250 11 |
|
CC 0.2632 0.4545 0.3333 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.1000 1.0000 0.1818 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.4000 0.4444 5 |
|
FAM/SOCHX 0.8776 0.9556 0.9149 45 |
|
GENHX 0.7258 0.8491 0.7826 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.0000 0.0000 0.0000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.6000 0.6429 0.6207 14 |
|
PASTSURGICAL 0.8750 1.0000 0.9333 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.7500 0.1765 0.2857 17 |
|
|
|
accuracy 0.6850 200 |
|
macro avg 0.3362 0.3743 0.3244 200 |
|
weighted avg 0.6663 0.6850 0.6537 200 |
|
| |
|
| 0.1554 | 6.0 | 1032 | 0.3941 | precision recall f1-score support |
|
|
|
ALLERGY 1.0000 0.9167 0.9565 12 |
|
ASSESSMENT 0.2500 0.0909 0.1333 11 |
|
CC 0.0000 0.0000 0.0000 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.0000 0.0000 0.0000 5 |
|
FAM/SOCHX 0.8936 0.9333 0.9130 45 |
|
GENHX 0.5341 0.8868 0.6667 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.0000 0.0000 0.0000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.5000 0.7143 0.5882 14 |
|
PASTSURGICAL 1.0000 0.8571 0.9231 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6500 200 |
|
macro avg 0.2806 0.2788 0.2681 200 |
|
weighted avg 0.5790 0.6500 0.5889 200 |
|
| |
|
| 0.1554 | 7.0 | 1204 | 0.4004 | precision recall f1-score support |
|
|
|
ALLERGY 1.0000 0.9167 0.9565 12 |
|
ASSESSMENT 0.3333 0.0909 0.1429 11 |
|
CC 0.3333 0.2727 0.3000 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.1250 1.0000 0.2222 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 1.0000 0.2000 0.3333 5 |
|
FAM/SOCHX 0.8667 0.8667 0.8667 45 |
|
GENHX 0.6081 0.8491 0.7087 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.0000 0.0000 0.0000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.5238 0.7857 0.6286 14 |
|
PASTSURGICAL 0.8571 0.8571 0.8571 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6667 0.1176 0.2000 17 |
|
X 0.0000 0.0000 0.0000 0 |
|
|
|
accuracy 0.6500 200 |
|
macro avg 0.3404 0.3313 0.2917 200 |
|
weighted avg 0.6434 0.6500 0.6104 200 |
|
| |
|
| 0.1554 | 8.0 | 1376 | 0.3968 | precision recall f1-score support |
|
|
|
ALLERGY 1.0000 0.9167 0.9565 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.3000 0.2727 0.2857 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.1667 1.0000 0.2857 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.2000 0.2857 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
G I 0.0000 0.0000 0.0000 0 |
|
GENHX 0.5897 0.8679 0.7023 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.2000 1.0000 0.3333 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.6667 0.5714 0.6154 14 |
|
PASTSURGICAL 0.8750 1.0000 0.9333 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6600 200 |
|
macro avg 0.3145 0.3770 0.3081 200 |
|
weighted avg 0.6134 0.6600 0.6144 200 |
|
| |
|
| 0.0947 | 9.0 | 1548 | 0.4471 | precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.2500 0.2727 0.2609 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.1429 1.0000 0.2500 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 1.0000 0.2000 0.3333 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.5875 0.8868 0.7068 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.2500 1.0000 0.4000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7500 0.6429 0.6923 14 |
|
PASTSURGICAL 1.0000 0.8571 0.9231 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6667 0.1176 0.2000 17 |
|
|
|
accuracy 0.6600 200 |
|
macro avg 0.3635 0.3902 0.3242 200 |
|
weighted avg 0.6335 0.6600 0.6120 200 |
|
| |
|
| 0.0947 | 10.0 | 1720 | 0.4346 | precision recall f1-score support |
|
|
|
ALLERGY 0.7857 0.9167 0.8462 12 |
|
ASSESSMENT 0.3333 0.0909 0.1429 11 |
|
CC 0.3333 0.5455 0.4138 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.2000 0.2857 5 |
|
FAM/SOCHX 0.8750 0.9333 0.9032 45 |
|
GENHX 0.6716 0.8491 0.7500 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.2000 1.0000 0.3333 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.6923 0.6429 0.6667 14 |
|
PASTSURGICAL 1.0000 1.0000 1.0000 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6800 200 |
|
macro avg 0.3412 0.3677 0.3262 200 |
|
weighted avg 0.6483 0.6800 0.6425 200 |
|
| |
|
| 0.0947 | 11.0 | 1892 | 0.4606 | precision recall f1-score support |
|
|
|
ALLERGY 0.7857 0.9167 0.8462 12 |
|
ASSESSMENT 0.3333 0.0909 0.1429 11 |
|
CC 0.3000 0.2727 0.2857 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.2000 0.2857 5 |
|
FAM/SOCHX 0.8696 0.8889 0.8791 45 |
|
GENHX 0.5823 0.8679 0.6970 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.2500 1.0000 0.4000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7500 0.6429 0.6923 14 |
|
PASTSURGICAL 1.0000 1.0000 1.0000 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6600 200 |
|
macro avg 0.3402 0.3528 0.3205 200 |
|
weighted avg 0.6258 0.6600 0.6181 200 |
|
| |
|
| 0.0587 | 12.0 | 2064 | 0.4997 | precision recall f1-score support |
|
|
|
ALLERGY 0.7857 0.9167 0.8462 12 |
|
ASSESSMENT 0.5000 0.0909 0.1538 11 |
|
CC 0.3333 0.3636 0.3478 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 1.0000 0.2000 0.3333 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.5921 0.8491 0.6977 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.2000 1.0000 0.3333 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7143 0.7143 0.7143 14 |
|
PASTSURGICAL 1.0000 1.0000 1.0000 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6700 200 |
|
macro avg 0.3716 0.3611 0.3250 200 |
|
weighted avg 0.6498 0.6700 0.6274 200 |
|
| |
|
| 0.0587 | 13.0 | 2236 | 0.4835 | precision recall f1-score support |
|
|
|
ALLERGY 0.8462 0.9167 0.8800 12 |
|
ASSESSMENT 0.3333 0.0909 0.1429 11 |
|
CC 0.2941 0.4545 0.3571 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.2000 0.2857 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.6377 0.8302 0.7213 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.2500 1.0000 0.4000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.6000 0.6429 0.6207 14 |
|
PASTSURGICAL 0.8750 1.0000 0.9333 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.5000 0.1176 0.1905 17 |
|
|
|
accuracy 0.6600 200 |
|
macro avg 0.3271 0.3582 0.3166 200 |
|
weighted avg 0.6211 0.6600 0.6189 200 |
|
| |
|
| 0.0587 | 14.0 | 2408 | 0.4983 | precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.5000 0.0909 0.1538 11 |
|
CC 0.2857 0.3636 0.3200 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.3333 0.2000 0.2500 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.6133 0.8679 0.7187 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.3333 1.0000 0.5000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7273 0.5714 0.6400 14 |
|
PASTSURGICAL 0.7778 1.0000 0.8750 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6650 200 |
|
macro avg 0.3397 0.3549 0.3224 200 |
|
weighted avg 0.6378 0.6650 0.6249 200 |
|
| |
|
| 0.0418 | 15.0 | 2580 | 0.4944 | precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.3158 0.5455 0.4000 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.2000 0.2857 5 |
|
FAM/SOCHX 0.8750 0.9333 0.9032 45 |
|
GENHX 0.6667 0.8679 0.7541 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.2000 1.0000 0.3333 1 |
|
Inferiority 0.0000 0.0000 0.0000 0 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7000 0.5000 0.5833 14 |
|
PASTSURGICAL 0.7778 1.0000 0.8750 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6700 200 |
|
macro avg 0.3041 0.3400 0.2968 200 |
|
weighted avg 0.6283 0.6700 0.6290 200 |
|
| |
|
| 0.0418 | 16.0 | 2752 | 0.4890 | precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.2308 0.5455 0.3243 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.3333 0.2000 0.2500 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.6866 0.8679 0.7667 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.3333 1.0000 0.5000 1 |
|
Inferiority 0.0000 0.0000 0.0000 0 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7778 0.5000 0.6087 14 |
|
PASTSURGICAL 0.7778 1.0000 0.8750 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6667 0.2353 0.3478 17 |
|
|
|
accuracy 0.6700 200 |
|
macro avg 0.3061 0.3417 0.3043 200 |
|
weighted avg 0.6359 0.6700 0.6336 200 |
|
| |
|
| 0.0418 | 17.0 | 2924 | 0.5106 | precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.2381 0.4545 0.3125 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.3333 0.2000 0.2500 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.6389 0.8679 0.7360 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.3333 1.0000 0.5000 1 |
|
Inferiority 0.0000 0.0000 0.0000 0 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7000 0.5000 0.5833 14 |
|
PASTSURGICAL 0.7778 1.0000 0.8750 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.5000 0.1176 0.1905 17 |
|
|
|
accuracy 0.6550 200 |
|
macro avg 0.2926 0.3318 0.2935 200 |
|
weighted avg 0.6041 0.6550 0.6096 200 |
|
| |
|
| 0.0289 | 18.0 | 3096 | 0.5188 | precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.2500 0.5455 0.3429 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.3333 0.2000 0.2500 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.6970 0.8679 0.7731 53 |
|
GYNHX 0.5000 1.0000 0.6667 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.3333 1.0000 0.5000 1 |
|
Inferiority 0.0000 0.0000 0.0000 0 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.8333 1.0000 0.9091 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7273 0.5714 0.6400 14 |
|
PASTSURGICAL 0.7778 1.0000 0.8750 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6750 200 |
|
macro avg 0.3258 0.3900 0.3351 200 |
|
weighted avg 0.6330 0.6750 0.6354 200 |
|
| |
|
| 0.0289 | 19.0 | 3268 | 0.5195 | precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.0000 0.0000 0.0000 11 |
|
CC 0.2500 0.5455 0.3429 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.2000 0.2857 5 |
|
FAM/SOCHX 0.8750 0.9333 0.9032 45 |
|
GENHX 0.6970 0.8679 0.7731 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.3333 1.0000 0.5000 1 |
|
Inferiority 0.0000 0.0000 0.0000 0 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.7692 1.0000 0.8696 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7273 0.5714 0.6400 14 |
|
PASTSURGICAL 0.7778 1.0000 0.8750 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6750 200 |
|
macro avg 0.3070 0.3434 0.3038 200 |
|
weighted avg 0.6321 0.6750 0.6337 200 |
|
| |
|
| 0.0289 | 20.0 | 3440 | 0.5235 | precision recall f1-score support |
|
|
|
ALLERGY 0.9167 0.9167 0.9167 12 |
|
ASSESSMENT 0.5000 0.0909 0.1538 11 |
|
CC 0.2400 0.5455 0.3333 11 |
|
DIAGNOSIS 0.0000 0.0000 0.0000 1 |
|
DISPOSITION 0.0000 0.0000 0.0000 1 |
|
EDCOURSE 0.0000 0.0000 0.0000 4 |
|
EXAM 0.5000 0.2000 0.2857 5 |
|
FAM/SOCHX 0.8723 0.9111 0.8913 45 |
|
GENHX 0.6866 0.8679 0.7667 53 |
|
GYNHX 0.0000 0.0000 0.0000 1 |
|
IMAGING 0.0000 0.0000 0.0000 1 |
|
IMMUNIZATIONS 0.3333 1.0000 0.5000 1 |
|
LABS 0.0000 0.0000 0.0000 1 |
|
MEDICATIONS 0.7692 1.0000 0.8696 10 |
|
OTHER_HISTORY 0.0000 0.0000 0.0000 3 |
|
PASTMEDICALHX 0.7273 0.5714 0.6400 14 |
|
PASTSURGICAL 0.7778 1.0000 0.8750 7 |
|
PLAN 0.0000 0.0000 0.0000 1 |
|
PROCEDURES 0.0000 0.0000 0.0000 1 |
|
ROS 0.6000 0.1765 0.2727 17 |
|
|
|
accuracy 0.6750 200 |
|
macro avg 0.3462 0.3640 0.3252 200 |
|
weighted avg 0.6557 0.6750 0.6372 200 |
|
| |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.38.2 |
|
- Pytorch 2.1.0+cu121 |
|
- Datasets 2.18.0 |
|
- Tokenizers 0.15.2 |
|
|
