metadata

license: apache-2.0
base_model: google/flan-t5-small
tags:
  - generated_from_trainer
model-index:
  - name: classification_flan_t5_enriched
    results: []

classification_flan_t5_enriched

This model is a fine-tuned version of google/flan-t5-small on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.5235
Classification Report: precision recall f1-score support
```
ALLERGY     0.9167    0.9167    0.9167        12
```
ASSESSMENT 0.5000 0.0909 0.1538 11 CC 0.2400 0.5455 0.3333 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6866 0.8679 0.7667 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1

IMMUNIZATIONS 0.3333 1.0000 0.5000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6750       200
macro avg     0.3462    0.3640    0.3252       200

weighted avg 0.6557 0.6750 0.6372 200

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 7
eval_batch_size: 7
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 20

Training results

Training Loss	Epoch	Step	Validation Loss	Classification Report
No log	1.0	172	0.5962	precision recall f1-score support

  ALLERGY     0.6471    0.9167    0.7586        12

ASSESSMENT 0.1429 0.0909 0.1111 11 CC 0.0000 0.0000 0.0000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.7556 0.7556 0.7556 45 GENHX 0.5000 0.8113 0.6187 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIS 0.0000 0.0000 0.0000 0 IMMUNITIVES 0.0000 0.0000 0.0000 0 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.4000 0.5000 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.2500 0.0714 0.1111 14 PASTSURGICAL 0.1739 0.5714 0.2667 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 Prevacid 0.0000 0.0000 0.0000 0 Psychiatric 0.0000 0.0000 0.0000 0 ROS 0.0000 0.0000 0.0000 17 Travel 0.0000 0.0000 0.0000 0 X 0.0000 0.0000 0.0000 0

 accuracy                         0.4900       200
macro avg     0.1206    0.1391    0.1201       200

weighted avg 0.4061 0.4900 0.4277 200 | | No log | 2.0 | 344 | 0.4113 | precision recall f1-score support

  ALLERGY     0.7857    0.9167    0.8462        12

ASSESSMENT 1.0000 0.0909 0.1667 11 CC 0.0000 0.0000 0.0000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.8444 0.8444 0.8444 45 GENHX 0.4706 0.9057 0.6194 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6667 0.8000 0.7273 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4545 0.3571 0.4000 14 PASTSURGICAL 0.6364 1.0000 0.7778 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 17

 accuracy                         0.5900       200
macro avg     0.2429    0.2457    0.2191       200

weighted avg 0.5043 0.5900 0.5057 200 | | 0.6004 | 3.0 | 516 | 0.3643 | precision recall f1-score support

  ALLERGY     0.8462    0.9167    0.8800        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2000 0.3636 0.2581 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.2500 1.0000 0.4000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.6618 0.8491 0.7438 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8000 0.8000 0.8000 10 Medicine 0.0000 0.0000 0.0000 0 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.4211 0.5714 0.4848 14 PASTSURGICAL 0.6364 1.0000 0.7778 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 17

 accuracy                         0.6350       200
macro avg     0.2719    0.3159    0.2662       200

weighted avg 0.5562 0.6350 0.5810 200 | | 0.6004 | 4.0 | 688 | 0.3429 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.5000 0.1818 0.2667 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1250 1.0000 0.2222 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.5897 0.8679 0.7023 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 Intra-Algeria 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5294 0.6429 0.5806 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.8000 0.2353 0.3636 17

 accuracy                         0.6650       200
macro avg     0.3394    0.3323    0.2939       200

weighted avg 0.6436 0.6650 0.6205 200 | | 0.6004 | 5.0 | 860 | 0.3425 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.2000 0.0909 0.1250 11 CC 0.2632 0.4545 0.3333 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1000 1.0000 0.1818 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.4000 0.4444 5 FAM/SOCHX 0.8776 0.9556 0.9149 45 GENHX 0.7258 0.8491 0.7826 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.6429 0.6207 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.7500 0.1765 0.2857 17

 accuracy                         0.6850       200
macro avg     0.3362    0.3743    0.3244       200

weighted avg 0.6663 0.6850 0.6537 200 | | 0.1554 | 6.0 | 1032 | 0.3941 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.2500 0.0909 0.1333 11 CC 0.0000 0.0000 0.0000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.0000 0.0000 0.0000 5 FAM/SOCHX 0.8936 0.9333 0.9130 45 GENHX 0.5341 0.8868 0.6667 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5000 0.7143 0.5882 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6500       200
macro avg     0.2806    0.2788    0.2681       200

weighted avg 0.5790 0.6500 0.5889 200 | | 0.1554 | 7.0 | 1204 | 0.4004 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.3333 0.2727 0.3000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1250 1.0000 0.2222 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8667 0.8667 0.8667 45 GENHX 0.6081 0.8491 0.7087 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.5238 0.7857 0.6286 14 PASTSURGICAL 0.8571 0.8571 0.8571 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1176 0.2000 17 X 0.0000 0.0000 0.0000 0

 accuracy                         0.6500       200
macro avg     0.3404    0.3313    0.2917       200

weighted avg 0.6434 0.6500 0.6104 200 | | 0.1554 | 8.0 | 1376 | 0.3968 | precision recall f1-score support

  ALLERGY     1.0000    0.9167    0.9565        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3000 0.2727 0.2857 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1667 1.0000 0.2857 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 G I 0.0000 0.0000 0.0000 0 GENHX 0.5897 0.8679 0.7023 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6667 0.5714 0.6154 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6600       200
macro avg     0.3145    0.3770    0.3081       200

weighted avg 0.6134 0.6600 0.6144 200 | | 0.0947 | 9.0 | 1548 | 0.4471 | precision recall f1-score support

  ALLERGY     0.9167    0.9167    0.9167        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2500 0.2727 0.2609 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.1429 1.0000 0.2500 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.5875 0.8868 0.7068 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2500 1.0000 0.4000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7500 0.6429 0.6923 14 PASTSURGICAL 1.0000 0.8571 0.9231 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1176 0.2000 17

 accuracy                         0.6600       200
macro avg     0.3635    0.3902    0.3242       200

weighted avg 0.6335 0.6600 0.6120 200 | | 0.0947 | 10.0 | 1720 | 0.4346 | precision recall f1-score support

  ALLERGY     0.7857    0.9167    0.8462        12

ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.3333 0.5455 0.4138 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.6716 0.8491 0.7500 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6923 0.6429 0.6667 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6800       200
macro avg     0.3412    0.3677    0.3262       200

weighted avg 0.6483 0.6800 0.6425 200 | | 0.0947 | 11.0 | 1892 | 0.4606 | precision recall f1-score support

  ALLERGY     0.7857    0.9167    0.8462        12

ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.3000 0.2727 0.2857 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8696 0.8889 0.8791 45 GENHX 0.5823 0.8679 0.6970 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2500 1.0000 0.4000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7500 0.6429 0.6923 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6600       200
macro avg     0.3402    0.3528    0.3205       200

weighted avg 0.6258 0.6600 0.6181 200 | | 0.0587 | 12.0 | 2064 | 0.4997 | precision recall f1-score support

  ALLERGY     0.7857    0.9167    0.8462        12

ASSESSMENT 0.5000 0.0909 0.1538 11 CC 0.3333 0.3636 0.3478 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 1.0000 0.2000 0.3333 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.5921 0.8491 0.6977 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7143 0.7143 0.7143 14 PASTSURGICAL 1.0000 1.0000 1.0000 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6700       200
macro avg     0.3716    0.3611    0.3250       200

weighted avg 0.6498 0.6700 0.6274 200 | | 0.0587 | 13.0 | 2236 | 0.4835 | precision recall f1-score support

  ALLERGY     0.8462    0.9167    0.8800        12

ASSESSMENT 0.3333 0.0909 0.1429 11 CC 0.2941 0.4545 0.3571 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6377 0.8302 0.7213 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2500 1.0000 0.4000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.6000 0.6429 0.6207 14 PASTSURGICAL 0.8750 1.0000 0.9333 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.5000 0.1176 0.1905 17

 accuracy                         0.6600       200
macro avg     0.3271    0.3582    0.3166       200

weighted avg 0.6211 0.6600 0.6189 200 | | 0.0587 | 14.0 | 2408 | 0.4983 | precision recall f1-score support

  ALLERGY     0.9167    0.9167    0.9167        12

ASSESSMENT 0.5000 0.0909 0.1538 11 CC 0.2857 0.3636 0.3200 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.2000 0.2500 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6133 0.8679 0.7187 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6650       200
macro avg     0.3397    0.3549    0.3224       200

weighted avg 0.6378 0.6650 0.6249 200 | | 0.0418 | 15.0 | 2580 | 0.4944 | precision recall f1-score support

  ALLERGY     0.9167    0.9167    0.9167        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.3158 0.5455 0.4000 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.6667 0.8679 0.7541 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.2000 1.0000 0.3333 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7000 0.5000 0.5833 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6700       200
macro avg     0.3041    0.3400    0.2968       200

weighted avg 0.6283 0.6700 0.6290 200 | | 0.0418 | 16.0 | 2752 | 0.4890 | precision recall f1-score support

  ALLERGY     0.9167    0.9167    0.9167        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2308 0.5455 0.3243 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.2000 0.2500 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6866 0.8679 0.7667 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7778 0.5000 0.6087 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.2353 0.3478 17

 accuracy                         0.6700       200
macro avg     0.3061    0.3417    0.3043       200

weighted avg 0.6359 0.6700 0.6336 200 | | 0.0418 | 17.0 | 2924 | 0.5106 | precision recall f1-score support

  ALLERGY     0.9167    0.9167    0.9167        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2381 0.4545 0.3125 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.2000 0.2500 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6389 0.8679 0.7360 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7000 0.5000 0.5833 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.5000 0.1176 0.1905 17

 accuracy                         0.6550       200
macro avg     0.2926    0.3318    0.2935       200

weighted avg 0.6041 0.6550 0.6096 200 | | 0.0289 | 18.0 | 3096 | 0.5188 | precision recall f1-score support

  ALLERGY     0.9167    0.9167    0.9167        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2500 0.5455 0.3429 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.3333 0.2000 0.2500 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6970 0.8679 0.7731 53 GYNHX 0.5000 1.0000 0.6667 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.8333 1.0000 0.9091 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6750       200
macro avg     0.3258    0.3900    0.3351       200

weighted avg 0.6330 0.6750 0.6354 200 | | 0.0289 | 19.0 | 3268 | 0.5195 | precision recall f1-score support

  ALLERGY     0.9167    0.9167    0.9167        12

ASSESSMENT 0.0000 0.0000 0.0000 11 CC 0.2500 0.5455 0.3429 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8750 0.9333 0.9032 45 GENHX 0.6970 0.8679 0.7731 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 Inferiority 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6750       200
macro avg     0.3070    0.3434    0.3038       200

weighted avg 0.6321 0.6750 0.6337 200 | | 0.0289 | 20.0 | 3440 | 0.5235 | precision recall f1-score support

  ALLERGY     0.9167    0.9167    0.9167        12

ASSESSMENT 0.5000 0.0909 0.1538 11 CC 0.2400 0.5455 0.3333 11 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 1 EDCOURSE 0.0000 0.0000 0.0000 4 EXAM 0.5000 0.2000 0.2857 5 FAM/SOCHX 0.8723 0.9111 0.8913 45 GENHX 0.6866 0.8679 0.7667 53 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7692 1.0000 0.8696 10 OTHER_HISTORY 0.0000 0.0000 0.0000 3 PASTMEDICALHX 0.7273 0.5714 0.6400 14 PASTSURGICAL 0.7778 1.0000 0.8750 7 PLAN 0.0000 0.0000 0.0000 1 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6000 0.1765 0.2727 17

 accuracy                         0.6750       200
macro avg     0.3462    0.3640    0.3252       200

weighted avg 0.6557 0.6750 0.6372 200 |

Framework versions

Transformers 4.38.2
Pytorch 2.1.0+cu121
Datasets 2.18.0
Tokenizers 0.15.2