Hugging Face's logo

sarahahtee
/
classification_flan_t5_enriched_validation

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
Edit model card

classification_flan_t5_enriched_validation

This model is a fine-tuned version of google/flan-t5-small on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.6387

  • Classification Report: precision recall f1-score support

    ALLERGY     1.0000    0.5000    0.6667         4

    ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3000 0.7500 0.4286 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8148 1.0000 0.8980 22 GENHX 0.6923 0.9000 0.7826 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1

IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6500       100
macro avg     0.3380    0.3523    0.3252       100

weighted avg 0.6059 0.6500 0.5984 100

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 0.0001
  • train_batch_size: 7
  • eval_batch_size: 7
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 20

Training results

Training Loss Epoch Step Validation Loss Classification Report
No log 1.0 172 0.7417 precision recall f1-score support 
  ALLERGY     0.2500    0.5000    0.3333         4

ASSESSMENT 0.0000 0.0000 0.0000 4 Afib 0.0000 0.0000 0.0000 0 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.7222 0.5909 0.6500 22 GENHX 0.5143 0.9000 0.6545 20 GYNHX 0.0000 0.0000 0.0000 1 ICT 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNITIES 0.0000 0.0000 0.0000 0 IMMUNITIVES 0.0000 0.0000 0.0000 0 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 INFLUENCED 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5000 0.4286 0.4615 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.2000 0.2500 0.2222 4 PASTSURGICAL 0.5000 0.7500 0.6000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 thoughts 0.0000 0.0000 0.0000 0

 accuracy                         0.4300       100
macro avg     0.1033    0.1315    0.1124       100

weighted avg 0.3547 0.4300 0.3764 100 | | No log | 2.0 | 344 | 0.5061 | precision recall f1-score support

  ALLERGY     0.5000    0.2500    0.3333         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.0000 0.0000 0.0000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.4524 0.9500 0.6129 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.4545 0.7143 0.5556 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4286 0.7500 0.5455 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.0000 0.0000 0.0000 11 thoughts 0.0000 0.0000 0.0000 0

 accuracy                         0.5700       100
macro avg     0.1697    0.2199    0.1849       100

weighted avg 0.4153 0.5700 0.4685 100 | | 0.6004 | 3.0 | 516 | 0.4744 | precision recall f1-score support

                ALLERGY     1.0000    0.2500    0.4000         4
             ASSESSMENT     0.0000    0.0000    0.0000         4
                     CC     0.2500    0.2500    0.2500         4
              DIAGNOSIS     0.0000    0.0000    0.0000         1
            DISPOSITION     0.0000    0.0000    0.0000         2
               EDCOURSE     0.0000    0.0000    0.0000         3
                   EXAM     0.0000    0.0000    0.0000         1
              FAM/SOCHX     0.9130    0.9545    0.9333        22
                  GENHX     0.6552    0.9500    0.7755        20
                  GYNHX     0.0000    0.0000    0.0000         1
   How are you feeling?     0.0000    0.0000    0.0000         0

I am going home with my son 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 INVATIONS 0.0000 0.0000 0.0000 0 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.5714 0.5714 0.5714 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4444 1.0000 0.6154 4 PASTSURGICAL 0.8000 1.0000 0.8889 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.0909 0.1667 11

               accuracy                         0.5900       100
              macro avg     0.2450    0.2203    0.2001       100
           weighted avg     0.6137    0.5900    0.5405       100
                                                                  |

| 0.6004 | 4.0 | 688 | 0.4568 | precision recall f1-score support

                ALLERGY     0.5000    0.2500    0.3333         4
             ASSESSMENT     0.0000    0.0000    0.0000         4
                   Afib     0.0000    0.0000    0.0000         0
                     CC     1.0000    0.2500    0.4000         4
              DIAGNOSIS     0.0000    0.0000    0.0000         1
            DISPOSITION     0.0000    0.0000    0.0000         2
               EDCOURSE     0.0000    0.0000    0.0000         3
                   EXAM     0.0000    0.0000    0.0000         1
              FAM/SOCHX     0.8462    1.0000    0.9167        22
                  GENHX     0.6129    0.9500    0.7451        20
                  GYNHX     0.0000    0.0000    0.0000         1
   How are you feeling?     0.0000    0.0000    0.0000         0

I am going home with my son 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11

               accuracy                         0.6300       100
              macro avg     0.2863    0.2759    0.2479       100
           weighted avg     0.6275    0.6300    0.5739       100
                                                                  |

| 0.6004 | 5.0 | 860 | 0.4503 | precision recall f1-score support

                ALLERGY     1.0000    0.2500    0.4000         4
             ASSESSMENT     0.0000    0.0000    0.0000         4
                   Afib     0.0000    0.0000    0.0000         0
                     CC     0.2222    0.5000    0.3077         4
              DIAGNOSIS     0.0000    0.0000    0.0000         1
            DISPOSITION     0.0000    0.0000    0.0000         2
               EDCOURSE     0.0000    0.0000    0.0000         3
                   EXAM     1.0000    1.0000    1.0000         1
              FAM/SOCHX     0.8462    1.0000    0.9167        22
                  GENHX     0.8261    0.9500    0.8837        20
                  GYNHX     0.0000    0.0000    0.0000         1
   How are you feeling?     0.0000    0.0000    0.0000         0

I am going home with my son 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 thoughts 0.0000 0.0000 0.0000 0

               accuracy                         0.6400       100
              macro avg     0.2816    0.2748    0.2578       100
           weighted avg     0.6302    0.6400    0.6039       100

| | 0.1554 | 6.0 | 1032 | 0.4714 | precision recall f1-score support

         ALLERGY     1.0000    0.2500    0.4000         4
      ASSESSMENT     0.0000    0.0000    0.0000         4
              CC     0.0000    0.0000    0.0000         4
       DIAGNOSIS     0.0000    0.0000    0.0000         1
     DISPOSITION     0.0000    0.0000    0.0000         2
        EDCOURSE     0.0000    0.0000    0.0000         3
            EXAM     0.0000    0.0000    0.0000         1
       FAM/SOCHX     0.8462    1.0000    0.9167        22
           GENHX     0.5758    0.9500    0.7170        20
           GYNHX     0.0000    0.0000    0.0000         1

How are you feeling? 0.0000 0.0000 0.0000 0 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.3333 1.0000 0.5000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11

        accuracy                         0.6200       100
       macro avg     0.2735    0.2903    0.2401       100
    weighted avg     0.5929    0.6200    0.5479       100
                                                                                                                                                                                                                                                                                                                                                                                           |

| 0.1554 | 7.0 | 1204 | 0.4865 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 1.0000 0.5000 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8696 0.9091 0.8889 22 GENHX 0.6333 0.9500 0.7600 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.5000 1.0000 0.6667 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.3636 1.0000 0.5333 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11

 accuracy                         0.6300       100
macro avg     0.3940    0.3753    0.3416       100

weighted avg 0.6524 0.6300 0.5840 100 | | 0.1554 | 8.0 | 1376 | 0.4980 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.6667 0.5000 0.5714 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8800 1.0000 0.9362 22 GENHX 0.5938 0.9500 0.7308 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 0.8889 1.0000 0.9412 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6300       100
macro avg     0.2946    0.2798    0.2630       100

weighted avg 0.5901 0.6300 0.5734 100 | | 0.0947 | 9.0 | 1548 | 0.5413 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4000 0.5000 0.4444 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 0.0000 0.0000 0.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.6552 0.9500 0.7755 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11

 accuracy                         0.6300       100
macro avg     0.3013    0.2798    0.2589       100

weighted avg 0.6269 0.6300 0.5777 100 | | 0.0947 | 10.0 | 1720 | 0.5247 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4286 0.7500 0.5455 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.7308 0.9500 0.8261 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.4000 1.0000 0.5714 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11 thoughts 0.0000 0.0000 0.0000 0

 accuracy                         0.6400       100
macro avg     0.3186    0.3238    0.2947       100

weighted avg 0.6112 0.6400 0.5906 100 | | 0.0947 | 11.0 | 1892 | 0.5280 | precision recall f1-score support

  ALLERGY     0.6667    0.5000    0.5714         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4000 0.5000 0.4444 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.9167 1.0000 0.9565 22 GENHX 0.5758 0.9500 0.7170 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6500       100
macro avg     0.3256    0.3423    0.3208       100

weighted avg 0.5957 0.6500 0.5950 100 | | 0.0587 | 12.0 | 2064 | 0.5994 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5714 1.0000 0.7273 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.6667 1.0000 0.8000 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11 thoughts 0.0000 0.0000 0.0000 0

 accuracy                         0.6800       100
macro avg     0.3475    0.3522    0.3238       100

weighted avg 0.6523 0.6800 0.6179 100 | | 0.0587 | 13.0 | 2236 | 0.5773 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.5000 1.0000 0.6667 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8462 1.0000 0.9167 22 GENHX 0.6786 0.9500 0.7917 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11 thoughts 0.0000 0.0000 0.0000 0

 accuracy                         0.6600       100
macro avg     0.3439    0.3379    0.3084       100

weighted avg 0.6485 0.6600 0.6023 100 | | 0.0587 | 14.0 | 2408 | 0.6098 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.4000 1.0000 0.5714 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.6429 0.9000 0.7500 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11

 accuracy                         0.6400       100
macro avg     0.3504    0.3500    0.3128       100

weighted avg 0.6331 0.6400 0.5826 100 | | 0.0418 | 15.0 | 2580 | 0.6052 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3636 1.0000 0.5333 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8148 1.0000 0.8980 22 GENHX 0.6923 0.9000 0.7826 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11

 accuracy                         0.6500       100
macro avg     0.3534    0.3523    0.3158       100

weighted avg 0.6389 0.6500 0.5910 100 | | 0.0418 | 16.0 | 2752 | 0.5896 | precision recall f1-score support

  ALLERGY     1.0000    0.2500    0.4000         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.2727 0.7500 0.4000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.6923 0.9000 0.7826 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.6250 0.7143 0.6667 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6300       100
macro avg     0.3298    0.3375    0.3048       100

weighted avg 0.6013 0.6300 0.5799 100 | | 0.0418 | 17.0 | 2924 | 0.6175 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3750 0.7500 0.5000 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8400 0.9545 0.8936 22 GENHX 0.6552 0.9500 0.7755 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5000 1.0000 0.6667 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6500       100
macro avg     0.3376    0.3525    0.3251       100

weighted avg 0.6042 0.6500 0.5965 100 | | 0.0289 | 18.0 | 3096 | 0.6305 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3636 1.0000 0.5333 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8148 1.0000 0.8980 22 GENHX 0.6923 0.9000 0.7826 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 1.0000 0.1818 0.3077 11

 accuracy                         0.6600       100
macro avg     0.3578    0.3648    0.3315       100

weighted avg 0.6451 0.6600 0.6050 100 | | 0.0289 | 19.0 | 3268 | 0.6326 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3000 0.7500 0.4286 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8148 1.0000 0.8980 22 GENHX 0.6923 0.9000 0.7826 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6500       100
macro avg     0.3380    0.3523    0.3252       100

weighted avg 0.6059 0.6500 0.5984 100 | | 0.0289 | 20.0 | 3440 | 0.6387 | precision recall f1-score support

  ALLERGY     1.0000    0.5000    0.6667         4

ASSESSMENT 0.0000 0.0000 0.0000 4 CC 0.3000 0.7500 0.4286 4 DIAGNOSIS 0.0000 0.0000 0.0000 1 DISPOSITION 0.0000 0.0000 0.0000 2 EDCOURSE 0.0000 0.0000 0.0000 3 EXAM 1.0000 1.0000 1.0000 1 FAM/SOCHX 0.8148 1.0000 0.8980 22 GENHX 0.6923 0.9000 0.7826 20 GYNHX 0.0000 0.0000 0.0000 1 IMAGING 0.0000 0.0000 0.0000 1 IMMUNIZATIONS 0.0000 0.0000 0.0000 1 LABS 0.0000 0.0000 0.0000 1 MEDICATIONS 0.7143 0.7143 0.7143 7 OTHER_HISTORY 0.0000 0.0000 0.0000 1 PASTMEDICALHX 0.5714 1.0000 0.7273 4 PASTSURGICAL 1.0000 1.0000 1.0000 8 PLAN 0.0000 0.0000 0.0000 3 PROCEDURES 0.0000 0.0000 0.0000 1 ROS 0.6667 0.1818 0.2857 11

 accuracy                         0.6500       100
macro avg     0.3380    0.3523    0.3252       100

weighted avg 0.6059 0.6500 0.5984 100 |

Framework versions

  • Transformers 4.38.2
  • Pytorch 2.1.0+cu121
  • Datasets 2.18.0
  • Tokenizers 0.15.2
Downloads last month
3
Safetensors
Model size
77M params
Tensor type
F32
·
Inference Examples
Text2Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for sarahahtee/classification_flan_t5_enriched_validation

Base model

google/flan-t5-small
Finetuned
(297)
this model

Evaluation results

Metadata error: specify a dataset to view leaderboard