Hugging Face's logo

sarahahtee
/
classification_flan_t5_enriched_validation

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
Sarah Tariq commited on
Commit
383aae2
•
1 Parent(s): 756d60a

End of training

Browse files
Files changed (4) hide show
  1. README.md +644 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Mar10_21-16-11_94b845ad4781/events.out.tfevents.1710105375.94b845ad4781.1445.0 +2 -2
README.md ADDED
@@ -0,0 +1,644 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: classification_flan_t5_enriched_validation
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # classification_flan_t5_enriched_validation
15
+
16
+ This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.6387
19
+ - Classification Report: precision recall f1-score support
20
+
21
+ ALLERGY 1.0000 0.5000 0.6667 4
22
+ ASSESSMENT 0.0000 0.0000 0.0000 4
23
+ CC 0.3000 0.7500 0.4286 4
24
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
25
+ DISPOSITION 0.0000 0.0000 0.0000 2
26
+ EDCOURSE 0.0000 0.0000 0.0000 3
27
+ EXAM 1.0000 1.0000 1.0000 1
28
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
29
+ GENHX 0.6923 0.9000 0.7826 20
30
+ GYNHX 0.0000 0.0000 0.0000 1
31
+ IMAGING 0.0000 0.0000 0.0000 1
32
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
33
+ LABS 0.0000 0.0000 0.0000 1
34
+ MEDICATIONS 0.7143 0.7143 0.7143 7
35
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
36
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
37
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
38
+ PLAN 0.0000 0.0000 0.0000 3
39
+ PROCEDURES 0.0000 0.0000 0.0000 1
40
+ ROS 0.6667 0.1818 0.2857 11
41
+
42
+ accuracy 0.6500 100
43
+ macro avg 0.3380 0.3523 0.3252 100
44
+ weighted avg 0.6059 0.6500 0.5984 100
45
+
46
+
47
+ ## Model description
48
+
49
+ More information needed
50
+
51
+ ## Intended uses & limitations
52
+
53
+ More information needed
54
+
55
+ ## Training and evaluation data
56
+
57
+ More information needed
58
+
59
+ ## Training procedure
60
+
61
+ ### Training hyperparameters
62
+
63
+ The following hyperparameters were used during training:
64
+ - learning_rate: 0.0001
65
+ - train_batch_size: 7
66
+ - eval_batch_size: 7
67
+ - seed: 42
68
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
69
+ - lr_scheduler_type: linear
70
+ - num_epochs: 20
71
+
72
+ ### Training results
73
+
74
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
+ | No log | 1.0 | 172 | 0.7417 | precision recall f1-score support
77
+
78
+ ALLERGY 0.2500 0.5000 0.3333 4
79
+ ASSESSMENT 0.0000 0.0000 0.0000 4
80
+ Afib 0.0000 0.0000 0.0000 0
81
+ CC 0.0000 0.0000 0.0000 4
82
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
83
+ DISPOSITION 0.0000 0.0000 0.0000 2
84
+ EDCOURSE 0.0000 0.0000 0.0000 3
85
+ EXAM 0.0000 0.0000 0.0000 1
86
+ FAM/SOCHX 0.7222 0.5909 0.6500 22
87
+ GENHX 0.5143 0.9000 0.6545 20
88
+ GYNHX 0.0000 0.0000 0.0000 1
89
+ ICT 0.0000 0.0000 0.0000 0
90
+ IMAGING 0.0000 0.0000 0.0000 1
91
+ IMMUNITIES 0.0000 0.0000 0.0000 0
92
+ IMMUNITIVES 0.0000 0.0000 0.0000 0
93
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
94
+ INFLUENCED 0.0000 0.0000 0.0000 0
95
+ LABS 0.0000 0.0000 0.0000 1
96
+ MEDICATIONS 0.5000 0.4286 0.4615 7
97
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
98
+ PASTMEDICALHX 0.2000 0.2500 0.2222 4
99
+ PASTSURGICAL 0.5000 0.7500 0.6000 8
100
+ PLAN 0.0000 0.0000 0.0000 3
101
+ PROCEDURES 0.0000 0.0000 0.0000 1
102
+ ROS 0.0000 0.0000 0.0000 11
103
+ thoughts 0.0000 0.0000 0.0000 0
104
+
105
+ accuracy 0.4300 100
106
+ macro avg 0.1033 0.1315 0.1124 100
107
+ weighted avg 0.3547 0.4300 0.3764 100
108
+ |
109
+ | No log | 2.0 | 344 | 0.5061 | precision recall f1-score support
110
+
111
+ ALLERGY 0.5000 0.2500 0.3333 4
112
+ ASSESSMENT 0.0000 0.0000 0.0000 4
113
+ CC 0.0000 0.0000 0.0000 4
114
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
115
+ DISPOSITION 0.0000 0.0000 0.0000 2
116
+ EDCOURSE 0.0000 0.0000 0.0000 3
117
+ EXAM 0.0000 0.0000 0.0000 1
118
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
119
+ GENHX 0.4524 0.9500 0.6129 20
120
+ GYNHX 0.0000 0.0000 0.0000 1
121
+ IMAGING 0.0000 0.0000 0.0000 1
122
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
123
+ LABS 0.0000 0.0000 0.0000 1
124
+ MEDICATIONS 0.4545 0.7143 0.5556 7
125
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
126
+ PASTMEDICALHX 0.4286 0.7500 0.5455 4
127
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
128
+ PLAN 0.0000 0.0000 0.0000 3
129
+ PROCEDURES 0.0000 0.0000 0.0000 1
130
+ ROS 0.0000 0.0000 0.0000 11
131
+ thoughts 0.0000 0.0000 0.0000 0
132
+
133
+ accuracy 0.5700 100
134
+ macro avg 0.1697 0.2199 0.1849 100
135
+ weighted avg 0.4153 0.5700 0.4685 100
136
+ |
137
+ | 0.6004 | 3.0 | 516 | 0.4744 | precision recall f1-score support
138
+
139
+ ALLERGY 1.0000 0.2500 0.4000 4
140
+ ASSESSMENT 0.0000 0.0000 0.0000 4
141
+ CC 0.2500 0.2500 0.2500 4
142
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
143
+ DISPOSITION 0.0000 0.0000 0.0000 2
144
+ EDCOURSE 0.0000 0.0000 0.0000 3
145
+ EXAM 0.0000 0.0000 0.0000 1
146
+ FAM/SOCHX 0.9130 0.9545 0.9333 22
147
+ GENHX 0.6552 0.9500 0.7755 20
148
+ GYNHX 0.0000 0.0000 0.0000 1
149
+ How are you feeling? 0.0000 0.0000 0.0000 0
150
+ I am going home with my son 0.0000 0.0000 0.0000 0
151
+ IMAGING 0.0000 0.0000 0.0000 1
152
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
153
+ INVATIONS 0.0000 0.0000 0.0000 0
154
+ LABS 0.0000 0.0000 0.0000 1
155
+ MEDICATIONS 0.5714 0.5714 0.5714 7
156
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
157
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
158
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
159
+ PLAN 0.0000 0.0000 0.0000 3
160
+ PROCEDURES 0.0000 0.0000 0.0000 1
161
+ ROS 1.0000 0.0909 0.1667 11
162
+
163
+ accuracy 0.5900 100
164
+ macro avg 0.2450 0.2203 0.2001 100
165
+ weighted avg 0.6137 0.5900 0.5405 100
166
+ |
167
+ | 0.6004 | 4.0 | 688 | 0.4568 | precision recall f1-score support
168
+
169
+ ALLERGY 0.5000 0.2500 0.3333 4
170
+ ASSESSMENT 0.0000 0.0000 0.0000 4
171
+ Afib 0.0000 0.0000 0.0000 0
172
+ CC 1.0000 0.2500 0.4000 4
173
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
174
+ DISPOSITION 0.0000 0.0000 0.0000 2
175
+ EDCOURSE 0.0000 0.0000 0.0000 3
176
+ EXAM 0.0000 0.0000 0.0000 1
177
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
178
+ GENHX 0.6129 0.9500 0.7451 20
179
+ GYNHX 0.0000 0.0000 0.0000 1
180
+ How are you feeling? 0.0000 0.0000 0.0000 0
181
+ I am going home with my son 0.0000 0.0000 0.0000 0
182
+ IMAGING 0.0000 0.0000 0.0000 1
183
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
184
+ LABS 0.0000 0.0000 0.0000 1
185
+ MEDICATIONS 0.6250 0.7143 0.6667 7
186
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
187
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
188
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
189
+ PLAN 0.0000 0.0000 0.0000 3
190
+ PROCEDURES 0.0000 0.0000 0.0000 1
191
+ ROS 1.0000 0.1818 0.3077 11
192
+
193
+ accuracy 0.6300 100
194
+ macro avg 0.2863 0.2759 0.2479 100
195
+ weighted avg 0.6275 0.6300 0.5739 100
196
+ |
197
+ | 0.6004 | 5.0 | 860 | 0.4503 | precision recall f1-score support
198
+
199
+ ALLERGY 1.0000 0.2500 0.4000 4
200
+ ASSESSMENT 0.0000 0.0000 0.0000 4
201
+ Afib 0.0000 0.0000 0.0000 0
202
+ CC 0.2222 0.5000 0.3077 4
203
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
204
+ DISPOSITION 0.0000 0.0000 0.0000 2
205
+ EDCOURSE 0.0000 0.0000 0.0000 3
206
+ EXAM 1.0000 1.0000 1.0000 1
207
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
208
+ GENHX 0.8261 0.9500 0.8837 20
209
+ GYNHX 0.0000 0.0000 0.0000 1
210
+ How are you feeling? 0.0000 0.0000 0.0000 0
211
+ I am going home with my son 0.0000 0.0000 0.0000 0
212
+ IMAGING 0.0000 0.0000 0.0000 1
213
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
214
+ LABS 0.0000 0.0000 0.0000 1
215
+ MEDICATIONS 0.6250 0.7143 0.6667 7
216
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
217
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
218
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
219
+ PLAN 0.0000 0.0000 0.0000 3
220
+ PROCEDURES 0.0000 0.0000 0.0000 1
221
+ ROS 0.6667 0.1818 0.2857 11
222
+ thoughts 0.0000 0.0000 0.0000 0
223
+
224
+ accuracy 0.6400 100
225
+ macro avg 0.2816 0.2748 0.2578 100
226
+ weighted avg 0.6302 0.6400 0.6039 100
227
+ |
228
+ | 0.1554 | 6.0 | 1032 | 0.4714 | precision recall f1-score support
229
+
230
+ ALLERGY 1.0000 0.2500 0.4000 4
231
+ ASSESSMENT 0.0000 0.0000 0.0000 4
232
+ CC 0.0000 0.0000 0.0000 4
233
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
234
+ DISPOSITION 0.0000 0.0000 0.0000 2
235
+ EDCOURSE 0.0000 0.0000 0.0000 3
236
+ EXAM 0.0000 0.0000 0.0000 1
237
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
238
+ GENHX 0.5758 0.9500 0.7170 20
239
+ GYNHX 0.0000 0.0000 0.0000 1
240
+ How are you feeling? 0.0000 0.0000 0.0000 0
241
+ IMAGING 0.0000 0.0000 0.0000 1
242
+ IMMUNIZATIONS 0.3333 1.0000 0.5000 1
243
+ LABS 0.0000 0.0000 0.0000 1
244
+ MEDICATIONS 0.6250 0.7143 0.6667 7
245
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
246
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
247
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
248
+ PLAN 0.0000 0.0000 0.0000 3
249
+ PROCEDURES 0.0000 0.0000 0.0000 1
250
+ ROS 1.0000 0.1818 0.3077 11
251
+
252
+ accuracy 0.6200 100
253
+ macro avg 0.2735 0.2903 0.2401 100
254
+ weighted avg 0.5929 0.6200 0.5479 100
255
+ |
256
+ | 0.1554 | 7.0 | 1204 | 0.4865 | precision recall f1-score support
257
+
258
+ ALLERGY 1.0000 0.2500 0.4000 4
259
+ ASSESSMENT 0.0000 0.0000 0.0000 4
260
+ CC 1.0000 0.5000 0.6667 4
261
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
262
+ DISPOSITION 0.0000 0.0000 0.0000 2
263
+ EDCOURSE 0.0000 0.0000 0.0000 3
264
+ EXAM 1.0000 1.0000 1.0000 1
265
+ FAM/SOCHX 0.8696 0.9091 0.8889 22
266
+ GENHX 0.6333 0.9500 0.7600 20
267
+ GYNHX 0.0000 0.0000 0.0000 1
268
+ IMAGING 0.0000 0.0000 0.0000 1
269
+ IMMUNIZATIONS 0.5000 1.0000 0.6667 1
270
+ LABS 0.0000 0.0000 0.0000 1
271
+ MEDICATIONS 0.6250 0.7143 0.6667 7
272
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
273
+ PASTMEDICALHX 0.3636 1.0000 0.5333 4
274
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
275
+ PLAN 0.0000 0.0000 0.0000 3
276
+ PROCEDURES 0.0000 0.0000 0.0000 1
277
+ ROS 1.0000 0.1818 0.3077 11
278
+
279
+ accuracy 0.6300 100
280
+ macro avg 0.3940 0.3753 0.3416 100
281
+ weighted avg 0.6524 0.6300 0.5840 100
282
+ |
283
+ | 0.1554 | 8.0 | 1376 | 0.4980 | precision recall f1-score support
284
+
285
+ ALLERGY 1.0000 0.2500 0.4000 4
286
+ ASSESSMENT 0.0000 0.0000 0.0000 4
287
+ CC 0.6667 0.5000 0.5714 4
288
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
289
+ DISPOSITION 0.0000 0.0000 0.0000 2
290
+ EDCOURSE 0.0000 0.0000 0.0000 3
291
+ EXAM 0.0000 0.0000 0.0000 1
292
+ FAM/SOCHX 0.8800 1.0000 0.9362 22
293
+ GENHX 0.5938 0.9500 0.7308 20
294
+ GYNHX 0.0000 0.0000 0.0000 1
295
+ IMAGING 0.0000 0.0000 0.0000 1
296
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
297
+ LABS 0.0000 0.0000 0.0000 1
298
+ MEDICATIONS 0.6250 0.7143 0.6667 7
299
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
300
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
301
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
302
+ PLAN 0.0000 0.0000 0.0000 3
303
+ PROCEDURES 0.0000 0.0000 0.0000 1
304
+ ROS 0.6667 0.1818 0.2857 11
305
+
306
+ accuracy 0.6300 100
307
+ macro avg 0.2946 0.2798 0.2630 100
308
+ weighted avg 0.5901 0.6300 0.5734 100
309
+ |
310
+ | 0.0947 | 9.0 | 1548 | 0.5413 | precision recall f1-score support
311
+
312
+ ALLERGY 1.0000 0.2500 0.4000 4
313
+ ASSESSMENT 0.0000 0.0000 0.0000 4
314
+ CC 0.4000 0.5000 0.4444 4
315
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
316
+ DISPOSITION 0.0000 0.0000 0.0000 2
317
+ EDCOURSE 0.0000 0.0000 0.0000 3
318
+ EXAM 0.0000 0.0000 0.0000 1
319
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
320
+ GENHX 0.6552 0.9500 0.7755 20
321
+ GYNHX 0.0000 0.0000 0.0000 1
322
+ IMAGING 0.0000 0.0000 0.0000 1
323
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
324
+ LABS 0.0000 0.0000 0.0000 1
325
+ MEDICATIONS 0.6250 0.7143 0.6667 7
326
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
327
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
328
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
329
+ PLAN 0.0000 0.0000 0.0000 3
330
+ PROCEDURES 0.0000 0.0000 0.0000 1
331
+ ROS 1.0000 0.1818 0.3077 11
332
+
333
+ accuracy 0.6300 100
334
+ macro avg 0.3013 0.2798 0.2589 100
335
+ weighted avg 0.6269 0.6300 0.5777 100
336
+ |
337
+ | 0.0947 | 10.0 | 1720 | 0.5247 | precision recall f1-score support
338
+
339
+ ALLERGY 1.0000 0.2500 0.4000 4
340
+ ASSESSMENT 0.0000 0.0000 0.0000 4
341
+ CC 0.4286 0.7500 0.5455 4
342
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
343
+ DISPOSITION 0.0000 0.0000 0.0000 2
344
+ EDCOURSE 0.0000 0.0000 0.0000 3
345
+ EXAM 1.0000 1.0000 1.0000 1
346
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
347
+ GENHX 0.7308 0.9500 0.8261 20
348
+ GYNHX 0.0000 0.0000 0.0000 1
349
+ IMAGING 0.0000 0.0000 0.0000 1
350
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
351
+ LABS 0.0000 0.0000 0.0000 1
352
+ MEDICATIONS 0.6250 0.7143 0.6667 7
353
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
354
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
355
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
356
+ PLAN 0.0000 0.0000 0.0000 3
357
+ PROCEDURES 0.0000 0.0000 0.0000 1
358
+ ROS 0.6667 0.1818 0.2857 11
359
+ thoughts 0.0000 0.0000 0.0000 0
360
+
361
+ accuracy 0.6400 100
362
+ macro avg 0.3186 0.3238 0.2947 100
363
+ weighted avg 0.6112 0.6400 0.5906 100
364
+ |
365
+ | 0.0947 | 11.0 | 1892 | 0.5280 | precision recall f1-score support
366
+
367
+ ALLERGY 0.6667 0.5000 0.5714 4
368
+ ASSESSMENT 0.0000 0.0000 0.0000 4
369
+ CC 0.4000 0.5000 0.4444 4
370
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
371
+ DISPOSITION 0.0000 0.0000 0.0000 2
372
+ EDCOURSE 0.0000 0.0000 0.0000 3
373
+ EXAM 1.0000 1.0000 1.0000 1
374
+ FAM/SOCHX 0.9167 1.0000 0.9565 22
375
+ GENHX 0.5758 0.9500 0.7170 20
376
+ GYNHX 0.0000 0.0000 0.0000 1
377
+ IMAGING 0.0000 0.0000 0.0000 1
378
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
379
+ LABS 0.0000 0.0000 0.0000 1
380
+ MEDICATIONS 0.7143 0.7143 0.7143 7
381
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
382
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
383
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
384
+ PLAN 0.0000 0.0000 0.0000 3
385
+ PROCEDURES 0.0000 0.0000 0.0000 1
386
+ ROS 0.6667 0.1818 0.2857 11
387
+
388
+ accuracy 0.6500 100
389
+ macro avg 0.3256 0.3423 0.3208 100
390
+ weighted avg 0.5957 0.6500 0.5950 100
391
+ |
392
+ | 0.0587 | 12.0 | 2064 | 0.5994 | precision recall f1-score support
393
+
394
+ ALLERGY 1.0000 0.5000 0.6667 4
395
+ ASSESSMENT 0.0000 0.0000 0.0000 4
396
+ CC 0.5714 1.0000 0.7273 4
397
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
398
+ DISPOSITION 0.0000 0.0000 0.0000 2
399
+ EDCOURSE 0.0000 0.0000 0.0000 3
400
+ EXAM 1.0000 1.0000 1.0000 1
401
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
402
+ GENHX 0.6667 1.0000 0.8000 20
403
+ GYNHX 0.0000 0.0000 0.0000 1
404
+ IMAGING 0.0000 0.0000 0.0000 1
405
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
406
+ LABS 0.0000 0.0000 0.0000 1
407
+ MEDICATIONS 0.7143 0.7143 0.7143 7
408
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
409
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
410
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
411
+ PLAN 0.0000 0.0000 0.0000 3
412
+ PROCEDURES 0.0000 0.0000 0.0000 1
413
+ ROS 1.0000 0.1818 0.3077 11
414
+ thoughts 0.0000 0.0000 0.0000 0
415
+
416
+ accuracy 0.6800 100
417
+ macro avg 0.3475 0.3522 0.3238 100
418
+ weighted avg 0.6523 0.6800 0.6179 100
419
+ |
420
+ | 0.0587 | 13.0 | 2236 | 0.5773 | precision recall f1-score support
421
+
422
+ ALLERGY 1.0000 0.2500 0.4000 4
423
+ ASSESSMENT 0.0000 0.0000 0.0000 4
424
+ CC 0.5000 1.0000 0.6667 4
425
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
426
+ DISPOSITION 0.0000 0.0000 0.0000 2
427
+ EDCOURSE 0.0000 0.0000 0.0000 3
428
+ EXAM 1.0000 1.0000 1.0000 1
429
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
430
+ GENHX 0.6786 0.9500 0.7917 20
431
+ GYNHX 0.0000 0.0000 0.0000 1
432
+ IMAGING 0.0000 0.0000 0.0000 1
433
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
434
+ LABS 0.0000 0.0000 0.0000 1
435
+ MEDICATIONS 0.6250 0.7143 0.6667 7
436
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
437
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
438
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
439
+ PLAN 0.0000 0.0000 0.0000 3
440
+ PROCEDURES 0.0000 0.0000 0.0000 1
441
+ ROS 1.0000 0.1818 0.3077 11
442
+ thoughts 0.0000 0.0000 0.0000 0
443
+
444
+ accuracy 0.6600 100
445
+ macro avg 0.3439 0.3379 0.3084 100
446
+ weighted avg 0.6485 0.6600 0.6023 100
447
+ |
448
+ | 0.0587 | 14.0 | 2408 | 0.6098 | precision recall f1-score support
449
+
450
+ ALLERGY 1.0000 0.2500 0.4000 4
451
+ ASSESSMENT 0.0000 0.0000 0.0000 4
452
+ CC 0.4000 1.0000 0.5714 4
453
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
454
+ DISPOSITION 0.0000 0.0000 0.0000 2
455
+ EDCOURSE 0.0000 0.0000 0.0000 3
456
+ EXAM 1.0000 1.0000 1.0000 1
457
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
458
+ GENHX 0.6429 0.9000 0.7500 20
459
+ GYNHX 0.0000 0.0000 0.0000 1
460
+ IMAGING 0.0000 0.0000 0.0000 1
461
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
462
+ LABS 0.0000 0.0000 0.0000 1
463
+ MEDICATIONS 0.6250 0.7143 0.6667 7
464
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
465
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
466
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
467
+ PLAN 0.0000 0.0000 0.0000 3
468
+ PROCEDURES 0.0000 0.0000 0.0000 1
469
+ ROS 1.0000 0.1818 0.3077 11
470
+
471
+ accuracy 0.6400 100
472
+ macro avg 0.3504 0.3500 0.3128 100
473
+ weighted avg 0.6331 0.6400 0.5826 100
474
+ |
475
+ | 0.0418 | 15.0 | 2580 | 0.6052 | precision recall f1-score support
476
+
477
+ ALLERGY 1.0000 0.2500 0.4000 4
478
+ ASSESSMENT 0.0000 0.0000 0.0000 4
479
+ CC 0.3636 1.0000 0.5333 4
480
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
481
+ DISPOSITION 0.0000 0.0000 0.0000 2
482
+ EDCOURSE 0.0000 0.0000 0.0000 3
483
+ EXAM 1.0000 1.0000 1.0000 1
484
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
485
+ GENHX 0.6923 0.9000 0.7826 20
486
+ GYNHX 0.0000 0.0000 0.0000 1
487
+ IMAGING 0.0000 0.0000 0.0000 1
488
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
489
+ LABS 0.0000 0.0000 0.0000 1
490
+ MEDICATIONS 0.6250 0.7143 0.6667 7
491
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
492
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
493
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
494
+ PLAN 0.0000 0.0000 0.0000 3
495
+ PROCEDURES 0.0000 0.0000 0.0000 1
496
+ ROS 1.0000 0.1818 0.3077 11
497
+
498
+ accuracy 0.6500 100
499
+ macro avg 0.3534 0.3523 0.3158 100
500
+ weighted avg 0.6389 0.6500 0.5910 100
501
+ |
502
+ | 0.0418 | 16.0 | 2752 | 0.5896 | precision recall f1-score support
503
+
504
+ ALLERGY 1.0000 0.2500 0.4000 4
505
+ ASSESSMENT 0.0000 0.0000 0.0000 4
506
+ CC 0.2727 0.7500 0.4000 4
507
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
508
+ DISPOSITION 0.0000 0.0000 0.0000 2
509
+ EDCOURSE 0.0000 0.0000 0.0000 3
510
+ EXAM 1.0000 1.0000 1.0000 1
511
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
512
+ GENHX 0.6923 0.9000 0.7826 20
513
+ GYNHX 0.0000 0.0000 0.0000 1
514
+ IMAGING 0.0000 0.0000 0.0000 1
515
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
516
+ LABS 0.0000 0.0000 0.0000 1
517
+ MEDICATIONS 0.6250 0.7143 0.6667 7
518
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
519
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
520
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
521
+ PLAN 0.0000 0.0000 0.0000 3
522
+ PROCEDURES 0.0000 0.0000 0.0000 1
523
+ ROS 0.6667 0.1818 0.2857 11
524
+
525
+ accuracy 0.6300 100
526
+ macro avg 0.3298 0.3375 0.3048 100
527
+ weighted avg 0.6013 0.6300 0.5799 100
528
+ |
529
+ | 0.0418 | 17.0 | 2924 | 0.6175 | precision recall f1-score support
530
+
531
+ ALLERGY 1.0000 0.5000 0.6667 4
532
+ ASSESSMENT 0.0000 0.0000 0.0000 4
533
+ CC 0.3750 0.7500 0.5000 4
534
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
535
+ DISPOSITION 0.0000 0.0000 0.0000 2
536
+ EDCOURSE 0.0000 0.0000 0.0000 3
537
+ EXAM 1.0000 1.0000 1.0000 1
538
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
539
+ GENHX 0.6552 0.9500 0.7755 20
540
+ GYNHX 0.0000 0.0000 0.0000 1
541
+ IMAGING 0.0000 0.0000 0.0000 1
542
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
543
+ LABS 0.0000 0.0000 0.0000 1
544
+ MEDICATIONS 0.7143 0.7143 0.7143 7
545
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
546
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
547
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
548
+ PLAN 0.0000 0.0000 0.0000 3
549
+ PROCEDURES 0.0000 0.0000 0.0000 1
550
+ ROS 0.6667 0.1818 0.2857 11
551
+
552
+ accuracy 0.6500 100
553
+ macro avg 0.3376 0.3525 0.3251 100
554
+ weighted avg 0.6042 0.6500 0.5965 100
555
+ |
556
+ | 0.0289 | 18.0 | 3096 | 0.6305 | precision recall f1-score support
557
+
558
+ ALLERGY 1.0000 0.5000 0.6667 4
559
+ ASSESSMENT 0.0000 0.0000 0.0000 4
560
+ CC 0.3636 1.0000 0.5333 4
561
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
562
+ DISPOSITION 0.0000 0.0000 0.0000 2
563
+ EDCOURSE 0.0000 0.0000 0.0000 3
564
+ EXAM 1.0000 1.0000 1.0000 1
565
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
566
+ GENHX 0.6923 0.9000 0.7826 20
567
+ GYNHX 0.0000 0.0000 0.0000 1
568
+ IMAGING 0.0000 0.0000 0.0000 1
569
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
570
+ LABS 0.0000 0.0000 0.0000 1
571
+ MEDICATIONS 0.7143 0.7143 0.7143 7
572
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
573
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
574
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
575
+ PLAN 0.0000 0.0000 0.0000 3
576
+ PROCEDURES 0.0000 0.0000 0.0000 1
577
+ ROS 1.0000 0.1818 0.3077 11
578
+
579
+ accuracy 0.6600 100
580
+ macro avg 0.3578 0.3648 0.3315 100
581
+ weighted avg 0.6451 0.6600 0.6050 100
582
+ |
583
+ | 0.0289 | 19.0 | 3268 | 0.6326 | precision recall f1-score support
584
+
585
+ ALLERGY 1.0000 0.5000 0.6667 4
586
+ ASSESSMENT 0.0000 0.0000 0.0000 4
587
+ CC 0.3000 0.7500 0.4286 4
588
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
589
+ DISPOSITION 0.0000 0.0000 0.0000 2
590
+ EDCOURSE 0.0000 0.0000 0.0000 3
591
+ EXAM 1.0000 1.0000 1.0000 1
592
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
593
+ GENHX 0.6923 0.9000 0.7826 20
594
+ GYNHX 0.0000 0.0000 0.0000 1
595
+ IMAGING 0.0000 0.0000 0.0000 1
596
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
597
+ LABS 0.0000 0.0000 0.0000 1
598
+ MEDICATIONS 0.7143 0.7143 0.7143 7
599
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
600
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
601
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
602
+ PLAN 0.0000 0.0000 0.0000 3
603
+ PROCEDURES 0.0000 0.0000 0.0000 1
604
+ ROS 0.6667 0.1818 0.2857 11
605
+
606
+ accuracy 0.6500 100
607
+ macro avg 0.3380 0.3523 0.3252 100
608
+ weighted avg 0.6059 0.6500 0.5984 100
609
+ |
610
+ | 0.0289 | 20.0 | 3440 | 0.6387 | precision recall f1-score support
611
+
612
+ ALLERGY 1.0000 0.5000 0.6667 4
613
+ ASSESSMENT 0.0000 0.0000 0.0000 4
614
+ CC 0.3000 0.7500 0.4286 4
615
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
616
+ DISPOSITION 0.0000 0.0000 0.0000 2
617
+ EDCOURSE 0.0000 0.0000 0.0000 3
618
+ EXAM 1.0000 1.0000 1.0000 1
619
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
620
+ GENHX 0.6923 0.9000 0.7826 20
621
+ GYNHX 0.0000 0.0000 0.0000 1
622
+ IMAGING 0.0000 0.0000 0.0000 1
623
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
624
+ LABS 0.0000 0.0000 0.0000 1
625
+ MEDICATIONS 0.7143 0.7143 0.7143 7
626
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
627
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
628
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
629
+ PLAN 0.0000 0.0000 0.0000 3
630
+ PROCEDURES 0.0000 0.0000 0.0000 1
631
+ ROS 0.6667 0.1818 0.2857 11
632
+
633
+ accuracy 0.6500 100
634
+ macro avg 0.3380 0.3523 0.3252 100
635
+ weighted avg 0.6059 0.6500 0.5984 100
636
+ |
637
+
638
+
639
+ ### Framework versions
640
+
641
+ - Transformers 4.38.2
642
+ - Pytorch 2.1.0+cu121
643
+ - Datasets 2.18.0
644
+ - Tokenizers 0.15.2
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.38.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b82448ed96d8ebd286f4060d2b69c36b8819ed5b622a2b6ffc3feb78866c03cf
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89e335d3678ad6e7edfa42ac8f6c12be449f6fa672fe44f90277f4d43c097f0c
3
  size 307867048
runs/Mar10_21-16-11_94b845ad4781/events.out.tfevents.1710105375.94b845ad4781.1445.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c4297873619f523d25aa6c55bdb82c6e5204053d96e119ac2b820269c20d8c4
3
- size 11549
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70d10c6be5a99eace912e7ce4c89a87ecfafccdf0b82b18f9e985e9ab9fba072
3
+ size 12716