Hugging Face's logo

veronica-girolimetti
/
t5-dialogue-classification-2

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
veronica-girolimetti commited on
Commit
c0ad5a1
•
1 Parent(s): a4b10d1

End of training

Browse files
Files changed (4) hide show
  1. README.md +627 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Jan10_22-23-42_cc5a0990e75c/events.out.tfevents.1704925436.cc5a0990e75c.1451.0 +2 -2
README.md ADDED
@@ -0,0 +1,627 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: t5-dialogue-classification-2
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # t5-dialogue-classification-2
15
+
16
+ This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.4154
19
+ - Classification Report: precision recall f1-score support
20
+
21
+ ALLERGY 1.0000 0.9167 0.9565 12
22
+ ASSESSMENT 0.3333 0.1818 0.2353 11
23
+ CC 0.5455 0.5455 0.5455 11
24
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
25
+ DISPOSITION 1.0000 1.0000 1.0000 1
26
+ EDCOURSE 0.0000 0.0000 0.0000 4
27
+ EXAM 0.3333 0.2000 0.2500 5
28
+ FAM/SOCHX 0.8462 0.9778 0.9072 45
29
+ GENHX 0.8491 0.8491 0.8491 53
30
+ GYNHX 0.0000 0.0000 0.0000 1
31
+ IMAGING 0.0000 0.0000 0.0000 1
32
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
33
+ LABS 0.0000 0.0000 0.0000 1
34
+ MEDICATIONS 0.8333 1.0000 0.9091 10
35
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
36
+ PASTMEDICALHX 0.4167 0.7143 0.5263 14
37
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
38
+ PLAN 0.0000 0.0000 0.0000 1
39
+ PROCEDURES 0.0000 0.0000 0.0000 1
40
+ ROS 0.8333 0.5882 0.6897 17
41
+
42
+ accuracy 0.7300 200
43
+ macro avg 0.3924 0.3915 0.3863 200
44
+ weighted avg 0.7087 0.7300 0.7116 200
45
+
46
+
47
+ ## Model description
48
+
49
+ More information needed
50
+
51
+ ## Intended uses & limitations
52
+
53
+ More information needed
54
+
55
+ ## Training and evaluation data
56
+
57
+ More information needed
58
+
59
+ ## Training procedure
60
+
61
+ ### Training hyperparameters
62
+
63
+ The following hyperparameters were used during training:
64
+ - learning_rate: 0.0001
65
+ - train_batch_size: 7
66
+ - eval_batch_size: 7
67
+ - seed: 42
68
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
69
+ - lr_scheduler_type: linear
70
+ - num_epochs: 20
71
+
72
+ ### Training results
73
+
74
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
75
+ |:-------------:|:-----:|:----:|:---------------:|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
76
+ | No log | 1.0 | 186 | 0.4012 | precision recall f1-score support
77
+
78
+ ALLERGY 0.9167 0.9167 0.9167 12
79
+ ASSESSMENT 0.0000 0.0000 0.0000 11
80
+ CC 0.0000 0.0000 0.0000 11
81
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
82
+ DISPOSITION 0.0000 0.0000 0.0000 1
83
+ EDCOURSE 0.0000 0.0000 0.0000 4
84
+ EXAM 0.0000 0.0000 0.0000 5
85
+ FAM/SOCHX 0.7097 0.9778 0.8224 45
86
+ GENHX 0.6267 0.8868 0.7344 53
87
+ GYNHX 0.0000 0.0000 0.0000 1
88
+ IMAGING 0.0000 0.0000 0.0000 1
89
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
90
+ LABS 0.0000 0.0000 0.0000 1
91
+ MEDICATIONS 0.8182 0.9000 0.8571 10
92
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
93
+ PASTMEDICALHX 0.3750 0.4286 0.4000 14
94
+ PASTSURGICAL 0.3889 1.0000 0.5600 7
95
+ PLAN 0.0000 0.0000 0.0000 1
96
+ PROCEDURES 0.0000 0.0000 0.0000 1
97
+ ROS 0.8333 0.2941 0.4348 17
98
+
99
+ accuracy 0.6450 200
100
+ macro avg 0.2334 0.2702 0.2363 200
101
+ weighted avg 0.5323 0.6450 0.5621 200
102
+ |
103
+ | No log | 2.0 | 372 | 0.2953 | precision recall f1-score support
104
+
105
+ ALLERGY 1.0000 0.9167 0.9565 12
106
+ ASSESSMENT 0.0000 0.0000 0.0000 11
107
+ CC 0.3333 0.2727 0.3000 11
108
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
109
+ DISPOSITION 0.0000 0.0000 0.0000 1
110
+ EDCOURSE 0.0000 0.0000 0.0000 4
111
+ EXAM 0.0000 0.0000 0.0000 5
112
+ FAM/SOCHX 0.8113 0.9556 0.8776 45
113
+ GENHX 0.6111 0.8302 0.7040 53
114
+ GYNHX 0.0000 0.0000 0.0000 1
115
+ IMAGING 0.0000 0.0000 0.0000 1
116
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
117
+ LABS 0.0000 0.0000 0.0000 1
118
+ MEDICATIONS 0.8182 0.9000 0.8571 10
119
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
120
+ PASTMEDICALHX 0.3929 0.7857 0.5238 14
121
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
122
+ PLAN 0.0000 0.0000 0.0000 1
123
+ PROCEDURES 0.0000 0.0000 0.0000 1
124
+ ROS 0.6250 0.2941 0.4000 17
125
+
126
+ accuracy 0.6600 200
127
+ macro avg 0.2796 0.2906 0.2771 200
128
+ weighted avg 0.5794 0.6600 0.6037 200
129
+ |
130
+ | 0.6246 | 3.0 | 558 | 0.2934 | precision recall f1-score support
131
+
132
+ ALLERGY 1.0000 0.9167 0.9565 12
133
+ ASSESSMENT 0.0000 0.0000 0.0000 11
134
+ CC 0.2857 0.3636 0.3200 11
135
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
136
+ DISPOSITION 0.0000 0.0000 0.0000 1
137
+ EDCOURSE 0.0000 0.0000 0.0000 4
138
+ EXAM 0.3333 0.2000 0.2500 5
139
+ FAM/SOCHX 0.8302 0.9778 0.8980 45
140
+ GENHX 0.6716 0.8491 0.7500 53
141
+ GYNHX 0.0000 0.0000 0.0000 1
142
+ IMAGING 0.0000 0.0000 0.0000 1
143
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
144
+ LABS 0.0000 0.0000 0.0000 1
145
+ MEDICATIONS 0.8333 1.0000 0.9091 10
146
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
147
+ PASTMEDICALHX 0.5294 0.6429 0.5806 14
148
+ PASTSURGICAL 0.7000 1.0000 0.8235 7
149
+ PLAN 0.0000 0.0000 0.0000 1
150
+ PROCEDURES 0.0000 0.0000 0.0000 1
151
+ ROS 0.8333 0.5882 0.6897 17
152
+
153
+ accuracy 0.7050 200
154
+ macro avg 0.3008 0.3269 0.3089 200
155
+ weighted avg 0.6229 0.7050 0.6556 200
156
+ |
157
+ | 0.6246 | 4.0 | 744 | 0.2946 | precision recall f1-score support
158
+
159
+ ALLERGY 1.0000 0.9167 0.9565 12
160
+ ASSESSMENT 0.2000 0.0909 0.1250 11
161
+ CC 0.2857 0.5455 0.3750 11
162
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
163
+ DISPOSITION 0.0000 0.0000 0.0000 1
164
+ EDCOURSE 0.0000 0.0000 0.0000 4
165
+ EXAM 0.6667 0.4000 0.5000 5
166
+ FAM/SOCHX 0.8431 0.9556 0.8958 45
167
+ GENHX 0.8462 0.8302 0.8381 53
168
+ GYNHX 0.0000 0.0000 0.0000 1
169
+ IMAGING 0.0000 0.0000 0.0000 1
170
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
171
+ LABS 0.0000 0.0000 0.0000 1
172
+ MEDICATIONS 0.7692 1.0000 0.8696 10
173
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
174
+ PASTMEDICALHX 0.5000 0.7143 0.5882 14
175
+ PASTSURGICAL 0.8750 1.0000 0.9333 7
176
+ PLAN 0.0000 0.0000 0.0000 1
177
+ PROCEDURES 0.0000 0.0000 0.0000 1
178
+ ROS 0.7500 0.5294 0.6207 17
179
+
180
+ accuracy 0.7150 200
181
+ macro avg 0.3368 0.3491 0.3351 200
182
+ weighted avg 0.6852 0.7150 0.6911 200
183
+ |
184
+ | 0.6246 | 5.0 | 930 | 0.2906 | precision recall f1-score support
185
+
186
+ ALLERGY 1.0000 0.9167 0.9565 12
187
+ ASSESSMENT 0.2000 0.0909 0.1250 11
188
+ CC 0.5000 0.3636 0.4211 11
189
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
190
+ DISPOSITION 0.0000 0.0000 0.0000 1
191
+ EDCOURSE 0.5000 0.2500 0.3333 4
192
+ EXAM 0.6000 0.6000 0.6000 5
193
+ FAM/SOCHX 0.8800 0.9778 0.9263 45
194
+ GENHX 0.6818 0.8491 0.7563 53
195
+ GYNHX 0.0000 0.0000 0.0000 1
196
+ IMAGING 0.0000 0.0000 0.0000 1
197
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
198
+ LABS 0.0000 0.0000 0.0000 1
199
+ MEDICATIONS 0.8333 1.0000 0.9091 10
200
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
201
+ PASTMEDICALHX 0.5000 0.6429 0.5625 14
202
+ PASTSURGICAL 0.7778 1.0000 0.8750 7
203
+ PLAN 0.0000 0.0000 0.0000 1
204
+ PROCEDURES 0.0000 0.0000 0.0000 1
205
+ ROS 0.7500 0.5294 0.6207 17
206
+
207
+ accuracy 0.7200 200
208
+ macro avg 0.3611 0.3610 0.3543 200
209
+ weighted avg 0.6698 0.7200 0.6861 200
210
+ |
211
+ | 0.1677 | 6.0 | 1116 | 0.2852 | precision recall f1-score support
212
+
213
+ ALLERGY 1.0000 0.9167 0.9565 12
214
+ ASSESSMENT 0.1667 0.0909 0.1176 11
215
+ CC 0.4444 0.3636 0.4000 11
216
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
217
+ DISPOSITION 0.0000 0.0000 0.0000 1
218
+ EDCOURSE 0.0000 0.0000 0.0000 4
219
+ EXAM 0.2500 0.4000 0.3077 5
220
+ FAM/SOCHX 0.8627 0.9778 0.9167 45
221
+ GENHX 0.7857 0.8302 0.8073 53
222
+ GYNHX 0.0000 0.0000 0.0000 1
223
+ IMAGING 0.0000 0.0000 0.0000 1
224
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
225
+ LABS 0.0000 0.0000 0.0000 1
226
+ MEDICATIONS 0.8333 1.0000 0.9091 10
227
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
228
+ PASTMEDICALHX 0.5000 0.7143 0.5882 14
229
+ PASTSURGICAL 0.7000 1.0000 0.8235 7
230
+ PLAN 0.0000 0.0000 0.0000 1
231
+ PROCEDURES 0.0000 0.0000 0.0000 1
232
+ ROS 0.7692 0.5882 0.6667 17
233
+
234
+ accuracy 0.7150 200
235
+ macro avg 0.3156 0.3441 0.3247 200
236
+ weighted avg 0.6687 0.7150 0.6859 200
237
+ |
238
+ | 0.1677 | 7.0 | 1302 | 0.3229 | precision recall f1-score support
239
+
240
+ ALLERGY 1.0000 0.9167 0.9565 12
241
+ ASSESSMENT 0.3333 0.1818 0.2353 11
242
+ CC 0.5556 0.4545 0.5000 11
243
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
244
+ DISPOSITION 0.0000 0.0000 0.0000 1
245
+ EDCOURSE 0.0000 0.0000 0.0000 4
246
+ EXAM 0.2500 0.2000 0.2222 5
247
+ FAM/SOCHX 0.8431 0.9556 0.8958 45
248
+ GENHX 0.7963 0.8113 0.8037 53
249
+ GYNHX 0.0000 0.0000 0.0000 1
250
+ IMAGING 0.0000 0.0000 0.0000 1
251
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
252
+ LABS 0.0000 0.0000 0.0000 1
253
+ MEDICATIONS 0.7692 1.0000 0.8696 10
254
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
255
+ PASTMEDICALHX 0.4138 0.8571 0.5581 14
256
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
257
+ PLAN 0.0000 0.0000 0.0000 1
258
+ PROCEDURES 0.0000 0.0000 0.0000 1
259
+ ROS 0.7692 0.5882 0.6667 17
260
+
261
+ accuracy 0.7150 200
262
+ macro avg 0.3365 0.3411 0.3316 200
263
+ weighted avg 0.6837 0.7150 0.6895 200
264
+ |
265
+ | 0.1677 | 8.0 | 1488 | 0.3119 | precision recall f1-score support
266
+
267
+ ALLERGY 0.9167 0.9167 0.9167 12
268
+ ASSESSMENT 0.2500 0.0909 0.1333 11
269
+ CC 0.3750 0.5455 0.4444 11
270
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
271
+ DISPOSITION 0.0000 0.0000 0.0000 1
272
+ EDCOURSE 0.0000 0.0000 0.0000 4
273
+ EXAM 0.2500 0.2000 0.2222 5
274
+ FAM/SOCHX 0.8600 0.9556 0.9053 45
275
+ GENHX 0.7963 0.8113 0.8037 53
276
+ GYNHX 0.0000 0.0000 0.0000 1
277
+ IMAGING 0.0000 0.0000 0.0000 1
278
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
279
+ LABS 0.0000 0.0000 0.0000 1
280
+ MEDICATIONS 0.8333 1.0000 0.9091 10
281
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
282
+ PASTMEDICALHX 0.4583 0.7857 0.5789 14
283
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
284
+ PLAN 0.0000 0.0000 0.0000 1
285
+ PROCEDURES 0.0000 0.0000 0.0000 1
286
+ ROS 0.7692 0.5882 0.6667 17
287
+ Restrained 0.0000 0.0000 0.0000 0
288
+
289
+ accuracy 0.7100 200
290
+ macro avg 0.3099 0.3215 0.3097 200
291
+ weighted avg 0.6743 0.7100 0.6840 200
292
+ |
293
+ | 0.1144 | 9.0 | 1674 | 0.2959 | precision recall f1-score support
294
+
295
+ ALLERGY 0.9167 0.9167 0.9167 12
296
+ ASSESSMENT 0.3333 0.1818 0.2353 11
297
+ CC 0.3333 0.5455 0.4138 11
298
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
299
+ DISPOSITION 0.0000 0.0000 0.0000 1
300
+ EDCOURSE 0.0000 0.0000 0.0000 4
301
+ EXAM 0.4000 0.4000 0.4000 5
302
+ FAM/SOCHX 0.8776 0.9556 0.9149 45
303
+ GENHX 0.7857 0.8302 0.8073 53
304
+ GYNHX 0.0000 0.0000 0.0000 1
305
+ IMAGING 0.0000 0.0000 0.0000 1
306
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
307
+ LABS 0.0000 0.0000 0.0000 1
308
+ MEDICATIONS 0.8333 1.0000 0.9091 10
309
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
310
+ PASTMEDICALHX 0.5556 0.7143 0.6250 14
311
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
312
+ PLAN 0.0000 0.0000 0.0000 1
313
+ PROCEDURES 0.0000 0.0000 0.0000 1
314
+ ROS 0.7692 0.5882 0.6667 17
315
+ Restrained 0.0000 0.0000 0.0000 0
316
+
317
+ accuracy 0.7200 200
318
+ macro avg 0.3172 0.3328 0.3212 200
319
+ weighted avg 0.6833 0.7200 0.6964 200
320
+ |
321
+ | 0.1144 | 10.0 | 1860 | 0.3363 | precision recall f1-score support
322
+
323
+ ALLERGY 1.0000 0.9167 0.9565 12
324
+ ASSESSMENT 0.2857 0.1818 0.2222 11
325
+ CC 0.5556 0.4545 0.5000 11
326
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
327
+ DISPOSITION 0.0000 0.0000 0.0000 1
328
+ EDCOURSE 1.0000 0.2500 0.4000 4
329
+ EXAM 0.4000 0.4000 0.4000 5
330
+ FAM/SOCHX 0.8627 0.9778 0.9167 45
331
+ GENHX 0.8269 0.8113 0.8190 53
332
+ GYNHX 0.0000 0.0000 0.0000 1
333
+ IMAGING 0.0000 0.0000 0.0000 1
334
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
335
+ LABS 0.0000 0.0000 0.0000 1
336
+ MEDICATIONS 0.8182 0.9000 0.8571 10
337
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
338
+ PASTMEDICALHX 0.4286 0.8571 0.5714 14
339
+ PASTSURGICAL 1.0000 0.8571 0.9231 7
340
+ PLAN 0.0000 0.0000 0.0000 1
341
+ PROCEDURES 0.0000 0.0000 0.0000 1
342
+ ROS 0.8333 0.5882 0.6897 17
343
+
344
+ accuracy 0.7250 200
345
+ macro avg 0.4006 0.3597 0.3628 200
346
+ weighted avg 0.7263 0.7250 0.7122 200
347
+ |
348
+ | 0.0772 | 11.0 | 2046 | 0.3538 | precision recall f1-score support
349
+
350
+ ALLERGY 1.0000 0.9167 0.9565 12
351
+ ASSESSMENT 0.2857 0.1818 0.2222 11
352
+ CC 0.3333 0.5455 0.4138 11
353
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
354
+ DISPOSITION 0.0000 0.0000 0.0000 1
355
+ EDCOURSE 0.0000 0.0000 0.0000 4
356
+ EXAM 0.4000 0.4000 0.4000 5
357
+ FAM/SOCHX 0.8627 0.9778 0.9167 45
358
+ GENHX 0.8400 0.7925 0.8155 53
359
+ GYNHX 0.0000 0.0000 0.0000 1
360
+ IMAGING 0.0000 0.0000 0.0000 1
361
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
362
+ LABS 0.0000 0.0000 0.0000 1
363
+ MEDICATIONS 0.8333 1.0000 0.9091 10
364
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
365
+ PASTMEDICALHX 0.4348 0.7143 0.5405 14
366
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
367
+ PLAN 0.0000 0.0000 0.0000 1
368
+ PROCEDURES 0.0000 0.0000 0.0000 1
369
+ ROS 0.8333 0.5882 0.6897 17
370
+
371
+ accuracy 0.7150 200
372
+ macro avg 0.3340 0.3487 0.3361 200
373
+ weighted avg 0.6937 0.7150 0.6967 200
374
+ |
375
+ | 0.0772 | 12.0 | 2232 | 0.3695 | precision recall f1-score support
376
+
377
+ ALLERGY 1.0000 0.9167 0.9565 12
378
+ ASSESSMENT 0.2500 0.1818 0.2105 11
379
+ CC 0.5455 0.5455 0.5455 11
380
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
381
+ DISPOSITION 1.0000 1.0000 1.0000 1
382
+ EDCOURSE 0.0000 0.0000 0.0000 4
383
+ EXAM 0.5000 0.4000 0.4444 5
384
+ FAM/SOCHX 0.8800 0.9778 0.9263 45
385
+ GENHX 0.8333 0.8491 0.8411 53
386
+ GYNHX 0.0000 0.0000 0.0000 1
387
+ IMAGING 0.0000 0.0000 0.0000 1
388
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
389
+ LABS 0.0000 0.0000 0.0000 1
390
+ MEDICATIONS 0.8333 1.0000 0.9091 10
391
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
392
+ PASTMEDICALHX 0.4545 0.7143 0.5556 14
393
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
394
+ PLAN 0.0000 0.0000 0.0000 1
395
+ PROCEDURES 0.0000 0.0000 0.0000 1
396
+ ROS 0.8333 0.5882 0.6897 17
397
+
398
+ accuracy 0.7350 200
399
+ macro avg 0.3994 0.4015 0.3968 200
400
+ weighted avg 0.7144 0.7350 0.7194 200
401
+ |
402
+ | 0.0772 | 13.0 | 2418 | 0.3666 | precision recall f1-score support
403
+
404
+ ALLERGY 1.0000 0.9167 0.9565 12
405
+ ASSESSMENT 0.1667 0.0909 0.1176 11
406
+ CC 0.4286 0.5455 0.4800 11
407
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
408
+ DISPOSITION 0.5000 1.0000 0.6667 1
409
+ EDCOURSE 0.5000 0.2500 0.3333 4
410
+ EXAM 0.4000 0.4000 0.4000 5
411
+ FAM/SOCHX 0.8627 0.9778 0.9167 45
412
+ GENHX 0.8431 0.8113 0.8269 53
413
+ GYNHX 0.0000 0.0000 0.0000 1
414
+ IMAGING 0.0000 0.0000 0.0000 1
415
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
416
+ LABS 0.0000 0.0000 0.0000 1
417
+ MEDICATIONS 0.8333 1.0000 0.9091 10
418
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
419
+ PASTMEDICALHX 0.5294 0.6429 0.5806 14
420
+ PASTSURGICAL 0.6000 0.8571 0.7059 7
421
+ PLAN 0.0000 0.0000 0.0000 1
422
+ PROCEDURES 0.0000 0.0000 0.0000 1
423
+ ROS 0.8462 0.6471 0.7333 17
424
+
425
+ accuracy 0.7250 200
426
+ macro avg 0.3755 0.4070 0.3813 200
427
+ weighted avg 0.7044 0.7250 0.7088 200
428
+ |
429
+ | 0.0486 | 14.0 | 2604 | 0.3836 | precision recall f1-score support
430
+
431
+ ALLERGY 1.0000 0.9167 0.9565 12
432
+ ASSESSMENT 0.2857 0.1818 0.2222 11
433
+ CC 0.5000 0.5455 0.5217 11
434
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
435
+ DISPOSITION 0.5000 1.0000 0.6667 1
436
+ EDCOURSE 0.0000 0.0000 0.0000 4
437
+ EXAM 0.5000 0.4000 0.4444 5
438
+ FAM/SOCHX 0.8800 0.9778 0.9263 45
439
+ GENHX 0.8333 0.8491 0.8411 53
440
+ GYNHX 0.0000 0.0000 0.0000 1
441
+ IMAGING 0.0000 0.0000 0.0000 1
442
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
443
+ LABS 0.0000 0.0000 0.0000 1
444
+ MEDICATIONS 0.8333 1.0000 0.9091 10
445
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
446
+ PASTMEDICALHX 0.5263 0.7143 0.6061 14
447
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
448
+ PLAN 0.0000 0.0000 0.0000 1
449
+ PROCEDURES 0.0000 0.0000 0.0000 1
450
+ ROS 0.8333 0.5882 0.6897 17
451
+ Restrained 0.0000 0.0000 0.0000 0
452
+
453
+ accuracy 0.7350 200
454
+ macro avg 0.3595 0.3824 0.3639 200
455
+ weighted avg 0.7164 0.7350 0.7206 200
456
+ |
457
+ | 0.0486 | 15.0 | 2790 | 0.3881 | precision recall f1-score support
458
+
459
+ ALLERGY 1.0000 0.9167 0.9565 12
460
+ ASSESSMENT 0.2222 0.1818 0.2000 11
461
+ CC 0.4615 0.5455 0.5000 11
462
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
463
+ DISPOSITION 1.0000 1.0000 1.0000 1
464
+ EDCOURSE 0.0000 0.0000 0.0000 4
465
+ EXAM 0.4000 0.4000 0.4000 5
466
+ FAM/SOCHX 0.8654 1.0000 0.9278 45
467
+ GENHX 0.8491 0.8491 0.8491 53
468
+ GYNHX 0.0000 0.0000 0.0000 1
469
+ IMAGING 0.0000 0.0000 0.0000 1
470
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
471
+ LABS 0.0000 0.0000 0.0000 1
472
+ MEDICATIONS 0.8333 1.0000 0.9091 10
473
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
474
+ PASTMEDICALHX 0.5882 0.7143 0.6452 14
475
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
476
+ PLAN 0.0000 0.0000 0.0000 1
477
+ PROCEDURES 0.0000 0.0000 0.0000 1
478
+ ROS 0.8333 0.5882 0.6897 17
479
+
480
+ accuracy 0.7400 200
481
+ macro avg 0.3955 0.4026 0.3967 200
482
+ weighted avg 0.7160 0.7400 0.7239 200
483
+ |
484
+ | 0.0486 | 16.0 | 2976 | 0.3948 | precision recall f1-score support
485
+
486
+ ALLERGY 1.0000 0.9167 0.9565 12
487
+ ASSESSMENT 0.2000 0.0909 0.1250 11
488
+ CC 0.6000 0.5455 0.5714 11
489
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
490
+ DISPOSITION 0.5000 1.0000 0.6667 1
491
+ EDCOURSE 0.0000 0.0000 0.0000 4
492
+ EXAM 0.5000 0.4000 0.4444 5
493
+ FAM/SOCHX 0.8654 1.0000 0.9278 45
494
+ GENHX 0.8333 0.8491 0.8411 53
495
+ GYNHX 0.0000 0.0000 0.0000 1
496
+ IMAGING 0.0000 0.0000 0.0000 1
497
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
498
+ LABS 0.0000 0.0000 0.0000 1
499
+ MEDICATIONS 0.8333 1.0000 0.9091 10
500
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
501
+ PASTMEDICALHX 0.5000 0.7143 0.5882 14
502
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
503
+ PLAN 0.0000 0.0000 0.0000 1
504
+ PROCEDURES 0.0000 0.0000 0.0000 1
505
+ ROS 0.7692 0.5882 0.6667 17
506
+
507
+ accuracy 0.7350 200
508
+ macro avg 0.3729 0.3981 0.3777 200
509
+ weighted avg 0.7066 0.7350 0.7151 200
510
+ |
511
+ | 0.0392 | 17.0 | 3162 | 0.4075 | precision recall f1-score support
512
+
513
+ ALLERGY 1.0000 0.9167 0.9565 12
514
+ ASSESSMENT 0.2000 0.0909 0.1250 11
515
+ CC 0.5455 0.5455 0.5455 11
516
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
517
+ DISPOSITION 0.5000 1.0000 0.6667 1
518
+ EDCOURSE 0.0000 0.0000 0.0000 4
519
+ EXAM 0.5000 0.4000 0.4444 5
520
+ FAM/SOCHX 0.8491 1.0000 0.9184 45
521
+ GENHX 0.8491 0.8491 0.8491 53
522
+ GYNHX 0.0000 0.0000 0.0000 1
523
+ IMAGING 0.0000 0.0000 0.0000 1
524
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
525
+ LABS 0.0000 0.0000 0.0000 1
526
+ MEDICATIONS 0.8333 1.0000 0.9091 10
527
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
528
+ PASTMEDICALHX 0.4762 0.7143 0.5714 14
529
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
530
+ PLAN 0.0000 0.0000 0.0000 1
531
+ PROCEDURES 0.0000 0.0000 0.0000 1
532
+ ROS 0.8333 0.5882 0.6897 17
533
+
534
+ accuracy 0.7350 200
535
+ macro avg 0.3722 0.3981 0.3766 200
536
+ weighted avg 0.7079 0.7350 0.7144 200
537
+ |
538
+ | 0.0392 | 18.0 | 3348 | 0.4103 | precision recall f1-score support
539
+
540
+ ALLERGY 1.0000 0.9167 0.9565 12
541
+ ASSESSMENT 0.3333 0.1818 0.2353 11
542
+ CC 0.5000 0.5455 0.5217 11
543
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
544
+ DISPOSITION 1.0000 1.0000 1.0000 1
545
+ EDCOURSE 0.0000 0.0000 0.0000 4
546
+ EXAM 0.3333 0.2000 0.2500 5
547
+ FAM/SOCHX 0.8462 0.9778 0.9072 45
548
+ GENHX 0.8491 0.8491 0.8491 53
549
+ GYNHX 0.0000 0.0000 0.0000 1
550
+ IMAGING 0.0000 0.0000 0.0000 1
551
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
552
+ LABS 0.0000 0.0000 0.0000 1
553
+ MEDICATIONS 0.8333 1.0000 0.9091 10
554
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
555
+ PASTMEDICALHX 0.4762 0.7143 0.5714 14
556
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
557
+ PLAN 0.0000 0.0000 0.0000 1
558
+ PROCEDURES 0.0000 0.0000 0.0000 1
559
+ ROS 0.7692 0.5882 0.6667 17
560
+
561
+ accuracy 0.7300 200
562
+ macro avg 0.3899 0.3915 0.3862 200
563
+ weighted avg 0.7049 0.7300 0.7115 200
564
+ |
565
+ | 0.0306 | 19.0 | 3534 | 0.4126 | precision recall f1-score support
566
+
567
+ ALLERGY 1.0000 0.9167 0.9565 12
568
+ ASSESSMENT 0.3333 0.1818 0.2353 11
569
+ CC 0.5455 0.5455 0.5455 11
570
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
571
+ DISPOSITION 1.0000 1.0000 1.0000 1
572
+ EDCOURSE 0.0000 0.0000 0.0000 4
573
+ EXAM 0.3333 0.2000 0.2500 5
574
+ FAM/SOCHX 0.8462 0.9778 0.9072 45
575
+ GENHX 0.8491 0.8491 0.8491 53
576
+ GYNHX 0.0000 0.0000 0.0000 1
577
+ IMAGING 0.0000 0.0000 0.0000 1
578
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
579
+ LABS 0.0000 0.0000 0.0000 1
580
+ MEDICATIONS 0.8333 1.0000 0.9091 10
581
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
582
+ PASTMEDICALHX 0.4348 0.7143 0.5405 14
583
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
584
+ PLAN 0.0000 0.0000 0.0000 1
585
+ PROCEDURES 0.0000 0.0000 0.0000 1
586
+ ROS 0.8333 0.5882 0.6897 17
587
+ Restrained 0.0000 0.0000 0.0000 0
588
+
589
+ accuracy 0.7300 200
590
+ macro avg 0.3746 0.3729 0.3686 200
591
+ weighted avg 0.7100 0.7300 0.7126 200
592
+ |
593
+ | 0.0306 | 20.0 | 3720 | 0.4154 | precision recall f1-score support
594
+
595
+ ALLERGY 1.0000 0.9167 0.9565 12
596
+ ASSESSMENT 0.3333 0.1818 0.2353 11
597
+ CC 0.5455 0.5455 0.5455 11
598
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
599
+ DISPOSITION 1.0000 1.0000 1.0000 1
600
+ EDCOURSE 0.0000 0.0000 0.0000 4
601
+ EXAM 0.3333 0.2000 0.2500 5
602
+ FAM/SOCHX 0.8462 0.9778 0.9072 45
603
+ GENHX 0.8491 0.8491 0.8491 53
604
+ GYNHX 0.0000 0.0000 0.0000 1
605
+ IMAGING 0.0000 0.0000 0.0000 1
606
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
607
+ LABS 0.0000 0.0000 0.0000 1
608
+ MEDICATIONS 0.8333 1.0000 0.9091 10
609
+ OTHER_HISTORY 0.0000 0.0000 0.0000 3
610
+ PASTMEDICALHX 0.4167 0.7143 0.5263 14
611
+ PASTSURGICAL 0.8571 0.8571 0.8571 7
612
+ PLAN 0.0000 0.0000 0.0000 1
613
+ PROCEDURES 0.0000 0.0000 0.0000 1
614
+ ROS 0.8333 0.5882 0.6897 17
615
+
616
+ accuracy 0.7300 200
617
+ macro avg 0.3924 0.3915 0.3863 200
618
+ weighted avg 0.7087 0.7300 0.7116 200
619
+ |
620
+
621
+
622
+ ### Framework versions
623
+
624
+ - Transformers 4.35.2
625
+ - Pytorch 2.1.0+cu121
626
+ - Datasets 2.16.1
627
+ - Tokenizers 0.15.0
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.35.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ce0013544b109505f7252d9f706ade2301c1a7356840ed609d51b569df973a4
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4751aecec728dda6ade44a5ccd07f89e0b8a973609a386974e74c1b8625dcc09
3
  size 307867048
runs/Jan10_22-23-42_cc5a0990e75c/events.out.tfevents.1704925436.cc5a0990e75c.1451.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fef535c242a8b8ffdd05b569ee138819773717136490a3e7590ce1f92f7e1afb
3
- size 11259
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:639f650a76ca339c9088b276a1368db09cbb41b195b087535e7c5a3f7269039e
3
+ size 12155