Hugging Face's logo

kmanaa
/
t5-dialogue-classification-4

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
kmanaa commited on
Commit
b584849
•
1 Parent(s): c870303

End of training

Browse files
Files changed (4) hide show
  1. README.md +648 -0
  2. generation_config.json +6 -0
  3. model.safetensors +1 -1
  4. runs/Mar11_13-16-17_a5a5bda6d522/events.out.tfevents.1710162978.a5a5bda6d522.255.0 +2 -2
README.md ADDED
@@ -0,0 +1,648 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/flan-t5-small
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: t5-dialogue-classification-4
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # t5-dialogue-classification-4
15
+
16
+ This model is a fine-tuned version of [google/flan-t5-small](https://huggingface.co/google/flan-t5-small) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 0.6143
19
+ - Classification Report: precision recall f1-score support
20
+
21
+ ALLERGY 1.0000 0.5000 0.6667 4
22
+ ASSESSMENT 0.0000 0.0000 0.0000 4
23
+ CC 0.5000 0.2500 0.3333 4
24
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
25
+ DISPOSITION 0.0000 0.0000 0.0000 2
26
+ EDCOURSE 0.0000 0.0000 0.0000 3
27
+ EXAM 1.0000 1.0000 1.0000 1
28
+ FAM/SOCHX 0.8077 0.9545 0.8750 22
29
+ GENHX 0.5429 0.9500 0.6909 20
30
+ GYNHX 0.0000 0.0000 0.0000 1
31
+ IMAGING 0.0000 0.0000 0.0000 1
32
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
33
+ LABS 0.0000 0.0000 0.0000 1
34
+ MEDICATIONS 0.6667 0.8571 0.7500 7
35
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
36
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
37
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
38
+ PLAN 0.0000 0.0000 0.0000 3
39
+ PROCEDURES 0.0000 0.0000 0.0000 1
40
+ ROS 0.6667 0.1818 0.2857 11
41
+ harming yourself or others 0.0000 0.0000 0.0000 0
42
+
43
+ accuracy 0.6400 100
44
+ macro avg 0.3164 0.3187 0.2986 100
45
+ weighted avg 0.5702 0.6400 0.5690 100
46
+
47
+
48
+ ## Model description
49
+
50
+ More information needed
51
+
52
+ ## Intended uses & limitations
53
+
54
+ More information needed
55
+
56
+ ## Training and evaluation data
57
+
58
+ More information needed
59
+
60
+ ## Training procedure
61
+
62
+ ### Training hyperparameters
63
+
64
+ The following hyperparameters were used during training:
65
+ - learning_rate: 0.0001
66
+ - train_batch_size: 7
67
+ - eval_batch_size: 7
68
+ - seed: 42
69
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
70
+ - lr_scheduler_type: linear
71
+ - num_epochs: 20
72
+
73
+ ### Training results
74
+
75
+ | Training Loss | Epoch | Step | Validation Loss | Classification Report |
76
+ |:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
77
+ | No log | 1.0 | 172 | 0.7682 | precision recall f1-score support
78
+
79
+ ALLERGY 0.3333 0.5000 0.4000 4
80
+ ASSESSMENT 0.0000 0.0000 0.0000 4
81
+ Afib 0.0000 0.0000 0.0000 0
82
+ CC 0.0000 0.0000 0.0000 4
83
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
84
+ DISPOSITION 0.0000 0.0000 0.0000 2
85
+ EDCOURSE 0.0000 0.0000 0.0000 3
86
+ EXAM 0.0000 0.0000 0.0000 1
87
+ FAM/SOCHX 0.7500 0.6818 0.7143 22
88
+ GENHX 0.3636 1.0000 0.5333 20
89
+ GYNHX 0.0000 0.0000 0.0000 1
90
+ ICT 0.0000 0.0000 0.0000 0
91
+ IMAGING 0.0000 0.0000 0.0000 1
92
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
93
+ Iv 0.0000 0.0000 0.0000 0
94
+ LABS 0.0000 0.0000 0.0000 1
95
+ MEDICATIONS 1.0000 0.1429 0.2500 7
96
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
97
+ PASTMEDICALHX 0.1250 0.2500 0.1667 4
98
+ PASTSURGICAL 0.5714 0.5000 0.5333 8
99
+ PLAN 0.0000 0.0000 0.0000 3
100
+ PROCEDURES 0.0000 0.0000 0.0000 1
101
+ ROS 0.0000 0.0000 0.0000 11
102
+
103
+ accuracy 0.4300 100
104
+ macro avg 0.1367 0.1337 0.1129 100
105
+ weighted avg 0.3718 0.4300 0.3466 100
106
+ |
107
+ | No log | 2.0 | 344 | 0.5464 | precision recall f1-score support
108
+
109
+ ALLERGY 0.5000 0.2500 0.3333 4
110
+ ASSESSMENT 0.0000 0.0000 0.0000 4
111
+ Afib 0.0000 0.0000 0.0000 0
112
+ CC 0.0000 0.0000 0.0000 4
113
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
114
+ DISPOSITION 0.0000 0.0000 0.0000 2
115
+ EDCOURSE 0.0000 0.0000 0.0000 3
116
+ EXAM 0.0000 0.0000 0.0000 1
117
+ FAM/SOCHX 0.8750 0.9545 0.9130 22
118
+ GENHX 0.4524 0.9500 0.6129 20
119
+ GYNHX 0.0000 0.0000 0.0000 1
120
+ I am going home with my son 0.0000 0.0000 0.0000 0
121
+ IMAGING 0.0000 0.0000 0.0000 1
122
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
123
+ LABS 0.0000 0.0000 0.0000 1
124
+ MEDICATIONS 0.4545 0.7143 0.5556 7
125
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
126
+ PASTMEDICALHX 0.3750 0.7500 0.5000 4
127
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
128
+ PLAN 0.0000 0.0000 0.0000 3
129
+ PROCEDURES 0.0000 0.0000 0.0000 1
130
+ ROS 0.0000 0.0000 0.0000 11
131
+ thoughts 0.0000 0.0000 0.0000 0
132
+
133
+ accuracy 0.5700 100
134
+ macro avg 0.1542 0.2008 0.1677 100
135
+ weighted avg 0.4209 0.5700 0.4710 100
136
+ |
137
+ | 0.5961 | 3.0 | 516 | 0.4964 | precision recall f1-score support
138
+
139
+ ALLERGY 1.0000 0.2500 0.4000 4
140
+ ASSESSMENT 0.0000 0.0000 0.0000 4
141
+ CC 0.0000 0.0000 0.0000 4
142
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
143
+ DISPOSITION 0.0000 0.0000 0.0000 2
144
+ EDCOURSE 0.0000 0.0000 0.0000 3
145
+ EXAM 0.0000 0.0000 0.0000 1
146
+ FAM/SOCHX 0.8750 0.9545 0.9130 22
147
+ GENHX 0.4878 1.0000 0.6557 20
148
+ GYNHX 0.0000 0.0000 0.0000 1
149
+ How are you feeling? 0.0000 0.0000 0.0000 0
150
+ I V 0.0000 0.0000 0.0000 0
151
+ I am going home with my son. 0.0000 0.0000 0.0000 0
152
+ IMAGING 0.0000 0.0000 0.0000 1
153
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
154
+ LABS 0.0000 0.0000 0.0000 1
155
+ MEDICATIONS 0.7143 0.7143 0.7143 7
156
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
157
+ PASTMEDICALHX 0.4444 1.0000 0.6154 4
158
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
159
+ PLAN 0.0000 0.0000 0.0000 3
160
+ PROCEDURES 0.0000 0.0000 0.0000 1
161
+ ROS 0.0000 0.0000 0.0000 11
162
+
163
+ accuracy 0.5900 100
164
+ macro avg 0.1918 0.2139 0.1843 100
165
+ weighted avg 0.4689 0.5900 0.4979 100
166
+ |
167
+ | 0.5961 | 4.0 | 688 | 0.5069 | precision recall f1-score support
168
+
169
+ ALLERGY 1.0000 0.2500 0.4000 4
170
+ ASSESSMENT 0.0000 0.0000 0.0000 4
171
+ Afib 0.0000 0.0000 0.0000 0
172
+ CC 0.0000 0.0000 0.0000 4
173
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
174
+ DISPOSITION 0.0000 0.0000 0.0000 2
175
+ EDCOURSE 0.0000 0.0000 0.0000 3
176
+ EXAM 1.0000 1.0000 1.0000 1
177
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
178
+ GENHX 0.6333 0.9500 0.7600 20
179
+ GYNHX 0.0000 0.0000 0.0000 1
180
+ IMAGING 0.0000 0.0000 0.0000 1
181
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
182
+ LABS 0.0000 0.0000 0.0000 1
183
+ MEDICATIONS 0.6667 0.8571 0.7500 7
184
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
185
+ PASTMEDICALHX 0.4000 1.0000 0.5714 4
186
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
187
+ PLAN 0.0000 0.0000 0.0000 3
188
+ PROCEDURES 0.0000 0.0000 0.0000 1
189
+ ROS 1.0000 0.1818 0.3077 11
190
+
191
+ accuracy 0.6300 100
192
+ macro avg 0.3064 0.2971 0.2689 100
193
+ weighted avg 0.6066 0.6300 0.5642 100
194
+ |
195
+ | 0.5961 | 5.0 | 860 | 0.4889 | precision recall f1-score support
196
+
197
+ ALLERGY 1.0000 0.5000 0.6667 4
198
+ ASSESSMENT 0.0000 0.0000 0.0000 4
199
+ Afib 0.0000 0.0000 0.0000 0
200
+ CC 0.0000 0.0000 0.0000 4
201
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
202
+ DISPOSITION 0.0000 0.0000 0.0000 2
203
+ EDCOURSE 0.0000 0.0000 0.0000 3
204
+ EXAM 1.0000 1.0000 1.0000 1
205
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
206
+ GENHX 0.6129 0.9500 0.7451 20
207
+ GYNHX 0.0000 0.0000 0.0000 1
208
+ IMAGING 0.0000 0.0000 0.0000 1
209
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
210
+ LABS 0.0000 0.0000 0.0000 1
211
+ MEDICATIONS 0.8333 0.7143 0.7692 7
212
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
213
+ PASTMEDICALHX 0.3000 0.7500 0.4286 4
214
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
215
+ PLAN 0.0000 0.0000 0.0000 3
216
+ PROCEDURES 0.0000 0.0000 0.0000 1
217
+ ROS 0.6667 0.1818 0.2857 11
218
+
219
+ accuracy 0.6200 100
220
+ macro avg 0.2928 0.2903 0.2740 100
221
+ weighted avg 0.5735 0.6200 0.5651 100
222
+ |
223
+ | 0.1563 | 6.0 | 1032 | 0.4923 | precision recall f1-score support
224
+
225
+ ALLERGY 1.0000 0.2500 0.4000 4
226
+ ASSESSMENT 0.0000 0.0000 0.0000 4
227
+ CC 0.0000 0.0000 0.0000 4
228
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
229
+ DISPOSITION 0.0000 0.0000 0.0000 2
230
+ EDCOURSE 0.0000 0.0000 0.0000 3
231
+ EXAM 1.0000 1.0000 1.0000 1
232
+ FAM/SOCHX 0.8462 1.0000 0.9167 22
233
+ GENHX 0.5128 1.0000 0.6780 20
234
+ GYNHX 0.0000 0.0000 0.0000 1
235
+ IMAGING 0.0000 0.0000 0.0000 1
236
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
237
+ LABS 0.0000 0.0000 0.0000 1
238
+ MEDICATIONS 0.5556 0.7143 0.6250 7
239
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
240
+ PASTMEDICALHX 0.3750 0.7500 0.5000 4
241
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
242
+ PLAN 0.0000 0.0000 0.0000 3
243
+ PROCEDURES 0.0000 0.0000 0.0000 1
244
+ ROS 1.0000 0.1818 0.3077 11
245
+
246
+ accuracy 0.6200 100
247
+ macro avg 0.3089 0.2948 0.2684 100
248
+ weighted avg 0.5737 0.6200 0.5362 100
249
+ |
250
+ | 0.1563 | 7.0 | 1204 | 0.5146 | precision recall f1-score support
251
+
252
+ ALLERGY 1.0000 0.2500 0.4000 4
253
+ ASSESSMENT 0.0000 0.0000 0.0000 4
254
+ CC 0.0000 0.0000 0.0000 4
255
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
256
+ DISPOSITION 0.0000 0.0000 0.0000 2
257
+ EDCOURSE 0.0000 0.0000 0.0000 3
258
+ EXAM 1.0000 1.0000 1.0000 1
259
+ FAM/SOCHX 0.8750 0.9545 0.9130 22
260
+ GENHX 0.5000 1.0000 0.6667 20
261
+ GYNHX 0.0000 0.0000 0.0000 1
262
+ IMAGING 0.0000 0.0000 0.0000 1
263
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
264
+ Injection 0.0000 0.0000 0.0000 0
265
+ LABS 0.0000 0.0000 0.0000 1
266
+ MEDICATIONS 0.6250 0.7143 0.6667 7
267
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
268
+ PASTMEDICALHX 0.5000 0.7500 0.6000 4
269
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
270
+ PLAN 0.0000 0.0000 0.0000 3
271
+ PROCEDURES 0.0000 0.0000 0.0000 1
272
+ ROS 0.6667 0.1818 0.2857 11
273
+
274
+ accuracy 0.6100 100
275
+ macro avg 0.2937 0.2786 0.2634 100
276
+ weighted avg 0.5596 0.6100 0.5423 100
277
+ |
278
+ | 0.1563 | 8.0 | 1376 | 0.5325 | precision recall f1-score support
279
+
280
+ ALLERGY 1.0000 0.2500 0.4000 4
281
+ ASSESSMENT 0.0000 0.0000 0.0000 4
282
+ CC 0.0000 0.0000 0.0000 4
283
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
284
+ DISPOSITION 0.0000 0.0000 0.0000 2
285
+ EDCOURSE 0.0000 0.0000 0.0000 3
286
+ EXAM 1.0000 1.0000 1.0000 1
287
+ FAM/SOCHX 0.8000 0.9091 0.8511 22
288
+ GENHX 0.5128 1.0000 0.6780 20
289
+ GYNHX 0.0000 0.0000 0.0000 1
290
+ IMAGING 0.0000 0.0000 0.0000 1
291
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
292
+ LABS 0.0000 0.0000 0.0000 1
293
+ MEDICATIONS 0.6000 0.8571 0.7059 7
294
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
295
+ PASTMEDICALHX 0.6000 0.7500 0.6667 4
296
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
297
+ PLAN 0.0000 0.0000 0.0000 3
298
+ PROCEDURES 0.0000 0.0000 0.0000 1
299
+ ROS 0.6667 0.1818 0.2857 11
300
+
301
+ accuracy 0.6100 100
302
+ macro avg 0.3090 0.2974 0.2794 100
303
+ weighted avg 0.5479 0.6100 0.5363 100
304
+ |
305
+ | 0.0973 | 9.0 | 1548 | 0.5105 | precision recall f1-score support
306
+
307
+ ALLERGY 1.0000 0.2500 0.4000 4
308
+ ASSESSMENT 0.0000 0.0000 0.0000 4
309
+ CC 0.0000 0.0000 0.0000 4
310
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
311
+ DISPOSITION 0.0000 0.0000 0.0000 2
312
+ EDCOURSE 0.0000 0.0000 0.0000 3
313
+ EXAM 1.0000 1.0000 1.0000 1
314
+ FAM/SOCHX 0.8400 0.9545 0.8936 22
315
+ GENHX 0.5429 0.9500 0.6909 20
316
+ GYNHX 0.0000 0.0000 0.0000 1
317
+ IMAGING 0.0000 0.0000 0.0000 1
318
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
319
+ LABS 0.0000 0.0000 0.0000 1
320
+ MEDICATIONS 0.6000 0.8571 0.7059 7
321
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
322
+ PASTMEDICALHX 0.6000 0.7500 0.6667 4
323
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
324
+ PLAN 0.0000 0.0000 0.0000 3
325
+ PROCEDURES 0.0000 0.0000 0.0000 1
326
+ ROS 0.6667 0.1818 0.2857 11
327
+ harming 0.0000 0.0000 0.0000 0
328
+
329
+ accuracy 0.6100 100
330
+ macro avg 0.2923 0.2830 0.2659 100
331
+ weighted avg 0.5538 0.6100 0.5436 100
332
+ |
333
+ | 0.0973 | 10.0 | 1720 | 0.5433 | precision recall f1-score support
334
+
335
+ ALLERGY 1.0000 0.5000 0.6667 4
336
+ ASSESSMENT 0.0000 0.0000 0.0000 4
337
+ CC 0.0000 0.0000 0.0000 4
338
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
339
+ DISPOSITION 0.0000 0.0000 0.0000 2
340
+ EDCOURSE 0.0000 0.0000 0.0000 3
341
+ EXAM 1.0000 1.0000 1.0000 1
342
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
343
+ GENHX 0.6129 0.9500 0.7451 20
344
+ GYNHX 0.0000 0.0000 0.0000 1
345
+ IMAGING 0.0000 0.0000 0.0000 1
346
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
347
+ LABS 0.0000 0.0000 0.0000 1
348
+ MEDICATIONS 0.6667 0.8571 0.7500 7
349
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
350
+ PASTMEDICALHX 0.5000 1.0000 0.6667 4
351
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
352
+ PLAN 0.0000 0.0000 0.0000 3
353
+ PROCEDURES 0.0000 0.0000 0.0000 1
354
+ ROS 0.7500 0.2727 0.4000 11
355
+ harming 0.0000 0.0000 0.0000 0
356
+
357
+ accuracy 0.6500 100
358
+ macro avg 0.3021 0.3133 0.2917 100
359
+ weighted avg 0.5810 0.6500 0.5864 100
360
+ |
361
+ | 0.0973 | 11.0 | 1892 | 0.5202 | precision recall f1-score support
362
+
363
+ ALLERGY 0.6667 0.5000 0.5714 4
364
+ ASSESSMENT 0.0000 0.0000 0.0000 4
365
+ CC 0.0000 0.0000 0.0000 4
366
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
367
+ DISPOSITION 0.0000 0.0000 0.0000 2
368
+ EDCOURSE 0.0000 0.0000 0.0000 3
369
+ EXAM 1.0000 1.0000 1.0000 1
370
+ FAM/SOCHX 0.8148 1.0000 0.8980 22
371
+ GENHX 0.5714 1.0000 0.7273 20
372
+ GYNHX 0.0000 0.0000 0.0000 1
373
+ IMAGING 0.0000 0.0000 0.0000 1
374
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
375
+ LABS 0.0000 0.0000 0.0000 1
376
+ MEDICATIONS 0.6250 0.7143 0.6667 7
377
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
378
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
379
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
380
+ PLAN 0.0000 0.0000 0.0000 3
381
+ PROCEDURES 0.0000 0.0000 0.0000 1
382
+ ROS 0.6667 0.1818 0.2857 11
383
+ harming 0.0000 0.0000 0.0000 0
384
+
385
+ accuracy 0.6400 100
386
+ macro avg 0.2764 0.3046 0.2770 100
387
+ weighted avg 0.5413 0.6400 0.5583 100
388
+ |
389
+ | 0.0612 | 12.0 | 2064 | 0.5594 | precision recall f1-score support
390
+
391
+ ALLERGY 1.0000 0.5000 0.6667 4
392
+ ASSESSMENT 0.0000 0.0000 0.0000 4
393
+ CC 0.5000 0.2500 0.3333 4
394
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
395
+ DISPOSITION 0.0000 0.0000 0.0000 2
396
+ EDCOURSE 0.0000 0.0000 0.0000 3
397
+ EXAM 1.0000 1.0000 1.0000 1
398
+ FAM/SOCHX 0.7857 1.0000 0.8800 22
399
+ GENHX 0.5882 1.0000 0.7407 20
400
+ GYNHX 0.0000 0.0000 0.0000 1
401
+ IMAGING 0.0000 0.0000 0.0000 1
402
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
403
+ LABS 0.0000 0.0000 0.0000 1
404
+ MEDICATIONS 0.6667 0.8571 0.7500 7
405
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
406
+ PASTMEDICALHX 0.7500 0.7500 0.7500 4
407
+ PASTSURGICAL 0.6667 1.0000 0.8000 8
408
+ PLAN 0.0000 0.0000 0.0000 3
409
+ PROCEDURES 0.0000 0.0000 0.0000 1
410
+ ROS 0.6667 0.1818 0.2857 11
411
+ harming 0.0000 0.0000 0.0000 0
412
+
413
+ accuracy 0.6500 100
414
+ macro avg 0.3154 0.3114 0.2955 100
415
+ weighted avg 0.5638 0.6500 0.5697 100
416
+ |
417
+ | 0.0612 | 13.0 | 2236 | 0.5590 | precision recall f1-score support
418
+
419
+ ALLERGY 1.0000 0.5000 0.6667 4
420
+ ASSESSMENT 0.0000 0.0000 0.0000 4
421
+ CC 1.0000 0.2500 0.4000 4
422
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
423
+ DISPOSITION 0.0000 0.0000 0.0000 2
424
+ EDCOURSE 0.0000 0.0000 0.0000 3
425
+ EXAM 1.0000 1.0000 1.0000 1
426
+ FAM/SOCHX 0.7778 0.9545 0.8571 22
427
+ GENHX 0.5714 1.0000 0.7273 20
428
+ GYNHX 0.0000 0.0000 0.0000 1
429
+ IMAGING 0.0000 0.0000 0.0000 1
430
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
431
+ LABS 0.0000 0.0000 0.0000 1
432
+ MEDICATIONS 0.6667 0.8571 0.7500 7
433
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
434
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
435
+ PASTSURGICAL 0.8000 1.0000 0.8889 8
436
+ PLAN 0.0000 0.0000 0.0000 3
437
+ PROCEDURES 0.0000 0.0000 0.0000 1
438
+ ROS 0.6667 0.1818 0.2857 11
439
+ harming 0.0000 0.0000 0.0000 0
440
+
441
+ accuracy 0.6500 100
442
+ macro avg 0.3359 0.3211 0.3001 100
443
+ weighted avg 0.5823 0.6500 0.5708 100
444
+ |
445
+ | 0.0612 | 14.0 | 2408 | 0.5971 | precision recall f1-score support
446
+
447
+ ALLERGY 1.0000 0.5000 0.6667 4
448
+ ASSESSMENT 0.0000 0.0000 0.0000 4
449
+ CC 0.5000 0.2500 0.3333 4
450
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
451
+ DISPOSITION 0.0000 0.0000 0.0000 2
452
+ EDCOURSE 0.0000 0.0000 0.0000 3
453
+ EXAM 1.0000 1.0000 1.0000 1
454
+ FAM/SOCHX 0.7857 1.0000 0.8800 22
455
+ GENHX 0.5882 1.0000 0.7407 20
456
+ GYNHX 0.0000 0.0000 0.0000 1
457
+ IMAGING 0.0000 0.0000 0.0000 1
458
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
459
+ LABS 0.0000 0.0000 0.0000 1
460
+ MEDICATIONS 0.6667 0.8571 0.7500 7
461
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
462
+ PASTMEDICALHX 0.4286 0.7500 0.5455 4
463
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
464
+ PLAN 0.0000 0.0000 0.0000 3
465
+ PROCEDURES 0.0000 0.0000 0.0000 1
466
+ ROS 0.6667 0.1818 0.2857 11
467
+ harming 0.0000 0.0000 0.0000 0
468
+
469
+ accuracy 0.6500 100
470
+ macro avg 0.3160 0.3114 0.2953 100
471
+ weighted avg 0.5776 0.6500 0.5775 100
472
+ |
473
+ | 0.0442 | 15.0 | 2580 | 0.6045 | precision recall f1-score support
474
+
475
+ ALLERGY 1.0000 0.5000 0.6667 4
476
+ ASSESSMENT 0.0000 0.0000 0.0000 4
477
+ CC 0.0000 0.0000 0.0000 4
478
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
479
+ DISPOSITION 0.0000 0.0000 0.0000 2
480
+ EDCOURSE 0.0000 0.0000 0.0000 3
481
+ EXAM 1.0000 1.0000 1.0000 1
482
+ FAM/SOCHX 0.8077 0.9545 0.8750 22
483
+ GENHX 0.5263 1.0000 0.6897 20
484
+ GYNHX 0.0000 0.0000 0.0000 1
485
+ IMAGING 0.0000 0.0000 0.0000 1
486
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
487
+ LABS 0.0000 0.0000 0.0000 1
488
+ MEDICATIONS 0.6667 0.8571 0.7500 7
489
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
490
+ PASTMEDICALHX 0.5000 0.7500 0.6000 4
491
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
492
+ PLAN 0.0000 0.0000 0.0000 3
493
+ PROCEDURES 0.0000 0.0000 0.0000 1
494
+ ROS 0.6667 0.1818 0.2857 11
495
+ harming yourself or others 0.0000 0.0000 0.0000 0
496
+
497
+ accuracy 0.6300 100
498
+ macro avg 0.2937 0.2973 0.2794 100
499
+ weighted avg 0.5530 0.6300 0.5550 100
500
+ |
501
+ | 0.0442 | 16.0 | 2752 | 0.6341 | precision recall f1-score support
502
+
503
+ ALLERGY 1.0000 0.5000 0.6667 4
504
+ ASSESSMENT 0.0000 0.0000 0.0000 4
505
+ CC 0.0000 0.0000 0.0000 4
506
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
507
+ DISPOSITION 0.0000 0.0000 0.0000 2
508
+ EDCOURSE 0.0000 0.0000 0.0000 3
509
+ EXAM 1.0000 1.0000 1.0000 1
510
+ FAM/SOCHX 0.7778 0.9545 0.8571 22
511
+ GENHX 0.5405 1.0000 0.7018 20
512
+ GYNHX 0.0000 0.0000 0.0000 1
513
+ IMAGING 0.0000 0.0000 0.0000 1
514
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
515
+ LABS 0.0000 0.0000 0.0000 1
516
+ MEDICATIONS 0.6667 0.8571 0.7500 7
517
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
518
+ PASTMEDICALHX 0.5000 0.7500 0.6000 4
519
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
520
+ PLAN 0.0000 0.0000 0.0000 3
521
+ PROCEDURES 0.0000 0.0000 0.0000 1
522
+ ROS 0.6667 0.1818 0.2857 11
523
+ harming yourself or others 0.0000 0.0000 0.0000 0
524
+
525
+ accuracy 0.6300 100
526
+ macro avg 0.2929 0.2973 0.2791 100
527
+ weighted avg 0.5492 0.6300 0.5535 100
528
+ |
529
+ | 0.0442 | 17.0 | 2924 | 0.6230 | precision recall f1-score support
530
+
531
+ ALLERGY 1.0000 0.5000 0.6667 4
532
+ ASSESSMENT 0.0000 0.0000 0.0000 4
533
+ CC 0.3333 0.2500 0.2857 4
534
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
535
+ DISPOSITION 0.0000 0.0000 0.0000 2
536
+ EDCOURSE 0.0000 0.0000 0.0000 3
537
+ EXAM 1.0000 1.0000 1.0000 1
538
+ FAM/SOCHX 0.8077 0.9545 0.8750 22
539
+ GENHX 0.5429 0.9500 0.6909 20
540
+ GYNHX 0.0000 0.0000 0.0000 1
541
+ IMAGING 0.0000 0.0000 0.0000 1
542
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
543
+ LABS 0.0000 0.0000 0.0000 1
544
+ MEDICATIONS 0.6667 0.8571 0.7500 7
545
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
546
+ PASTMEDICALHX 0.5000 0.7500 0.6000 4
547
+ PASTSURGICAL 1.0000 1.0000 1.0000 8
548
+ PLAN 0.0000 0.0000 0.0000 3
549
+ PROCEDURES 0.0000 0.0000 0.0000 1
550
+ ROS 0.6667 0.1818 0.2857 11
551
+ harming yourself or others 0.0000 0.0000 0.0000 0
552
+
553
+ accuracy 0.6300 100
554
+ macro avg 0.3103 0.3068 0.2930 100
555
+ weighted avg 0.5696 0.6300 0.5667 100
556
+ |
557
+ | 0.0266 | 18.0 | 3096 | 0.6051 | precision recall f1-score support
558
+
559
+ ALLERGY 1.0000 0.5000 0.6667 4
560
+ ASSESSMENT 0.0000 0.0000 0.0000 4
561
+ CC 1.0000 0.2500 0.4000 4
562
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
563
+ DISPOSITION 0.0000 0.0000 0.0000 2
564
+ EDCOURSE 0.0000 0.0000 0.0000 3
565
+ EXAM 1.0000 1.0000 1.0000 1
566
+ FAM/SOCHX 0.7778 0.9545 0.8571 22
567
+ GENHX 0.5556 1.0000 0.7143 20
568
+ GYNHX 0.0000 0.0000 0.0000 1
569
+ IMAGING 0.0000 0.0000 0.0000 1
570
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
571
+ LABS 0.0000 0.0000 0.0000 1
572
+ MEDICATIONS 0.6667 0.8571 0.7500 7
573
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
574
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
575
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
576
+ PLAN 0.0000 0.0000 0.0000 3
577
+ PROCEDURES 0.0000 0.0000 0.0000 1
578
+ ROS 0.6667 0.1818 0.2857 11
579
+ harming yourself or others 0.0000 0.0000 0.0000 0
580
+
581
+ accuracy 0.6500 100
582
+ macro avg 0.3394 0.3211 0.3020 100
583
+ weighted avg 0.5862 0.6500 0.5724 100
584
+ |
585
+ | 0.0266 | 19.0 | 3268 | 0.6057 | precision recall f1-score support
586
+
587
+ ALLERGY 1.0000 0.5000 0.6667 4
588
+ ASSESSMENT 0.0000 0.0000 0.0000 4
589
+ CC 1.0000 0.2500 0.4000 4
590
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
591
+ DISPOSITION 0.0000 0.0000 0.0000 2
592
+ EDCOURSE 0.0000 0.0000 0.0000 3
593
+ EXAM 1.0000 1.0000 1.0000 1
594
+ FAM/SOCHX 0.7778 0.9545 0.8571 22
595
+ GENHX 0.5556 1.0000 0.7143 20
596
+ GYNHX 0.0000 0.0000 0.0000 1
597
+ IMAGING 0.0000 0.0000 0.0000 1
598
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
599
+ LABS 0.0000 0.0000 0.0000 1
600
+ MEDICATIONS 0.6667 0.8571 0.7500 7
601
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
602
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
603
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
604
+ PLAN 0.0000 0.0000 0.0000 3
605
+ PROCEDURES 0.0000 0.0000 0.0000 1
606
+ ROS 0.6667 0.1818 0.2857 11
607
+ harming yourself or others 0.0000 0.0000 0.0000 0
608
+
609
+ accuracy 0.6500 100
610
+ macro avg 0.3394 0.3211 0.3020 100
611
+ weighted avg 0.5862 0.6500 0.5724 100
612
+ |
613
+ | 0.0266 | 20.0 | 3440 | 0.6143 | precision recall f1-score support
614
+
615
+ ALLERGY 1.0000 0.5000 0.6667 4
616
+ ASSESSMENT 0.0000 0.0000 0.0000 4
617
+ CC 0.5000 0.2500 0.3333 4
618
+ DIAGNOSIS 0.0000 0.0000 0.0000 1
619
+ DISPOSITION 0.0000 0.0000 0.0000 2
620
+ EDCOURSE 0.0000 0.0000 0.0000 3
621
+ EXAM 1.0000 1.0000 1.0000 1
622
+ FAM/SOCHX 0.8077 0.9545 0.8750 22
623
+ GENHX 0.5429 0.9500 0.6909 20
624
+ GYNHX 0.0000 0.0000 0.0000 1
625
+ IMAGING 0.0000 0.0000 0.0000 1
626
+ IMMUNIZATIONS 0.0000 0.0000 0.0000 1
627
+ LABS 0.0000 0.0000 0.0000 1
628
+ MEDICATIONS 0.6667 0.8571 0.7500 7
629
+ OTHER_HISTORY 0.0000 0.0000 0.0000 1
630
+ PASTMEDICALHX 0.5714 1.0000 0.7273 4
631
+ PASTSURGICAL 0.8889 1.0000 0.9412 8
632
+ PLAN 0.0000 0.0000 0.0000 3
633
+ PROCEDURES 0.0000 0.0000 0.0000 1
634
+ ROS 0.6667 0.1818 0.2857 11
635
+ harming yourself or others 0.0000 0.0000 0.0000 0
636
+
637
+ accuracy 0.6400 100
638
+ macro avg 0.3164 0.3187 0.2986 100
639
+ weighted avg 0.5702 0.6400 0.5690 100
640
+ |
641
+
642
+
643
+ ### Framework versions
644
+
645
+ - Transformers 4.38.2
646
+ - Pytorch 2.1.0+cu121
647
+ - Datasets 2.18.0
648
+ - Tokenizers 0.15.2
generation_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "decoder_start_token_id": 0,
3
+ "eos_token_id": 1,
4
+ "pad_token_id": 0,
5
+ "transformers_version": "4.38.2"
6
+ }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2bf373ed1fe4157d6b3e56bbc3857aae5ee1fb4434b84a5121cdcfcab12f2d7a
3
  size 307867048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86b1335c5178b356e91e5718b6c7ee50e5cbad5472d4a1e88256ca541f239e09
3
  size 307867048
runs/Mar11_13-16-17_a5a5bda6d522/events.out.tfevents.1710162978.a5a5bda6d522.255.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d2415dcca2e695ede9844e976529ecbfcd98681c32c77062eda7a3f816f7cb4c
3
- size 9459
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c891bf1d657d4da0603f577c905d11261fa6b8b23fdf0eb58a1c2a326b13d17f
3
+ size 12674