zwellington commited on
Commit
a3260b5
1 Parent(s): 4d98f4c

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +93 -0
README.md ADDED
@@ -0,0 +1,93 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: bert-base-uncased
4
+ tags:
5
+ - generated_from_trainer
6
+ datasets:
7
+ - azaheadhealth
8
+ metrics:
9
+ - accuracy
10
+ - f1
11
+ - precision
12
+ - recall
13
+ model-index:
14
+ - name: bert-azahead-v0.1
15
+ results:
16
+ - task:
17
+ name: Text Classification
18
+ type: text-classification
19
+ dataset:
20
+ name: azaheadhealth
21
+ type: azaheadhealth
22
+ config: small
23
+ split: test
24
+ args: small
25
+ metrics:
26
+ - name: Accuracy
27
+ type: accuracy
28
+ value: 0.75
29
+ - name: F1
30
+ type: f1
31
+ value: 0.4
32
+ - name: Precision
33
+ type: precision
34
+ value: 0.6666666666666666
35
+ - name: Recall
36
+ type: recall
37
+ value: 0.2857142857142857
38
+ ---
39
+
40
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
41
+ should probably proofread and complete it, then remove this comment. -->
42
+
43
+ # bert-azahead-v0.1
44
+
45
+ This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on the azaheadhealth dataset.
46
+ It achieves the following results on the evaluation set:
47
+ - Loss: 0.4710
48
+ - Accuracy: 0.75
49
+ - F1: 0.4
50
+ - Precision: 0.6667
51
+ - Recall: 0.2857
52
+
53
+ ## Model description
54
+
55
+ More information needed
56
+
57
+ ## Intended uses & limitations
58
+
59
+ More information needed
60
+
61
+ ## Training and evaluation data
62
+
63
+ More information needed
64
+
65
+ ## Training procedure
66
+
67
+ ### Training hyperparameters
68
+
69
+ The following hyperparameters were used during training:
70
+ - learning_rate: 2e-05
71
+ - train_batch_size: 2
72
+ - eval_batch_size: 2
73
+ - seed: 42
74
+ - gradient_accumulation_steps: 2
75
+ - total_train_batch_size: 4
76
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
77
+ - lr_scheduler_type: linear
78
+ - num_epochs: 1
79
+
80
+ ### Training results
81
+
82
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
83
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
84
+ | 0.6325 | 0.5 | 20 | 0.5001 | 0.7917 | 0.7059 | 0.6 | 0.8571 |
85
+ | 0.5346 | 1.0 | 40 | 0.4710 | 0.75 | 0.4 | 0.6667 | 0.2857 |
86
+
87
+
88
+ ### Framework versions
89
+
90
+ - Transformers 4.31.0
91
+ - Pytorch 2.2.0+cu121
92
+ - Datasets 2.16.1
93
+ - Tokenizers 0.13.2