Hugging Face's logo

VuongQuoc
/
1_microsoft_deberta_V1.0

Multiple Choice
Transformers
PyTorch
deberta-v2
Generated from Trainer
Inference Endpoints
Model card Files Community
VuongQuoc commited on
Commit
bde85da
•
1 Parent(s): b564f25

Model save

Browse files
Files changed (2) hide show
  1. README.md +55 -12
  2. pytorch_model.bin +1 -1
README.md CHANGED
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [microsoft/deberta-v3-large](https://huggingface.co/microsoft/deberta-v3-large) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.0849
21
- - Map@3: 0.7725
22
- - Accuracy: 0.665
23
 
24
  ## Model description
25
 
@@ -42,23 +42,66 @@ The following hyperparameters were used during training:
42
  - train_batch_size: 2
43
  - eval_batch_size: 4
44
  - seed: 42
45
- - gradient_accumulation_steps: 25
46
- - total_train_batch_size: 50
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: cosine
49
  - lr_scheduler_warmup_ratio: 0.1
50
- - training_steps: 60
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Map@3 | Accuracy |
55
  |:-------------:|:-----:|:----:|:---------------:|:------:|:--------:|
56
- | 1.6098 | 0.01 | 10 | 1.6090 | 0.6108 | 0.475 |
57
- | 1.6057 | 0.02 | 20 | 1.6027 | 0.7375 | 0.625 |
58
- | 1.5615 | 0.03 | 30 | 1.4516 | 0.7458 | 0.64 |
59
- | 1.2061 | 0.03 | 40 | 1.2130 | 0.7292 | 0.595 |
60
- | 1.1028 | 0.04 | 50 | 1.0947 | 0.765 | 0.65 |
61
- | 1.0682 | 0.05 | 60 | 1.0849 | 0.7725 | 0.665 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
62
 
63
 
64
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [microsoft/deberta-v3-large](https://huggingface.co/microsoft/deberta-v3-large) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.5748
21
+ - Map@3: 0.8700
22
+ - Accuracy: 0.785
23
 
24
  ## Model description
25
 
 
42
  - train_batch_size: 2
43
  - eval_batch_size: 4
44
  - seed: 42
45
+ - gradient_accumulation_steps: 21
46
+ - total_train_batch_size: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: cosine
49
  - lr_scheduler_warmup_ratio: 0.1
50
+ - num_epochs: 1
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Map@3 | Accuracy |
55
  |:-------------:|:-----:|:----:|:---------------:|:------:|:--------:|
56
+ | 1.6136 | 0.02 | 25 | 1.6092 | 0.4850 | 0.335 |
57
+ | 1.6116 | 0.04 | 50 | 1.6063 | 0.7250 | 0.61 |
58
+ | 1.4598 | 0.05 | 75 | 1.2186 | 0.7575 | 0.63 |
59
+ | 1.0137 | 0.07 | 100 | 0.9068 | 0.7908 | 0.665 |
60
+ | 0.9483 | 0.09 | 125 | 0.9574 | 0.8108 | 0.69 |
61
+ | 0.9619 | 0.1 | 150 | 0.8634 | 0.8183 | 0.71 |
62
+ | 0.8679 | 0.12 | 175 | 0.7644 | 0.8292 | 0.73 |
63
+ | 0.8594 | 0.14 | 200 | 0.8161 | 0.8067 | 0.7 |
64
+ | 0.8105 | 0.16 | 225 | 0.8355 | 0.82 | 0.715 |
65
+ | 0.8315 | 0.17 | 250 | 0.7381 | 0.8275 | 0.73 |
66
+ | 0.8275 | 0.19 | 275 | 0.7636 | 0.8433 | 0.745 |
67
+ | 0.8252 | 0.21 | 300 | 0.7196 | 0.8217 | 0.73 |
68
+ | 0.7801 | 0.23 | 325 | 0.6940 | 0.8367 | 0.745 |
69
+ | 0.8078 | 0.24 | 350 | 0.7185 | 0.8567 | 0.775 |
70
+ | 0.7583 | 0.26 | 375 | 0.7007 | 0.8433 | 0.75 |
71
+ | 0.7772 | 0.28 | 400 | 0.7032 | 0.8417 | 0.75 |
72
+ | 0.8204 | 0.3 | 425 | 0.7062 | 0.8500 | 0.76 |
73
+ | 0.8269 | 0.32 | 450 | 0.7082 | 0.8617 | 0.785 |
74
+ | 0.7418 | 0.33 | 475 | 0.7288 | 0.8517 | 0.78 |
75
+ | 0.7376 | 0.35 | 500 | 0.7021 | 0.8633 | 0.78 |
76
+ | 0.7519 | 0.37 | 525 | 0.6943 | 0.8642 | 0.785 |
77
+ | 0.7469 | 0.39 | 550 | 0.6807 | 0.8725 | 0.805 |
78
+ | 0.7244 | 0.4 | 575 | 0.6622 | 0.8692 | 0.79 |
79
+ | 0.7297 | 0.42 | 600 | 0.6783 | 0.8583 | 0.775 |
80
+ | 0.7259 | 0.44 | 625 | 0.6788 | 0.8550 | 0.765 |
81
+ | 0.6893 | 0.46 | 650 | 0.6571 | 0.8625 | 0.785 |
82
+ | 0.6871 | 0.47 | 675 | 0.6587 | 0.8492 | 0.76 |
83
+ | 0.7003 | 0.49 | 700 | 0.6485 | 0.8683 | 0.785 |
84
+ | 0.7094 | 0.51 | 725 | 0.6320 | 0.8675 | 0.795 |
85
+ | 0.7052 | 0.53 | 750 | 0.6554 | 0.8583 | 0.78 |
86
+ | 0.6873 | 0.54 | 775 | 0.6121 | 0.8550 | 0.775 |
87
+ | 0.6152 | 0.56 | 800 | 0.6060 | 0.8675 | 0.785 |
88
+ | 0.6741 | 0.58 | 825 | 0.6191 | 0.8808 | 0.815 |
89
+ | 0.7098 | 0.59 | 850 | 0.6213 | 0.8817 | 0.815 |
90
+ | 0.7029 | 0.61 | 875 | 0.6533 | 0.8725 | 0.79 |
91
+ | 0.6489 | 0.63 | 900 | 0.6127 | 0.8667 | 0.79 |
92
+ | 0.7289 | 0.65 | 925 | 0.6261 | 0.8750 | 0.81 |
93
+ | 0.6589 | 0.67 | 950 | 0.6019 | 0.8708 | 0.8 |
94
+ | 0.6876 | 0.68 | 975 | 0.6076 | 0.8725 | 0.805 |
95
+ | 0.6624 | 0.7 | 1000 | 0.5810 | 0.8708 | 0.79 |
96
+ | 0.6746 | 0.72 | 1025 | 0.5922 | 0.8708 | 0.79 |
97
+ | 0.6644 | 0.73 | 1050 | 0.5827 | 0.8675 | 0.785 |
98
+ | 0.668 | 0.75 | 1075 | 0.5814 | 0.8725 | 0.795 |
99
+ | 0.6115 | 0.77 | 1100 | 0.5680 | 0.8750 | 0.8 |
100
+ | 0.6799 | 0.79 | 1125 | 0.5767 | 0.8750 | 0.8 |
101
+ | 0.6466 | 0.81 | 1150 | 0.5700 | 0.8725 | 0.795 |
102
+ | 0.6765 | 0.82 | 1175 | 0.5700 | 0.8717 | 0.79 |
103
+ | 0.6936 | 0.84 | 1200 | 0.5758 | 0.8683 | 0.785 |
104
+ | 0.6239 | 0.86 | 1225 | 0.5748 | 0.8700 | 0.785 |
105
 
106
 
107
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9c6633bc99b0dcb0e824db274093fc02ed0bf971b6a3dd964b6eb143524b59dc
3
  size 1740387701
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df9c3827eb6c853f801b4b5096667d9fddeeaa49c8e07d62f6faac0e65a9dd1e
3
  size 1740387701