dewifaj commited on
Commit
e61aadb
1 Parent(s): 722b3de

End of training

Browse files
README.md CHANGED
@@ -17,12 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.4249
21
- - Rouge1: 0.3873
22
- - Rouge2: 0.1614
23
- - Rougel: 0.3216
24
- - Rougelsum: 0.3216
25
- - Gen Len: 16.1371
26
 
27
  ## Model description
28
 
@@ -47,17 +47,23 @@ The following hyperparameters were used during training:
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
- - num_epochs: 4
51
  - mixed_precision_training: Native AMP
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
56
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
57
- | 1.9208 | 1.0 | 737 | 0.4468 | 0.3549 | 0.1408 | 0.2962 | 0.2962 | 15.1235 |
58
- | 0.5031 | 2.0 | 1474 | 0.4318 | 0.3769 | 0.1527 | 0.3129 | 0.3129 | 15.9878 |
59
- | 0.4758 | 3.0 | 2211 | 0.4272 | 0.3849 | 0.1591 | 0.3197 | 0.3197 | 16.0886 |
60
- | 0.4722 | 4.0 | 2948 | 0.4249 | 0.3873 | 0.1614 | 0.3216 | 0.3216 | 16.1371 |
 
 
 
 
 
 
61
 
62
 
63
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.3992
21
+ - Rouge1: 0.4144
22
+ - Rouge2: 0.1805
23
+ - Rougel: 0.3419
24
+ - Rougelsum: 0.3418
25
+ - Gen Len: 16.6732
26
 
27
  ## Model description
28
 
 
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - num_epochs: 10
51
  - mixed_precision_training: Native AMP
52
 
53
  ### Training results
54
 
55
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
56
  |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|
57
+ | 0.4595 | 1.0 | 737 | 0.4170 | 0.3923 | 0.163 | 0.3243 | 0.3242 | 16.1826 |
58
+ | 0.4474 | 2.0 | 1474 | 0.4113 | 0.3991 | 0.1685 | 0.3304 | 0.3303 | 16.5925 |
59
+ | 0.4416 | 3.0 | 2211 | 0.4092 | 0.4021 | 0.1722 | 0.3337 | 0.3339 | 16.6023 |
60
+ | 0.4388 | 4.0 | 2948 | 0.4048 | 0.4062 | 0.1737 | 0.3361 | 0.3361 | 16.5731 |
61
+ | 0.4331 | 5.0 | 3685 | 0.4030 | 0.4093 | 0.1758 | 0.3379 | 0.338 | 16.696 |
62
+ | 0.4243 | 6.0 | 4422 | 0.4010 | 0.4111 | 0.1778 | 0.3396 | 0.3396 | 16.5728 |
63
+ | 0.4234 | 7.0 | 5159 | 0.4000 | 0.4129 | 0.1789 | 0.3406 | 0.3405 | 16.7139 |
64
+ | 0.425 | 8.0 | 5896 | 0.3996 | 0.4125 | 0.1797 | 0.3407 | 0.3407 | 16.7089 |
65
+ | 0.4247 | 9.0 | 6633 | 0.3993 | 0.4147 | 0.181 | 0.3421 | 0.3422 | 16.6943 |
66
+ | 0.4176 | 10.0 | 7370 | 0.3992 | 0.4144 | 0.1805 | 0.3419 | 0.3418 | 16.6732 |
67
 
68
 
69
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e85498e66858e895bb59988b8fdde025d09474ca8dae1ce7ccb535bfe205689b
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9decb15fcd91b2aea34ec84d724527819537eeed8daf96a12d0bc054d3ece9f2
3
  size 242041896
runs/Mar17_03-17-30_f568924cd75f/events.out.tfevents.1710645451.f568924cd75f.18253.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f96165b2ed5b24a108efd95b8fa477d08c13a4f1f1e7477095d4c927c1ed3e74
3
- size 13273
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:367a7ad55ccd95ef78c176a119494ade6ffab722973710d0d79a6b8abcacc021
3
+ size 14152