Hugging Face's logo

Arjun9
/
t5_long_tglobal_base_samsum

Text2Text Generation
Transformers
Safetensors
longt5
Generated from Trainer
Inference Endpoints
Model card Files Community
Arjun9 commited on
Commit
1601c00
•
1 Parent(s): d222694

t5_long_tglobal_base_samsum

Browse files
Files changed (3) hide show
  1. README.md +12 -15
  2. model.safetensors +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -18,14 +18,14 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [google/long-t5-tglobal-base](https://huggingface.co/google/long-t5-tglobal-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 1.3947
22
- - Rouge1: 45.5932
23
- - Rouge2: 21.2389
24
- - Rougel: 38.0289
25
- - Rougelsum: 41.6019
26
  - Bleu: 0.0
27
- - Meteor: 0.3517
28
- - Gen Len: 16.8303
29
 
30
  ## Model description
31
 
@@ -52,17 +52,14 @@ The following hyperparameters were used during training:
52
  - total_train_batch_size: 8
53
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
54
  - lr_scheduler_type: linear
55
- - num_epochs: 5
 
56
 
57
  ### Training results
58
 
59
- | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Bleu | Meteor | Gen Len |
60
- |:-------------:|:------:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:----:|:------:|:-------:|
61
- | 1.8835 | 0.9997 | 1841 | 1.4599 | 43.5088 | 19.377 | 36.0811 | 39.65 | 0.0 | 0.3294 | 16.3346 |
62
- | 1.7514 | 2.0 | 3683 | 1.4235 | 44.2039 | 20.1072 | 36.6115 | 40.352 | 0.0 | 0.3385 | 16.8217 |
63
- | 1.6756 | 2.9997 | 5524 | 1.4020 | 44.824 | 20.5361 | 37.1858 | 40.7583 | 0.0 | 0.3431 | 16.6752 |
64
- | 1.6694 | 4.0 | 7366 | 1.3984 | 45.2781 | 21.1846 | 37.7909 | 41.3745 | 0.0 | 0.3504 | 16.7741 |
65
- | 1.6449 | 4.9986 | 9205 | 1.3947 | 45.5932 | 21.2389 | 38.0289 | 41.6019 | 0.0 | 0.3517 | 16.8303 |
66
 
67
 
68
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [google/long-t5-tglobal-base](https://huggingface.co/google/long-t5-tglobal-base) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: nan
22
+ - Rouge1: 22.7436
23
+ - Rouge2: 4.9383
24
+ - Rougel: 19.0314
25
+ - Rougelsum: 19.8871
26
  - Bleu: 0.0
27
+ - Meteor: 0.1307
28
+ - Gen Len: 17.4725
29
 
30
  ## Model description
31
 
 
52
  - total_train_batch_size: 8
53
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
54
  - lr_scheduler_type: linear
55
+ - num_epochs: 1
56
+ - mixed_precision_training: Native AMP
57
 
58
  ### Training results
59
 
60
+ | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Bleu | Meteor | Gen Len |
61
+ |:-------------:|:------:|:----:|:---------------:|:-------:|:------:|:-------:|:---------:|:----:|:------:|:-------:|
62
+ | 0.1925 | 0.9997 | 1841 | nan | 22.7436 | 4.9383 | 19.0314 | 19.8871 | 0.0 | 0.1307 | 17.4725 |
 
 
 
 
63
 
64
 
65
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0edc285525f9afb2bad2cb171293cf041647851004c9559722e43be4dc797baf
3
  size 990386200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1337bb8aa5d354d6eb6788b09ad34b30cca776f26b647738b7692377b94ccc39
3
  size 990386200
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2b274badca9f67981cdf1f847303cdd298cc46c404f57c5627b1ce61154a2a79
3
  size 5176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c529f680dd1560ad4b1e1d2867932d6f8b477ae85ca2d05de432f771454d2037
3
  size 5176