File size: 4,170 Bytes
3efb79a
 
 
 
 
 
 
 
 
 
 
 
 
 
5270882
3efb79a
 
 
 
 
5270882
3efb79a
5270882
1021f8c
 
 
 
 
 
 
 
 
5270882
1021f8c
5270882
1021f8c
5270882
 
1021f8c
5270882
1021f8c
5270882
 
1021f8c
5270882
1021f8c
5270882
 
1021f8c
5270882
1021f8c
5270882
 
1021f8c
5270882
1021f8c
5270882
 
1021f8c
5270882
1021f8c
5270882
3efb79a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
---
license: apache-2.0
tags:
- summarization
- generated_from_trainer
datasets:
- samsum
metrics:
- rouge
model-index:
- name: bart-base-finetuned-samsum-en
  results:
  - task:
      type: text2text-generation
      name: Sequence-to-sequence Language Modeling
    dataset:
      name: samsum
      type: samsum
      args: samsum
    metrics:
    - type: rouge
      value: 46.8825
      name: Rouge1
  - task:
      type: summarization
      name: Summarization
    dataset:
      name: samsum
      type: samsum
      config: samsum
      split: test
    metrics:
    - type: rouge
      value: 45.0692
      name: ROUGE-1
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYmJmZGIzMjdlODZhOThjMTFhYzM3NWJjOTNjMjkyN2U4NmE2YjViZmM0ZTBkNTU0NTc0YmZlMGY4NDI1NmM0YyIsInZlcnNpb24iOjF9.4p6xyMhFMia_Ms0bohyUchjrHhYvz7tH_O9LdeEK5FYF6pWEWs3Aw3i6LCc2HPnsge2ZKG-pzsRdbMJwO5w4Bg
    - type: rouge
      value: 20.9049
      name: ROUGE-2
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTY3OTVmM2E5ZmRjYzYzZmE3MGQwODNmMTk0MGJjMTRkMDQ2NGEwNGY0ZTA3OWJjODIzOWVkYTgwZjRjNzhkYiIsInZlcnNpb24iOjF9.YKFCR8fT38vuj9TA9wZHUNX6hmV0_m4yErKuuVvEBtWSwOmrzIrdSHVk40wSQomojTFFA9HRAZ_Ssf0rke_SAw
    - type: rouge
      value: 37.3128
      name: ROUGE-L
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDZhN2I5NDdjNTEwYzg2YTZlMWJkZDFmYmE0NDkzYmI4Mjg2YjVkYTQwMmEyMTEzZmI4YzBmMDg3OWY5MDQ0MiIsInZlcnNpb24iOjF9.RFrkndxIOt61Vs59zCdI09IXh349inPilhD-bXvpqfUKa92PTUNBqsumL8lzS4N7uEcfca1QYG4STEy_Efc9Dw
    - type: rouge
      value: 40.662
      name: ROUGE-LSUM
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGIxMjlkZjY3ZDNiOGQwM2FlNTExYjI5OGIwOGUxYTU4ZGFiNGRjOTU5MTFjMDQ2YWU2MzU3M2E0NTQ3Yjk4MiIsInZlcnNpb24iOjF9.AEJgh8jnUs0nyIsUj6mNxyqIzfFRVwqEowIMnK-xnSRbuMkCMEREeao4FSK2a0Cx5rNkXuEW4fBIRDrhyDKIBA
    - type: loss
      value: 5.763935565948486
      name: loss
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzc2Yzc5YjRjOGFjZmIwYTFiYzNiN2VmNzJiNjdlZmRhNjZlNzU4ZDc1OWE2MTk1MjQ5MGM0NDNmMDY3NTZmYiIsInZlcnNpb24iOjF9.r-Z0kcXf81IlDxT0yYoLjya7Uc3q6sJT0LxzhIdKVYc3mOoxPLMX1_vLQPX8fsIHIqPHPtKczfZ_z6mB0yptBg
    - type: gen_len
      value: 18.4921
      name: gen_len
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiY2NkYTg0MGFiYmJiZWI1ZjYzMGEzOGM1MGM2NjgyNzE2MTk2ZTc3MTQ2Mzg4Y2U5NTM3MDBiNTQ5YzUwNzAzYyIsInZlcnNpb24iOjF9.fn2kkheKjJJio6pcI0X0OWMEE08CuO35VrebfTNqTGJDV3U5O2f6Vf6RMo0d5b4N5X-E5-Ju-7k2CDxNi8CAAw
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bart-base-finetuned-samsum-en

This model is a fine-tuned version of [facebook/bart-base](https://huggingface.co./facebook/bart-base) on the samsum dataset.
It achieves the following results on the evaluation set:
- Loss: 2.3676
- Rouge1: 46.8825
- Rouge2: 22.0923
- Rougel: 39.7249
- Rougelsum: 42.9187

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5.6e-05
- train_batch_size: 10
- eval_batch_size: 10
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 3

### Training results

| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|
| 0.5172        | 1.0   | 300  | 2.1613          | 47.4152 | 22.8106 | 39.93   | 43.3639   |
| 0.3627        | 2.0   | 600  | 2.2771          | 47.2676 | 22.6325 | 40.1345 | 43.19     |
| 0.2466        | 3.0   | 900  | 2.3676          | 46.8825 | 22.0923 | 39.7249 | 42.9187   |


### Framework versions

- Transformers 4.19.2
- Pytorch 1.11.0+cu113
- Datasets 2.2.2
- Tokenizers 0.12.1