lewtun HF staff commited on
Commit
ce9fb19
•
1 Parent(s): 176f748

Add evaluation results on samsum dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [samsum](https://huggingface.co./datasets/samsum) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co./datasets/autoevaluate/autoeval-staging-eval-project-84760c85-7314786).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co./spaces/autoevaluate/leaderboards?dataset=samsum).\
Evaluate your model on more datasets [here](https://huggingface.co./spaces/autoevaluate/model-evaluator?dataset=samsum).

Files changed (1) hide show
  1. README.md +40 -7
README.md CHANGED
@@ -9,13 +9,46 @@ license: apache-2.0
9
  datasets:
10
  - samsum
11
  widget:
12
- - text: |
13
- Jeff: Can I train a 🤗 Transformers model on Amazon SageMaker?
14
- Philipp: Sure you can use the new Hugging Face Deep Learning Container.
15
- Jeff: ok.
16
- Jeff: and how can I get started?
17
- Jeff: where can I find documentation?
18
- Philipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ---
20
 
21
  ## `distilbart-cnn-12-6-samsum`
 
9
  datasets:
10
  - samsum
11
  widget:
12
+ - text: "Jeff: Can I train a \U0001F917 Transformers model on Amazon SageMaker? \n\
13
+ Philipp: Sure you can use the new Hugging Face Deep Learning Container. \nJeff:\
14
+ \ ok.\nJeff: and how can I get started? \nJeff: where can I find documentation?\
15
+ \ \nPhilipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face "
16
+ model-index:
17
+ - name: philschmid/distilbart-cnn-12-6-samsum
18
+ results:
19
+ - task:
20
+ type: summarization
21
+ name: Summarization
22
+ dataset:
23
+ name: samsum
24
+ type: samsum
25
+ config: samsum
26
+ split: test
27
+ metrics:
28
+ - name: ROUGE-1
29
+ type: rouge
30
+ value: 41.0895
31
+ verified: true
32
+ - name: ROUGE-2
33
+ type: rouge
34
+ value: 20.7459
35
+ verified: true
36
+ - name: ROUGE-L
37
+ type: rouge
38
+ value: 31.5952
39
+ verified: true
40
+ - name: ROUGE-LSUM
41
+ type: rouge
42
+ value: 38.3389
43
+ verified: true
44
+ - name: loss
45
+ type: loss
46
+ value: 1.4566329717636108
47
+ verified: true
48
+ - name: gen_len
49
+ type: gen_len
50
+ value: 59.6032
51
+ verified: true
52
  ---
53
 
54
  ## `distilbart-cnn-12-6-samsum`