lewtun HF staff commited on
Commit
d6ccc0e
•
1 Parent(s): 1968504

Add evaluation results on xsum dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [xsum](https://huggingface.co./datasets/xsum) dataset by

@ArjunPrSarkhel

, using the predictions stored [here](https://huggingface.co./datasets/autoevaluate/autoeval-staging-eval-project-xsum-7db0303b-10095338).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co./spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co./spaces/autoevaluate/model-evaluator?dataset=xsum).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -49,6 +49,39 @@ model-index:
49
  type: gen_len
50
  value: 59.6032
51
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
  ---
53
 
54
  ## `distilbart-cnn-12-6-samsum`
 
49
  type: gen_len
50
  value: 59.6032
51
  verified: true
52
+ - task:
53
+ type: summarization
54
+ name: Summarization
55
+ dataset:
56
+ name: xsum
57
+ type: xsum
58
+ config: default
59
+ split: test
60
+ metrics:
61
+ - name: ROUGE-1
62
+ type: rouge
63
+ value: 21.1644
64
+ verified: true
65
+ - name: ROUGE-2
66
+ type: rouge
67
+ value: 4.0659
68
+ verified: true
69
+ - name: ROUGE-L
70
+ type: rouge
71
+ value: 13.9414
72
+ verified: true
73
+ - name: ROUGE-LSUM
74
+ type: rouge
75
+ value: 17.0718
76
+ verified: true
77
+ - name: loss
78
+ type: loss
79
+ value: 3.002755880355835
80
+ verified: true
81
+ - name: gen_len
82
+ type: gen_len
83
+ value: 71.2969
84
+ verified: true
85
  ---
86
 
87
  ## `distilbart-cnn-12-6-samsum`