lewtun HF staff commited on
Commit
6380ccf
1 Parent(s): a4f8f3e

Add evaluation results on the default config of xsum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the default config of the [xsum](https://huggingface.co/datasets/xsum) dataset by @xarymast, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-xsum-69daf1dd-12935739).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xsum).

Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -7,6 +7,42 @@ datasets:
7
  - cnn_dailymail
8
  - xsum
9
  thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  ### Usage
 
7
  - cnn_dailymail
8
  - xsum
9
  thumbnail: https://huggingface.co/front/thumbnails/distilbart_medium.png
10
+ model-index:
11
+ - name: sshleifer/distilbart-cnn-12-6
12
+ results:
13
+ - task:
14
+ type: summarization
15
+ name: Summarization
16
+ dataset:
17
+ name: xsum
18
+ type: xsum
19
+ config: default
20
+ split: test
21
+ metrics:
22
+ - name: ROUGE-1
23
+ type: rouge
24
+ value: 21.0357
25
+ verified: true
26
+ - name: ROUGE-2
27
+ type: rouge
28
+ value: 3.8995
29
+ verified: true
30
+ - name: ROUGE-L
31
+ type: rouge
32
+ value: 13.7879
33
+ verified: true
34
+ - name: ROUGE-LSUM
35
+ type: rouge
36
+ value: 16.9128
37
+ verified: true
38
+ - name: loss
39
+ type: loss
40
+ value: 3.8684895038604736
41
+ verified: true
42
+ - name: gen_len
43
+ type: gen_len
44
+ value: 68.5219
45
+ verified: true
46
  ---
47
 
48
  ### Usage