autoevaluator HF staff commited on
Commit
2c67882
1 Parent(s): de92e8b

Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the kmfoda--booksum config and test split of the [kmfoda/booksum](https://huggingface.co/datasets/kmfoda/booksum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-kmfoda__booksum-kmfoda__booksum-e19ec2-2251271758).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=kmfoda/booksum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=kmfoda/booksum).

Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -9,7 +9,40 @@ metrics:
9
  - rouge
10
  model-index:
11
  - name: long-t5-tglobal-large-booksum-WIP
12
- results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  ---
14
 
15
 
 
9
  - rouge
10
  model-index:
11
  - name: long-t5-tglobal-large-booksum-WIP
12
+ results:
13
+ - task:
14
+ type: summarization
15
+ name: Summarization
16
+ dataset:
17
+ name: kmfoda/booksum
18
+ type: kmfoda/booksum
19
+ config: kmfoda--booksum
20
+ split: test
21
+ metrics:
22
+ - name: ROUGE-1
23
+ type: rouge
24
+ value: 25.6136
25
+ verified: true
26
+ - name: ROUGE-2
27
+ type: rouge
28
+ value: 2.8652
29
+ verified: true
30
+ - name: ROUGE-L
31
+ type: rouge
32
+ value: 12.4913
33
+ verified: true
34
+ - name: ROUGE-LSUM
35
+ type: rouge
36
+ value: 23.1102
37
+ verified: true
38
+ - name: loss
39
+ type: loss
40
+ value: 5.004334926605225
41
+ verified: true
42
+ - name: gen_len
43
+ type: gen_len
44
+ value: 89.4354
45
+ verified: true
46
  ---
47
 
48