lewtun HF staff commited on
Commit
9823a7f
1 Parent(s): bb24c62

Add evaluation results on xsum dataset

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the [xsum](https://huggingface.co/datasets/xsum) dataset by

@lewtun

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-project-38643302-7294782).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=xsum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=xsum).

Files changed (1) hide show
  1. README.md +49 -2
README.md CHANGED
@@ -7,8 +7,55 @@ datasets:
7
  metrics:
8
  - rouge
9
  widget:
10
- - text: "National Commercial Bank (NCB), Saudi Arabia’s largest lender by assets, agreed to buy rival Samba Financial Group for $15 billion in the biggest banking takeover this year.NCB will pay 28.45 riyals ($7.58) for each Samba share, according to a statement on Sunday, valuing it at about 55.7 billion riyals. NCB will offer 0.739 new shares for each Samba share, at the lower end of the 0.736-0.787 ratio the banks set when they signed an initial framework agreement in June.The offer is a 3.5% premium to Samba’s Oct. 8 closing price of 27.50 riyals and about 24% higher than the level the shares traded at before the talks were made public. Bloomberg News first reported the merger discussions.The new bank will have total assets of more than $220 billion, creating the Gulf region’s third-largest lender. The entity’s $46 billion market capitalization nearly matches that of Qatar National Bank QPSC, which is still the Middle East’s biggest lender with about $268 billion of assets."
11
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  ### PEGASUS for Financial Summarization
 
7
  metrics:
8
  - rouge
9
  widget:
10
+ - text: "National Commercial Bank (NCB), Saudi Arabia\u2019s largest lender by assets,\
11
+ \ agreed to buy rival Samba Financial Group for $15 billion in the biggest banking\
12
+ \ takeover this year.NCB will pay 28.45 riyals ($7.58) for each Samba share, according\
13
+ \ to a statement on Sunday, valuing it at about 55.7 billion riyals. NCB will\
14
+ \ offer 0.739 new shares for each Samba share, at the lower end of the 0.736-0.787\
15
+ \ ratio the banks set when they signed an initial framework agreement in June.The\
16
+ \ offer is a 3.5% premium to Samba\u2019s Oct. 8 closing price of 27.50 riyals\
17
+ \ and about 24% higher than the level the shares traded at before the talks were\
18
+ \ made public. Bloomberg News first reported the merger discussions.The new bank\
19
+ \ will have total assets of more than $220 billion, creating the Gulf region\u2019\
20
+ s third-largest lender. The entity\u2019s $46 billion market capitalization nearly\
21
+ \ matches that of Qatar National Bank QPSC, which is still the Middle East\u2019\
22
+ s biggest lender with about $268 billion of assets."
23
+ model-index:
24
+ - name: human-centered-summarization/financial-summarization-pegasus
25
+ results:
26
+ - task:
27
+ type: summarization
28
+ name: Summarization
29
+ dataset:
30
+ name: xsum
31
+ type: xsum
32
+ config: default
33
+ split: test
34
+ metrics:
35
+ - name: ROUGE-1
36
+ type: rouge
37
+ value: 35.2055
38
+ verified: true
39
+ - name: ROUGE-2
40
+ type: rouge
41
+ value: 16.5689
42
+ verified: true
43
+ - name: ROUGE-L
44
+ type: rouge
45
+ value: 30.1285
46
+ verified: true
47
+ - name: ROUGE-LSUM
48
+ type: rouge
49
+ value: 30.1706
50
+ verified: true
51
+ - name: loss
52
+ type: loss
53
+ value: 2.7092134952545166
54
+ verified: true
55
+ - name: gen_len
56
+ type: gen_len
57
+ value: 15.1414
58
+ verified: true
59
  ---
60
 
61
  ### PEGASUS for Financial Summarization