lewtun HF staff commited on
Commit
16e81ba
1 Parent(s): 0e8d08d

Add evaluation results on the plain_text config and validation split of launch/gov_report

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the plain_text config and validation split of the [launch/gov_report](https://huggingface.co/datasets/launch/gov_report) dataset by @nonchalant-nagavalli, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-staging-eval-launch__gov_report-plain_text-cd8e90-16116209).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=launch/gov_report).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=launch/gov_report).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -383,6 +383,39 @@ model-index:
383
  type: gen_len
384
  value: 132.7475
385
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
386
  ---
387
 
388
  # long-t5-tglobal-base-16384 + BookSum
 
383
  type: gen_len
384
  value: 132.7475
385
  verified: true
386
+ - task:
387
+ type: summarization
388
+ name: Summarization
389
+ dataset:
390
+ name: launch/gov_report
391
+ type: launch/gov_report
392
+ config: plain_text
393
+ split: validation
394
+ metrics:
395
+ - name: ROUGE-1
396
+ type: rouge
397
+ value: 37.9246
398
+ verified: true
399
+ - name: ROUGE-2
400
+ type: rouge
401
+ value: 8.5837
402
+ verified: true
403
+ - name: ROUGE-L
404
+ type: rouge
405
+ value: 18.0274
406
+ verified: true
407
+ - name: ROUGE-LSUM
408
+ type: rouge
409
+ value: 34.0816
410
+ verified: true
411
+ - name: loss
412
+ type: loss
413
+ value: 2.56695818901062
414
+ verified: true
415
+ - name: gen_len
416
+ type: gen_len
417
+ value: 220.3747
418
+ verified: true
419
  ---
420
 
421
  # long-t5-tglobal-base-16384 + BookSum