SUPERT: Towards New Frontiers in Unsupervised Evaluation Metrics for Multi-Document Summarization

7 May 2020

Papers citing "SUPERT: Towards New Frontiers in Unsupervised Evaluation Metrics for Multi-Document Summarization"

28 / 78 papers shown

Title
Recursively Summarizing Books with Human Feedback Jeff Wu Long Ouyang Daniel M. Ziegler Nissan Stiennon Ryan J. Lowe Jan Leike Paul Christiano ALM 35 296 0 22 Sep 2021
Perturbation CheckLists for Evaluating NLG Evaluation Metrics Ananya B. Sai Tanay Dixit D. Y. Sheth S. Mohan Mitesh M. Khapra AAML 116 58 0 13 Sep 2021
A Survey on Multi-modal Summarization Anubhav Jangra Sourajit Mukherjee Adam Jatowt S. Saha M. Hasanuzzaman 31 59 0 11 Sep 2021
A Training-free and Reference-free Summarization Evaluation Metric via Centrality-weighted Relevance and Self-referenced Redundancy Wang Chen Pijian Li Irwin King 19 22 0 26 Jun 2021
RewardsOfSum: Exploring Reinforcement Learning Rewards for Summarisation Jacob Parnell Inigo Jauregi Unanue Massimo Piccardi 28 5 0 08 Jun 2021
Re-evaluating Word Mover's Distance Ryoma Sato M. Yamada H. Kashima 36 23 0 30 May 2021
The statistical advantage of automatic NLG metrics at the system level Johnny Tian-Zheng Wei Robin Jia 15 23 0 26 May 2021
Towards Human-Free Automatic Quality Evaluation of German Summarization Neslihan Iskender Oleg V. Vasilyev Tim Polzehl John Bohannon Sebastian Möller 29 1 0 13 May 2021
Hone as You Read: A Practical Type of Interactive Summarization Tanner A. Bohn Charles X. Ling 14 9 0 06 May 2021
RefSum: Refactoring Neural Summarization Yixin Liu Zi-Yi Dou Pengfei Liu 24 40 0 15 Apr 2021
What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization Griffin Adams Emily Alsentzer Mert Ketenci Jason Zucker Noémie Elhadad 52 47 0 12 Apr 2021
Estimation of Summary-to-Text Inconsistency by Mismatched Embeddings Oleg V. Vasilyev John Bohannon HILM 31 7 0 12 Apr 2021
Play the Shannon Game With Language Models: A Human-Free Approach to Summary Evaluation Nicholas Egan Oleg V. Vasilyev John Bohannon HILM 13 18 0 19 Mar 2021
Exploring Supervised and Unsupervised Rewards in Machine Translation Julia Ive Zixu Wang M. Fomicheva Lucia Specia 16 2 0 22 Feb 2021
How to Evaluate a Summarizer: Study Design and Statistical Analysis for Manual Linguistic Quality Evaluation Julius Steen K. Markert ELM 25 13 0 27 Jan 2021
Is human scoring the best criteria for summary evaluation? Oleg V. Vasilyev John Bohannon 18 11 0 29 Dec 2020
FFCI: A Framework for Interpretable Automatic Evaluation of Summarization Fajri Koto Timothy Baldwin Jey Han Lau HILM 32 37 0 27 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey Congbo Ma W. Zhang Mingyu Guo Hu Wang Quan Z. Sheng 13 126 0 10 Nov 2020
Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries Daniel Deutsch Dan Roth 61 7 0 23 Oct 2020
Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation Yunpeng Ren Ziao Wang Yiyuan Wang Xiaofeng Zhang 22 9 0 23 Oct 2020
Semantically Driven Sentence Fusion: Modeling and Evaluation Eyal Ben-David Orgad Keller Eric Malmi Idan Szpektor Roi Reichart 16 5 0 06 Oct 2020
GRUEN for Evaluating Linguistic Quality of Generated Text Wanzheng Zhu S. Bhat 33 60 0 06 Oct 2020
Unsupervised Reference-Free Summary Quality Evaluation via Contrastive Learning Hanlu Wu Tengfei Ma Lingfei Wu Tariro Manyumwa S. Ji SSL 14 56 0 05 Oct 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 38 690 0 24 Jul 2020
SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling F. S. Bao Hebi Li Ge Luo Minghui Qiu Yinfei Yang Youbiao He Cen Chen 18 4 0 13 May 2020
Fill in the BLANC: Human-free quality estimation of document summaries Oleg V. Vasilyev Vedant Dharnidharka John Bohannon 3DH 42 116 0 23 Feb 2020
Interactive Text Ranking with Bayesian Optimisation: A Case Study on Community QA and Summarisation Edwin Simpson Yang Gao Iryna Gurevych BDL 13 10 0 22 Nov 2019
Knowledge-guided Unsupervised Rhetorical Parsing for Text Summarization Shengluan Hou R. Lu 8 16 0 14 Oct 2019