Towards Question-Answering as an Automatic Metric for Evaluating the
Content Quality of a Summary

v1v2v3 (latest)

Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary

1 October 2020

Tania Bedrax-Weiss

ArXiv (abs)PDF HTML

Papers citing "Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary"

16 / 66 papers shown

Title
Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics Daniel Deutsch Dan Roth 88 4 0 21 Apr 2022
Learning to Revise References for Faithful Summarization Griffin Adams Han-Chin Shing Q. Sun C. Winestock Kathleen McKeown Noémie Elhadad 96 33 0 13 Apr 2022
TRUE: Re-evaluating Factual Consistency Evaluation Or Honovich Roee Aharoni Jonathan Herzig Hagai Taitelbaum Doron Kukliansy Vered Cohen Thomas Scialom Idan Szpektor Avinatan Hassidim Yossi Matias HILM 86 4 0 11 Apr 2022
Evaluation of Automatic Text Summarization using Synthetic Facts J. Ahn Foaad Khosmood HILM 53 0 0 11 Apr 2022
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text Sebastian Gehrmann Elizabeth Clark Thibault Sellam ELM AI4CE 157 193 0 14 Feb 2022
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization Alexander R. Fabbri Chien-Sheng Wu Wenhao Liu Caiming Xiong HILM 110 219 0 16 Dec 2021
Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection Daniel Deutsch Dan Roth 97 7 0 15 Nov 2021
Training Dynamics for Text Summarization Models Tanya Goyal Jiacheng Xu Junjie Li Greg Durrett 135 32 0 15 Oct 2021
Finding a Balanced Degree of Automation for Summary Evaluation Shiyue Zhang Joey Tianyi Zhou 117 44 0 23 Sep 2021
Improving Faithfulness in Abstractive Summarization with Contrast Candidate Generation and Selection Sihao Chen Fan Zhang Kazoo Sone Dan Roth HILM 100 108 0 19 Apr 2021
What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization Griffin Adams Emily Alsentzer Mert Ketenci Jason Zucker Noémie Elhadad 102 49 0 12 Apr 2021
Estimation of Summary-to-Text Inconsistency by Mismatched Embeddings Oleg V. Vasilyev John Bohannon HILM 40 7 0 12 Apr 2021
LazyDAgger: Reducing Context Switching in Interactive Imitation Learning Ryan Hoque Ashwin Balakrishna Carl Putterman Michael Luo Daniel S. Brown Daniel Seita Brijen Thananjeyan Ellen R. Novoseller Ken Goldberg 164 54 0 31 Mar 2021
Is human scoring the best criteria for summary evaluation? Oleg V. Vasilyev John Bohannon 41 11 0 29 Dec 2020
Summary-Oriented Question Generation for Informational Queries Xusen Yin Li Zhou Kevin Small Jonathan May 74 3 0 19 Oct 2020
SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metrics Daniel Deutsch Dan Roth 102 26 0 10 Jul 2020