Evaluating the Factual Consistency of Abstractive Text Summarization

28 October 2019

Papers citing "Evaluating the Factual Consistency of Abstractive Text Summarization"

50 / 463 papers shown

Title
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization Alexander R. Fabbri C. Wu Wenhao Liu Caiming Xiong HILM 22 208 0 16 Dec 2021
Massive-scale Decoding for Text Generation using Lattices Jiacheng Xu Siddhartha Reddy Jonnalagadda Greg Durrett AI4CE 35 8 0 14 Dec 2021
SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization Philippe Laban Tobias Schnabel Paul N. Bennett Marti A. Hearst HILM 16 379 0 18 Nov 2021
How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN R. Thomas McCoy P. Smolensky Tal Linzen Jianfeng Gao Asli Celikyilmaz SyDa 25 119 0 18 Nov 2021
Template Filling for Controllable Commonsense Reasoning Dheeraj Rajagopal Vivek Khetan Bogdan Sacaleanu A. Gershman Andy E. Fano Eduard H. Hovy BDL LRM 25 6 0 31 Oct 2021
TODSum: Task-Oriented Dialogue Summarization with State Tracking Lulu Zhao Fujia Zheng Keqing He Weihao Zeng Yuejie Lei Huixing Jiang Wei Wu Weiran Xu Jun Guo Fanyu Meng 42 23 0 25 Oct 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 29 45 0 16 Oct 2021
Training Dynamics for Text Summarization Models Tanya Goyal Jiacheng Xu Junjie Li Greg Durrett 63 29 0 15 Oct 2021
CaPE: Contrastive Parameter Ensembling for Reducing Hallucination in Abstractive Summarization Prafulla Kumar Choubey Alexander R. Fabbri Jesse Vig Chien-Sheng Wu Wenhao Liu Nazneen Rajani HILM 24 16 0 14 Oct 2021
Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generation Sashank Santhanam Behnam Hedayatnia Spandana Gella Aishwarya Padmakumar Seokhwan Kim Yang Liu Dilek Z. Hakkani-Tür 26 35 0 11 Oct 2021
Explainable Fact-checking through Question Answering Jing Yang D. Vega-Oliveros Taís Seibt Anderson de Rezende Rocha HILM 27 14 0 11 Oct 2021
Controllable Neural Dialogue Summarization with Personal Named Entity Planning Zhengyuan Liu Nancy F. Chen 27 62 0 27 Sep 2021
Exploring Decomposition for Table-based Fact Verification Xiaoyu Yang Xiao-Dan Zhu ReLM 50 22 0 22 Sep 2021
CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization Shuyang Cao Lu Wang HILM 31 175 0 19 Sep 2021
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries Xiangru Tang Alexander R. Fabbri Haoran Li Ziming Mao Griffin Adams Borui Wang Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 13 19 0 19 Sep 2021
Does Summary Evaluation Survive Translation to Other Languages? Neslihan Iskender Oleg V. Vasilyev Neslihan Iskender John Bohannon 32 3 0 16 Sep 2021
RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization Chen An Ming Zhong Zhichao Geng Jianqiang Yang Xipeng Qiu RALM 20 23 0 16 Sep 2021
Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language Generation Mingkai Deng Bowen Tan Zhengzhong Liu Eric Xing Zhiting Hu 16 73 0 14 Sep 2021
Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarization Bharath Chintagunta Namit Katariya X. Amatriain Anitha Kannan LM&MA MedIm 134 149 0 09 Sep 2021
Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization Faisal Ladhak Esin Durmus He He Claire Cardie Kathleen McKeown 14 64 0 31 Aug 2021
Hallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive Summarization Mengyao Cao Yue Dong Jackie C.K. Cheung HILM 186 146 0 30 Aug 2021
Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation Yuexiang Xie Fei Sun Yang Deng Yaliang Li Bolin Ding HILM 26 53 0 30 Aug 2021
ComSum: Commit Messages Summarization and Meaning Preservation Leshem Choshen Idan Amit 17 4 0 23 Aug 2021
Accurate, yet inconsistent? Consistency Analysis on Language Understanding Models Myeongjun Jang D. Kwon Thomas Lukasiewicz 38 13 0 15 Aug 2021
MeetSum: Transforming Meeting Transcript Summarization using Transformers! Nima Sadri Bohan Zhang Bihan Liu 13 1 0 13 Aug 2021
Evaluating the Tradeoff Between Abstractiveness and Factuality in Abstractive Summarization Markus Dreyer Mengwen Liu Feng Nan Sandeep Atluri Sujith Ravi HILM 54 16 0 05 Aug 2021
Summary Explorer: Visualizing the State of the Art in Text Summarization S. Syed Tariq Yousef Khalid Al Khatib S. Jänicke Martin Potthast ELM 9 9 0 04 Aug 2021
Logic-Consistency Text Generation from Semantic Parses Chang Shu Yusen Zhang Xiangyu Dong Peng Shi Tao Yu Rui Zhang 30 34 0 02 Aug 2021
Keep it Simple: Unsupervised Simplification of Multi-Paragraph Text Philippe Laban Tobias Schnabel Paul N. Bennett Marti A. Hearst 21 60 0 07 Jul 2021
Improving Factual Consistency of Abstractive Summarization on Customer Feedback Yang Liu Yifei Sun Vincent Gao HILM 18 6 0 30 Jun 2021
BARTScore: Evaluating Generated Text as Text Generation Weizhe Yuan Graham Neubig Pengfei Liu 50 809 0 22 Jun 2021
How well do you know your summarization datasets? Priyam Tejaswin Dhruv Naik Peng Liu 33 26 0 21 Jun 2021
DocNLI: A Large-scale Dataset for Document-level Natural Language Inference Wenpeng Yin Dragomir R. Radev Caiming Xiong HILM 26 96 0 17 Jun 2021
Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluation Prakhar Gupta Yulia Tsvetkov Jeffrey P. Bigham 42 22 0 10 Jun 2021
AgreeSum: Agreement-Oriented Multi-Document Summarization Richard Yuanzhe Pang Á. Lelkes Vinh Q. Tran Cong Yu 13 16 0 04 Jun 2021
To Point or Not to Point: Understanding How Abstractive Summarizers Paraphrase Text Matthew Wilber William Timkey Marten van Schijndel 24 8 0 03 Jun 2021
Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution Jiacheng Xu Greg Durrett 38 16 0 03 Jun 2021
Question-aware Transformer Models for Consumer Health Question Summarization S. Yadav D. Gupta Asma Ben Abacha Dina Demner-Fushman ELM MedIm 31 28 0 01 Jun 2021
Focus Attention: Promoting Faithfulness and Diversity in Summarization Rahul Aralikatte Shashi Narayan Joshua Maynez S. Rothe Ryan T. McDonald 35 45 0 25 May 2021
Should We Trust This Summary? Bayesian Abstractive Summarization to The Rescue Alexios Gidiotis Grigorios Tsoumakas UQCV UD BDL 22 9 0 21 May 2021
DialogSum: A Real-Life Scenario Dialogue Summarization Dataset Yulong Chen Yang Liu Liang Chen Yue Zhang 42 224 0 14 May 2021
Improving Factual Consistency of Abstractive Summarization via Question Answering Feng Nan Cicero Nogueira dos Santos Henghui Zhu Patrick Ng Kathleen McKeown Ramesh Nallapati Dejiao Zhang Zhiguo Wang Andrew O. Arnold Bing Xiang HILM 14 82 0 10 May 2021
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark Nouha Dziri Hannah Rashkin Tal Linzen David Reitter ALM 206 79 0 30 Apr 2021
The Factual Inconsistency Problem in Abstractive Text Summarization: A Survey Yi-Chong Huang Xiachong Feng Xiaocheng Feng Bing Qin HILM 136 105 0 30 Apr 2021
Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior Notes Han-Chin Shing Chaitanya P. Shivade Nima Pourdamghani Feng Nan Philip Resnik Douglas W. Oard Parminder Bhatia 60 24 0 27 Apr 2021
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics Artidoro Pagnoni Vidhisha Balachandran Yulia Tsvetkov HILM 233 306 0 27 Apr 2021
Improving Faithfulness in Abstractive Summarization with Contrast Candidate Generation and Selection Sihao Chen Fan Zhang Kazoo Sone Dan Roth HILM 47 104 0 19 Apr 2021
Learning with Instance Bundles for Reading Comprehension Dheeru Dua Pradeep Dasigi Sameer Singh Matt Gardner 37 11 0 18 Apr 2021
Can NLI Models Verify QA Systems' Predictions? Jifan Chen Eunsol Choi Greg Durrett 28 54 0 18 Apr 2021
A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation Tianyu Liu Yizhe Zhang Chris Brockett Yi Mao Zhifang Sui Weizhu Chen W. Dolan HILM 228 144 0 18 Apr 2021