SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization

18 November 2021

ArXiv (abs)PDF HTML Github (94★)

Papers citing "SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization"

46 / 46 papers shown

Title
BAGELS: Benchmarking the Automated Generation and Extraction of Limitations from Scholarly Text Ibrahim Al Azher Miftahul Jannat Mokarrama Zhishuai Guo Sagnik Ray Choudhury Hamed Alhoori 57 0 0 22 May 2025
Explanatory Summarization with Discourse-Driven Planning Dongqi Liu Xi Yu Vera Demberg Mirella Lapata 98 1 0 27 Apr 2025
Summarization Metrics for Spanish and Basque: Do Automatic Scores and LLM-Judges Correlate with Humans? Jeremy Barnes Naiara Perez Alba Bonet-Jover Begoña Altuna 94 2 0 21 Mar 2025
Unequal Opportunities: Examining the Bias in Geographical Recommendations by Large Language Models Shiran Dudy Thulasi Tholeti R. Ramachandranpillai Muhammad Ali Toby Jia-Jun Li Ricardo Baeza-Yates 101 0 0 16 Mar 2025
Introducing Verification Task of Set Consistency with Set-Consistency Energy Networks Mooho Song Hyeryung Son Jay-Yoon Lee 87 0 0 12 Mar 2025
Bridging Legal Knowledge and AI: Retrieval-Augmented Generation with Vector Stores, Knowledge Graphs, and Hierarchical Non-negative Matrix Factorization Ryan Barron Maksim E. Eren Olga M. Serafimova Cynthia Matuszek Boian S. Alexandrov AILaw 107 1 0 27 Feb 2025
Learning to Summarize from LLM-generated Feedback Hwanjun Song Taewon Yun Yuho Lee Jihwan Oh Gihun Lee Jason (Jinglun) Cai Hang Su 212 9 0 28 Jan 2025
EventSum: A Large-Scale Event-Centric Summarization Dataset for Chinese Multi-News Documents Mengna Zhu Kaisheng Zeng Mao Wang Kaiming Xiao Lei Hou Hongbin Huang Juanzi Li 481 1 0 16 Dec 2024
Coverage-based Fairness in Multi-document Summarization Haoyuan Li Yusen Zhang Rui Zhang Snigdha Chaturvedi 154 0 0 11 Dec 2024
Decomposition Dilemmas: Does Claim Decomposition Boost or Burden Fact-Checking Performance? Qisheng Hu Quanyu Long Wenya Wang 378 9 0 17 Oct 2024
On A Scale From 1 to 5: Quantifying Hallucination in Faithfulness Evaluation Xiaonan Jing Srinivas Billa Danny Godbout HILM 104 0 0 16 Oct 2024
LLMs Know More Than They Show: On the Intrinsic Representation of LLM Hallucinations Hadas Orgad Michael Toker Zorik Gekhman Roi Reichart Idan Szpektor Hadas Kotek Yonatan Belinkov HILM AIFin 99 43 0 03 Oct 2024
STORYSUMM: Evaluating Faithfulness in Story Summarization Melanie Subbiah Faisal Ladhak Akankshya Mishra Griffin Adams Lydia B. Chilton Kathleen McKeown 106 4 0 09 Jul 2024
Can LLMs Solve longer Math Word Problems Better? Xin Xu Tong Xiao Zitong Chao Zhenya Huang Can Yang Yang Wang 108 14 0 23 May 2024
A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods Hanlei Jin Yang Zhang Dan Meng Jun Wang Jinghua Tan 225 92 0 05 Mar 2024
GenAudit: Fixing Factual Errors in Language Model Outputs with Evidence Kundan Krishna S. Ramprasad Prakhar Gupta Byron C. Wallace Zachary Chase Lipton Jeffrey P. Bigham HILM KELM SyDa 103 9 0 19 Feb 2024
Can We Verify Step by Step for Incorrect Answer Detection? Xin Xu Shizhe Diao Can Yang Yang Wang LRM 232 15 0 16 Feb 2024
Keep it Simple: Unsupervised Simplification of Multi-Paragraph Text Philippe Laban Tobias Schnabel Paul N. Bennett Marti A. Hearst 50 60 0 07 Jul 2021
Improving Factual Consistency of Abstractive Summarization via Question Answering Feng Nan Cicero Nogueira dos Santos Henghui Zhu Patrick Ng Kathleen McKeown Ramesh Nallapati Dejiao Zhang Zhiguo Wang Andrew O. Arnold Bing Xiang HILM 61 84 0 10 May 2021
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics Artidoro Pagnoni Vidhisha Balachandran Yulia Tsvetkov HILM 273 310 0 27 Apr 2021
SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text Summarization Jesse Vig Wojciech Kry'sciñski Karan Goel Nazneen Rajani 54 22 0 15 Apr 2021
QuestEval: Summarization Asks for Fact-based Evaluation Thomas Scialom Paul-Alexis Dray Patrick Gallinari Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano Alex Jinpeng Wang HILM 59 275 0 23 Mar 2021
Get Your Vitamin C! Robust Fact Verification with Contrastive Evidence Tal Schuster Adam Fisch Regina Barzilay 82 234 0 15 Mar 2021
Evaluating Factuality in Generation with Dependency-level Entailment Tanya Goyal Greg Durrett 104 151 0 12 Oct 2020
What Have We Achieved on Text Summarization? Dandan Huang Leyang Cui Sen Yang Guangsheng Bao Kun Wang Jun Xie Yue Zhang 104 109 0 09 Oct 2020
Multi-Fact Correction in Abstractive Text Summarization Yue Dong Shuohang Wang Zhe Gan Yu Cheng Jackie C.K. Cheung Jingjing Liu KELM HILM 86 119 0 06 Oct 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 97 713 0 24 Jul 2020
FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization Esin Durmus He He Mona T. Diab HILM 91 395 0 07 May 2020
On Faithfulness and Factuality in Abstractive Summarization Joshua Maynez Shashi Narayan Bernd Bohnet Ryan T. McDonald HILM 81 1,035 0 02 May 2020
TLDR: Extreme Summarization of Scientific Documents Isabel Cachola Kyle Lo Arman Cohan Daniel S. Weld 110 217 0 30 Apr 2020
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization Jingqing Zhang Yao-Min Zhao Mohammad Saleh Peter J. Liu RALM 3DGS 285 2,049 0 18 Dec 2019
Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reports Yuhao Zhang Derek Merck E. Tsai Christopher D. Manning C. Langlotz MedIm HILM 54 185 0 06 Nov 2019
Adversarial NLI: A New Benchmark for Natural Language Understanding Yixin Nie Adina Williams Emily Dinan Joey Tianyi Zhou Jason Weston Douwe Kiela 125 1,006 0 31 Oct 2019
Evaluating the Factual Consistency of Abstractive Text Summarization Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher HILM 106 744 0 28 Oct 2019
BillSum: A Corpus for Automatic Summarization of US Legislation Anastassia Kornilova Vladimir Eidelman AILaw 60 156 0 01 Oct 2019
Answers Unite! Unsupervised Metrics for Reinforced Summarization Models Thomas Scialom Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 73 149 0 04 Sep 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 665 24,464 0 26 Jul 2019
Assessing The Factual Accuracy of Generated Text Ben Goodrich Vinay Rao Mohammad Saleh Peter J. Liu HILM 93 188 0 30 May 2019
Guiding Extractive Summarization with Question-Answering Rewards Kristjan Arumae Fei Liu 69 34 0 04 Apr 2019
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Shashi Narayan Shay B. Cohen Mirella Lapata AILaw 134 1,676 0 27 Aug 2018
Multi-Reward Reinforced Summarization with Saliency and Entailment Ramakanth Pasunuru Joey Tianyi Zhou 59 201 0 17 Apr 2018
FEVER: a large-scale dataset for Fact Extraction and VERification James Thorne Andreas Vlachos Christos Christodoulopoulos Arpit Mittal HILM 148 1,657 0 14 Mar 2018
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 524 4,479 0 18 Apr 2017
A Decomposable Attention Model for Natural Language Inference Ankur P. Parikh Oscar Täckström Dipanjan Das Jakob Uszkoreit 343 1,375 0 06 Jun 2016
Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyond Ramesh Nallapati Bowen Zhou Cicero Nogueira dos Santos Çağlar Gülçehre Bing Xiang AIMat 264 2,557 0 19 Feb 2016
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 321 4,287 0 21 Aug 2015