Evaluating the Factual Consistency of Abstractive Text Summarization

28 October 2019

Papers citing "Evaluating the Factual Consistency of Abstractive Text Summarization"

50 / 463 papers shown

Title
Are LLM-based Evaluators Confusing NLG Quality Criteria? Xinyu Hu Mingqi Gao Sen Hu Yang Zhang Yicheng Chen Teng Xu Xiaojun Wan AAML ELM 49 22 0 19 Feb 2024
Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs Jiejun Tan Zhicheng Dou Yutao Zhu Peidong Guo Kun Fang Ji-Rong Wen 49 25 0 19 Feb 2024
DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detection Herun Wan Shangbin Feng Zhaoxuan Tan Heng Wang Yulia Tsvetkov Minnan Luo 72 29 0 16 Feb 2024
InstructGraph: Boosting Large Language Models via Graph-centric Instruction Tuning and Preference Alignment Jianing Wang Junda Wu Yupeng Hou Yao Liu Ming Gao Julian McAuley 35 32 0 13 Feb 2024
Improving Factual Error Correction for Abstractive Summarization via Data Distillation and Conditional-generation Cloze Yiyang Li Lei Li Dingxing Hu Xueyi Hao Marina Litvak N. Vanetik Yanquan Zhou HILM KELM 24 0 0 13 Feb 2024
Plausible Extractive Rationalization through Semi-Supervised Entailment Signal Yeo Wei Jie Ranjan Satapathy Min Zhang 19 5 0 13 Feb 2024
Merging Facts, Crafting Fallacies: Evaluating the Contradictory Nature of Aggregated Factual Claims in Long-Form Generations Cheng-Han Chiang Hung-yi Lee HILM 75 8 0 08 Feb 2024
Source Identification in Abstractive Summarization Yoshi Suhara Dimitris Alikaniotis 38 2 0 07 Feb 2024
Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains S. Ramprasad Kundan Krishna Zachary Chase Lipton Byron C. Wallace HILM 52 6 0 05 Feb 2024
Unified Hallucination Detection for Multimodal Large Language Models Xiang Chen Chenxi Wang Yida Xue Ningyu Zhang Xiaoyan Yang Qian Li Yue Shen Lei Liang Jinjie Gu Huajun Chen HILM 36 38 0 05 Feb 2024
PRE: A Peer Review Based Large Language Model Evaluator Zhumin Chu Qingyao Ai Yiteng Tu Haitao Li Yiqun Liu LRM ALM 41 21 0 28 Jan 2024
Are self-explanations from Large Language Models faithful? Andreas Madsen Sarath Chandar Siva Reddy LRM 30 25 0 15 Jan 2024
Inroads to a Structured Data Natural Language Bijection and the role of LLM annotation Blake Vente 26 0 0 14 Jan 2024
The Critique of Critique Shichao Sun Junlong Li Weizhe Yuan Ruifeng Yuan Wenjie Li Pengfei Liu ELM 40 0 0 09 Jan 2024
Do Androids Know They're Only Dreaming of Electric Sheep? Sky CH-Wang Benjamin Van Durme Jason Eisner Chris Kedzie HILM 35 27 0 28 Dec 2023
DelucionQA: Detecting Hallucinations in Domain-specific Question Answering Mobashir Sadat Zhengyu Zhou Lukas Lange Jun Araki Arsalan Gundroo Bingqing Wang Rakesh R Menon Md. Rizwan Parvez Zhe Feng HILM 37 37 0 08 Dec 2023
CODEX: A Cluster-Based Method for Explainable Reinforcement Learning Timothy K. Mathes Jessica Inman Andrés Colón Simon Khan OffRL 19 1 0 07 Dec 2023
Building Trustworthy NeuroSymbolic AI Systems: Consistency, Reliability, Explainability, and Safety Manas Gaur Amit P. Sheth 26 17 0 05 Dec 2023
Prompted Zero-Shot Multi-label Classification of Factual Incorrectness in Machine-Generated Summaries Aniket Deroy Subhankar Maity Saptarshi Ghosh 27 5 0 02 Dec 2023
Zero-shot Conversational Summarization Evaluations with small Large Language Models R. Manuvinakurike Saurav Sahay Sangeeta Manepalli L. Nachman ELM LM&MA 30 0 0 29 Nov 2023
Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus Tianhang Zhang Lin Qiu Qipeng Guo Cheng Deng Yue Zhang Zheng-Wei Zhang Cheng Zhou Xinbing Wang Luoyi Fu HILM 77 49 0 22 Nov 2023
Responsible AI Considerations in Text Summarization Research: A Review of Current Practices Yu Lu Liu Meng Cao Su Lin Blodgett Jackie Chi Kit Cheung Alexandra Olteanu Adam Trischler 36 1 0 18 Nov 2023
PELMS: Pre-training for Effective Low-Shot Multi-Document Summarization Joseph Peper Wenzhao Qiu Lu Wang 28 0 0 16 Nov 2023
P^3SUM: Preserving Author's Perspective in News Summarization with Diffusion Language Models Yuhan Liu Shangbin Feng Xiaochuang Han Vidhisha Balachandran Chan Young Park Sachin Kumar Yulia Tsvetkov DiffM 44 2 0 16 Nov 2023
AMRFact: Enhancing Summarization Factuality Evaluation with AMR-Driven Negative Samples Generation Haoyi Qiu Kung-Hsiang Huang Jingnong Qu Nanyun Peng HILM 28 6 0 16 Nov 2023
Think While You Write: Hypothesis Verification Promotes Faithful Knowledge-to-Text Generation Yifu Qiu Varun R. Embar Shay B. Cohen Benjamin Han 29 4 0 16 Nov 2023
Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization G. Chrysostomou Zhixue Zhao Miles Williams Nikolaos Aletras HILM 34 10 0 15 Nov 2023
Fair Abstractive Summarization of Diverse Perspectives Yusen Zhang Nan Zhang Yixin Liu Alexander R. Fabbri Junru Liu ... Caiming Xiong Jieyu Zhao Dragomir R. Radev Kathleen McKeown Rui Zhang 38 8 0 14 Nov 2023
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models Shangqing Tu Yuliang Sun Yushi Bai Jifan Yu Lei Hou Juanzi Li WaLM 35 9 0 13 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 56 744 0 09 Nov 2023
Are NLP Models Good at Tracing Thoughts: An Overview of Narrative Understanding Lixing Zhu Runcong Zhao Lin Gui Yulan He 52 4 0 28 Oct 2023
Correction with Backtracking Reduces Hallucination in Summarization Zhenzhen Liu Chao-gang Wan Varsha Kishore Jin Peng Zhou Minmin Chen Kilian Q. Weinberger HILM 26 3 0 24 Oct 2023
Hallucination Detection for Grounded Instruction Generation Lingjun Zhao Khanh Nguyen Hal Daumé HILM 39 7 0 23 Oct 2023
Language Models Hallucinate, but May Excel at Fact Verification Jian Guan Jesse Dodge David Wadden Minlie Huang Hao Peng LRM HILM 40 28 0 23 Oct 2023
Text Fact Transfer Nishant Balepur Jie Huang Kevin Chen-Chuan Chang 30 0 0 23 Oct 2023
From Chaos to Clarity: Claim Normalization to Empower Fact-Checking Megha Sundriyal Tanmoy Chakraborty Preslav Nakov 23 14 0 22 Oct 2023
LUNA: A Model-Based Universal Analysis Framework for Large Language Models Da Song Xuan Xie Jiayang Song Derui Zhu Yuheng Huang Felix Juefei Xu Lei Ma ALM 40 3 0 22 Oct 2023
RTSUM: Relation Triple-based Interpretable Summarization with Multi-level Salience Visualization Seonglae Cho Yonggi Cho HoonJae Lee Myungha Jang Jinyoung Yeo Dongha Lee 27 0 0 21 Oct 2023
Fast and Accurate Factual Inconsistency Detection Over Long Documents B. Lattimer Patrick Chen Xinyuan Zhang Yi Yang HILM 6 18 0 19 Oct 2023
FactCHD: Benchmarking Fact-Conflicting Hallucination Detection Xiang Chen Duanzheng Song Honghao Gui Chengxi Wang Ningyu Zhang Jiang Yong Yan Zhang Chengfei Lv Dan Zhang Huajun Chen HILM 35 14 0 18 Oct 2023
Zero-shot Faithfulness Evaluation for Text Summarization with Foundation Language Model Qi Jia Siyu Ren Yizhu Liu Kenny Q. Zhu ALM HILM 33 16 0 18 Oct 2023
Factored Verification: Detecting and Reducing Hallucination in Summaries of Academic Papers Charlie George Andreas Stuhlmuller HILM 28 5 0 16 Oct 2023
Generating Summaries with Controllable Readability Levels Leonardo F. R. Ribeiro Mohit Bansal Markus Dreyer 80 19 0 16 Oct 2023
Metric Ensembles For Hallucination Detection Grant C. Forbes Parth Katlana Zeydy Ortiz HILM 41 4 0 16 Oct 2023
Character-LLM: A Trainable Agent for Role-Playing Yunfan Shao Linyang Li Junqi Dai Xipeng Qiu LLMAG 22 216 0 16 Oct 2023
"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letters Yixin Wan George Pu Jiao Sun Aparna Garimella Kai-Wei Chang Nanyun Peng 34 163 0 13 Oct 2023
Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignment Boyang Xue Weichao Wang Hongru Wang Fei Mi Rui Wang Yasheng Wang Lifeng Shang Xin Jiang Qun Liu Kam-Fai Wong KELM HILM 227 15 0 12 Oct 2023
Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators Liang Chen Yang Deng Yatao Bian Zeyu Qin Bingzhe Wu Tat-Seng Chua Kam-Fai Wong HILM ELM 65 42 0 11 Oct 2023
Chain of Natural Language Inference for Reducing Large Language Model Ungrounded Hallucinations Deren Lei Yaxi Li Mengya Hu Mingyu Wang Vincent Yun Emily Ching Eslam Kamal HILM LRM 24 40 0 06 Oct 2023
Quantifying the Plausibility of Context Reliance in Neural Machine Translation Gabriele Sarti Grzegorz Chrupala Malvina Nissim Arianna Bisazza 42 5 0 02 Oct 2023