QuestEval: Summarization Asks for Fact-based Evaluation

23 March 2021

Papers citing "QuestEval: Summarization Asks for Fact-based Evaluation"

31 / 181 papers shown

Title
InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning Prakhar Gupta Cathy Jiao Yi-Ting Yeh Shikib Mehri M. Eskénazi Jeffrey P. Bigham ALM 44 47 0 25 May 2022
MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification Yu Lu Liu Rachel Bawden Thomas Scaliom Benoît Sagot Jackie C.K. Cheung 35 4 0 24 May 2022
SQuALITY: Building a Long-Document Summarization Dataset the Hard Way Alex Jinpeng Wang Richard Yuanzhe Pang Angelica Chen Jason Phang Samuel R. Bowman 78 44 0 23 May 2022
FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization David Wan Joey Tianyi Zhou HILM 25 68 0 16 May 2022
Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets Philippe Laban Chien-Sheng Wu Wenhao Liu Caiming Xiong 41 5 0 13 May 2022
Masked Summarization to Generate Factually Inconsistent Summaries for Improved Factual Consistency Checking Hwanhee Lee Kang Min Yoo Joonsuk Park Hwaran Lee Kyomin Jung HILM 13 10 0 04 May 2022
Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code Daniel Deutsch Dan Roth AI4CE 45 2 0 29 Apr 2022
Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics Daniel Deutsch Dan Roth 17 4 0 21 Apr 2022
TRUE: Re-evaluating Factual Consistency Evaluation Or Honovich Roee Aharoni Jonathan Herzig Hagai Taitelbaum Doron Kukliansy Vered Cohen Thomas Scialom Idan Szpektor Avinatan Hassidim Yossi Matias HILM 35 3 0 11 Apr 2022
HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarization Shuyang Cao Lu Wang 70 36 0 21 Mar 2022
Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges Shikib Mehri Jinho Choi L. F. D’Haro Jan Deriu M. Eskénazi ... David Traum Yi-Ting Yeh Zhou Yu Yizhe Zhang Chen Zhang 34 21 0 18 Mar 2022
Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods Wei Li Wenhao Wu Moye Chen Jiachen Liu Xinyan Xiao Hua Wu HILM 29 27 0 10 Mar 2022
Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text Sebastian Gehrmann Elizabeth Clark Thibault Sellam ELM AI4CE 69 184 0 14 Feb 2022
Differentiable N-gram Objective on Abstractive Summarization Yunqi Zhu Xuebing Yang Yuanyuan Wu Mingjing Zhu Wensheng Zhang 35 5 0 08 Feb 2022
Survey of Hallucination in Natural Language Generation Ziwei Ji Nayeon Lee Rita Frieske Tiezheng Yu D. Su ... Delong Chen Wenliang Dai Ho Shu Chan Andrea Madotto Pascale Fung HILM LRM 79 2,248 0 08 Feb 2022
New Methods & Metrics for LFQA tasks Suchismit Mahapatra V. Blagojević P. Bertorello Prasanna Kumar 25 2 0 26 Dec 2021
Consistency and Coherence from Points of Contextual Similarity Oleg V. Vasilyev John Bohannon HILM 33 1 0 22 Dec 2021
CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuning Xiangru Tang Arjun Nair Borui Wang Bingyao Wang Jai Desai Aaron Wade Haoran Li Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 25 62 0 16 Dec 2021
QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarization Alexander R. Fabbri C. Wu Wenhao Liu Caiming Xiong HILM 22 208 0 16 Dec 2021
Does Structure Matter? Leveraging Data-to-Text Generation for Answering Complex Information Needs Hanane Djeddal Thomas Gerald Laure Soulier K. Pinel-Sauvagnat L. Tamine 27 1 0 08 Dec 2021
CO2Sum:Contrastive Learning for Factual-Consistent Abstractive Summarization Wei Liu Huanqin Wu Wenjing Mu Zhen Li Tao Chen Dan Nie HILM 14 17 0 02 Dec 2021
SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization Philippe Laban Tobias Schnabel Paul N. Bennett Marti A. Hearst HILM 16 379 0 18 Nov 2021
Incorporating Question Answering-Based Signals into Abstractive Summarization via Salient Span Selection Daniel Deutsch Dan Roth 12 6 0 15 Nov 2021
CaPE: Contrastive Parameter Ensembling for Reducing Hallucination in Abstractive Summarization Prafulla Kumar Choubey Alexander R. Fabbri Jesse Vig Chien-Sheng Wu Wenhao Liu Nazneen Rajani HILM 24 16 0 14 Oct 2021
CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization Shuyang Cao Lu Wang HILM 31 175 0 19 Sep 2021
Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation Yuexiang Xie Fei Sun Yang Deng Yaliang Li Bolin Ding HILM 26 53 0 30 Aug 2021
To Beam Or Not To Beam: That is a Question of Cooperation for Language GANs Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 29 19 0 11 Jun 2021
A Comprehensive Assessment of Dialog Evaluation Metrics Yi-Ting Yeh M. Eskénazi Shikib Mehri 36 105 0 07 Jun 2021
$$Q^{2}$: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering$ $Q^{2}$ : Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering Or Honovich Leshem Choshen Roee Aharoni Ella Neeman Idan Szpektor Omri Abend HILM 36 138 0 16 Apr 2021
Rethinking Automatic Evaluation in Sentence Simplification Thomas Scialom Louis Martin Jacopo Staiano Eric Villemonte de la Clergerie Benoît Sagot 30 29 0 15 Apr 2021
Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluation Clément Rebuffel Thomas Scialom Laure Soulier Benjamin Piwowarski Sylvain Lamprier Jacopo Staiano Geoffrey Scoutheeten Patrick Gallinari 21 30 0 15 Apr 2021