HighRES: Highlight-based Reference-less Evaluation of Summarization

4 June 2019

Papers citing "HighRES: Highlight-based Reference-less Evaluation of Summarization"

27 / 27 papers shown

Title
Summarizing Speech: A Comprehensive Survey Fabian Retkowski Maike Züfle Andreas Sudmann Dinah Pfau Jan Niehues Alexander Waibel Alexander H. Waibel 115 0 0 10 Apr 2025
Summarization Metrics for Spanish and Basque: Do Automatic Scores and LLM-Judges Correlate with Humans? Jeremy Barnes Naiara Perez Alba Bonet-Jover Begoña Altuna 104 2 0 21 Mar 2025
Lexical Repetitions Lead to Rote Learning: Unveiling the Impact of Lexical Overlap in Train and Test Reference Summaries Prafulla Kumar Choubey Alexander R. Fabbri Caiming Xiong Chien-Sheng Wu 82 2 0 15 Nov 2023
Redundancy Aware Multi-Reference Based Gainwise Evaluation of Extractive Summarization Mousumi Akter Shubhra (Santu) Karmaker 58 1 0 04 Aug 2023
An Investigation of Evaluation Metrics for Automated Medical Note Generation Asma Ben Abacha Wen-wai Yim George Michalopoulos Thomas Lin 67 23 0 27 May 2023
APPLS: Evaluating Evaluation Metrics for Plain Language Summarization Yue Guo Tal August Gondy Leroy T. Cohen Lucy Lu Wang 175 9 0 23 May 2023
LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization Kalpesh Krishna Erin Bransom Bailey Kuehl Mohit Iyyer Pradeep Dasigi Arman Cohan Kyle Lo 67 96 0 30 Jan 2023
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation Yixin Liu Alexander R. Fabbri Pengfei Liu Yilun Zhao Linyong Nan ... Simeng Han Shafiq Joty Chien-Sheng Wu Caiming Xiong Dragomir R. Radev ALM 86 134 0 15 Dec 2022
Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation Aleksandar Savkov Francesco Moramarco Alex Papadopoulos Korfiatis Mark Perera Anya Belz Ehud Reiter 30 7 0 17 Nov 2022
News Summarization and Evaluation in the Era of GPT-3 Tanya Goyal Junyi Jessy Li Greg Durrett ELM 124 411 0 26 Sep 2022
Multi-Narrative Semantic Overlap Task: Evaluation and Benchmark Naman Bansal Mousumi Akter Shubhra (Santu) Karmaker 75 0 0 14 Jan 2022
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries Xiangru Tang Alexander R. Fabbri Haoran Li Ziming Mao Griffin Adams Borui Wang Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 88 20 0 19 Sep 2021
VerbCL: A Dataset of Verbatim Quotes for Highlight Extraction in Case Law Julien Rossi Svitlana Vakulenko Evangelos Kanoulas AILaw 37 2 0 23 Aug 2021
Summary Explorer: Visualizing the State of the Art in Text Summarization S. Syed Tariq Yousef Khalid Al Khatib S. Jänicke Martin Potthast ELM 74 9 0 04 Aug 2021
Evaluating the Efficacy of Summarization Evaluation across Languages Fajri Koto Jey Han Lau Timothy Baldwin 108 19 0 02 Jun 2021
What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization Griffin Adams Emily Alsentzer Mert Ketenci Jason Zucker Noémie Elhadad 96 49 0 12 Apr 2021
How to Evaluate a Summarizer: Study Design and Statistical Analysis for Manual Linguistic Quality Evaluation Julius Steen K. Markert ELM 88 13 0 27 Jan 2021
GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation Daniel Khashabi Gabriel Stanovsky Jonathan Bragg Nicholas Lourie Jungo Kasai Yejin Choi Noah A. Smith Daniel S. Weld 131 21 0 17 Jan 2021
FFCI: A Framework for Interpretable Automatic Evaluation of Summarization Fajri Koto Timothy Baldwin Jey Han Lau HILM 107 37 0 27 Nov 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 142 724 0 24 Jul 2020
Understanding Points of Correspondence between Sentences for Abstractive Summarization Logan Lebanoff John Muchovej Franck Dernoncourt Doo Soon Kim Lidan Wang Walter Chang Fei Liu 65 28 0 10 Jun 2020
Artemis: A Novel Annotation Methodology for Indicative Single Document Summarization Rahul Jha Keping Bi Yang Li M. Pakdaman Asli Celikyilmaz Ivan Zhiboedov Kieran McDonald 36 2 0 05 May 2020
On Faithfulness and Factuality in Abstractive Summarization Joshua Maynez Shashi Narayan Bernd Bohnet Ryan T. McDonald HILM 98 1,048 0 02 May 2020
Fill in the BLANC: Human-free quality estimation of document summaries Oleg V. Vasilyev Vedant Dharnidharka John Bohannon 3DH 110 119 0 23 Feb 2020
Generating Representative Headlines for News Stories Xiaotao Gu Yuning Mao Jiawei Han Jialu Liu Hongkun Yu You Wu Cong Yu Daniel Finnie Jiaqi Zhai Nicholas Zukoski 108 70 0 26 Jan 2020
Facet-Aware Evaluation for Extractive Summarization Yuning Mao Liyuan Liu Qi Zhu Xiang Ren Jiawei Han CVBM 78 20 0 27 Aug 2019
What is this Article about? Extreme Summarization with Topic-aware Convolutional Neural Networks Shashi Narayan Shay B. Cohen Mirella Lapata AILaw 77 18 0 19 Jul 2019