What are the Desired Characteristics of Calibration Sets? Identifying
Correlates on Long Form Scientific Summarization

What are the Desired Characteristics of Calibration Sets? Identifying Correlates on Long Form Scientific Summarization

12 May 2023

Bichlien H. Nguyen

Anna Ostropolets

Tristan Naumann

Noémie Elhadad

Papers citing "What are the Desired Characteristics of Calibration Sets? Identifying Correlates on Long Form Scientific Summarization"

15 / 15 papers shown

Title
On Positional Bias of Faithfulness for Long-form Summarization David Wan Jesse Vig Mohit Bansal Shafiq R. Joty HILM 48 3 0 31 Oct 2024
Overview of the First Shared Task on Clinical Text Generation: RRG24 and "Discharge Me!" Justin Xu Zhihong Chen Andrew Johnston Louis Blankemeier Maya Varma ... Ankit Modi Robert Lloyd Benjamin Hopkins Curtis Langlotz Jean-Benoit Delbrouck LM&MA 36 25 0 25 Sep 2024
Fine-Grained Natural Language Inference Based Faithfulness Evaluation for Diverse Summarisation Tasks Huajian Zhang Yumo Xu Laura Perez-Beltrachini HILM 29 9 0 27 Feb 2024
SPEER: Sentence-Level Planning of Long Clinical Summaries via Embedded Entity Retrieval Griffin Adams Jason Zucker Noémie Elhadad 24 4 0 04 Jan 2024
Generating EDU Extracts for Plan-Guided Summary Re-Ranking Griffin Adams Alexander R. Fabbri Faisal Ladhak Kathleen McKeown Noémie Elhadad 18 10 0 28 May 2023
A Meta-Evaluation of Faithfulness Metrics for Long-Form Hospital-Course Summarization Griffin Adams Jason Zucker Noémie Elhadad 48 22 0 07 Mar 2023
Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarization Shiyue Zhang David Wan Mohit Bansal HILM 52 27 0 08 Sep 2022
PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization Wen Xiao Iz Beltagy Giuseppe Carenini Arman Cohan CVBM 81 114 0 16 Oct 2021
Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarization Bharath Chintagunta Namit Katariya X. Amatriain Anitha Kannan LM&MA MedIm 125 148 0 09 Sep 2021
Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics Artidoro Pagnoni Vidhisha Balachandran Yulia Tsvetkov HILM 225 305 0 27 Apr 2021
What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarization Griffin Adams Emily Alsentzer Mert Ketenci Jason Zucker Noémie Elhadad 44 46 0 12 Apr 2021
Entity-level Factual Consistency of Abstractive Text Summarization Feng Nan Ramesh Nallapati Zhiguo Wang Cicero Nogueira dos Santos Henghui Zhu Dejiao Zhang Kathleen McKeown Bing Xiang HILM 142 157 0 18 Feb 2021
Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation Alexander R. Fabbri Simeng Han Haoyuan Li Haoran Li Marjan Ghazvininejad Shafiq R. Joty Dragomir R. Radev Yashar Mehdad 123 95 0 24 Oct 2020
Factual Error Correction for Abstractive Summarization Models Mengyao Cao Yue Dong Jiapeng Wu Jackie C.K. Cheung HILM KELM 169 159 0 17 Oct 2020
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages Peng Qi Yuhao Zhang Yuhui Zhang Jason Bolton Christopher D. Manning AI4TS 204 1,653 0 16 Mar 2020