Benchmarking Large Language Models for News Summarization

31 January 2023

Tianyi Zhang

Faisal Ladhak

Esin Durmus

Percy Liang

Kathleen McKeown

Tatsunori B. Hashimoto

ELM

ArXiv PDF HTML

Papers citing "Benchmarking Large Language Models for News Summarization"

50 / 300 papers shown

Title
A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates Raphael Milliere Cameron Buckner LRM ELM 41 20 0 08 Jan 2024
Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache Bin Lin Chen Zhang Tao Peng Hanyu Zhao Wencong Xiao ... Shen Li Zhigang Ji Tao Xie Yong Li Wei Lin 44 46 0 05 Jan 2024
SPEER: Sentence-Level Planning of Long Clinical Summaries via Embedded Entity Retrieval Griffin Adams Jason Zucker Noémie Elhadad 29 4 0 04 Jan 2024
Revisiting Zero-Shot Abstractive Summarization in the Era of Large Language Models from the Perspective of Position Bias Anshuman Chhabra Hadi Askari Prasant Mohapatra 23 15 0 03 Jan 2024
Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic Procrastination Ananya Bhattacharjee Yuchen Zeng Sarah Yi Xu Dana Kulzhabayeva Minyi Ma ... A. Mariakakis Mary P Czerwinski Anastasia Kuzminykh Michael Liut Joseph Jay Williams AI4Ed 24 25 0 21 Dec 2023
ECAMP: Entity-centered Context-aware Medical Vision Language Pre-training Rongsheng Wang Qingsong Yao Haoran Lai Zhiyang He Xiaodong Tao Zihang Jiang S.Kevin Zhou VLM MedIm 49 6 0 20 Dec 2023
Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectives Chen Gao Xiaochong Lan Nian Li Yuan Yuan Jingtao Ding Zhilun Zhou Fengli Xu Yong Li LLMAG AI4CE LM&Ro 41 105 0 19 Dec 2023
A Survey of Text Watermarking in the Era of Large Language Models Aiwei Liu Leyi Pan Yijian Lu Jingjing Li Xuming Hu Xi Zhang Lijie Wen Irwin King Hui Xiong Philip S. Yu WaLM 43 51 0 13 Dec 2023
Unsupervised Extractive Summarization with Learnable Length Control Strategies Renlong Jie Xiaojun Meng Xin Jiang Qun Liu 32 1 0 12 Dec 2023
LLM-TAKE: Theme Aware Keyword Extraction Using Large Language Models Reza Yousefi Maragheh Chenhao Fang Charan Chand Irugu Parth Parikh Jason H. D. Cho ... Saranyan Sukumar Malay Patel Evren Körpeoglu Sushant Kumar Kannan Achan 30 6 0 01 Dec 2023
Zero-shot Conversational Summarization Evaluations with small Large Language Models R. Manuvinakurike Saurav Sahay Sangeeta Manepalli L. Nachman ELM LM&MA 22 0 0 29 Nov 2023
ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up? Hailin Chen Fangkai Jiao Xingxuan Li Chengwei Qin Mathieu Ravaut Ruochen Zhao Caiming Xiong Shafiq R. Joty ELM CLL AI4MH LRM ALM 85 27 0 28 Nov 2023
Graph Prompt Learning: A Comprehensive Survey and Beyond Xiangguo Sun Jiawen Zhang Xixi Wu Hong Cheng Yun Xiong Jia Li 25 52 0 28 Nov 2023
Cognitive Overload: Jailbreaking Large Language Models with Overloaded Logical Thinking Nan Xu Fei Wang Ben Zhou Bangzheng Li Chaowei Xiao Muhao Chen 32 55 0 16 Nov 2023
Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization G. Chrysostomou Zhixue Zhao Miles Williams Nikolaos Aletras HILM 34 10 0 15 Nov 2023
Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization Yixin Liu Alexander R. Fabbri Jiawen Chen Yilun Zhao Simeng Han Shafiq R. Joty Pengfei Liu Dragomir R. Radev Chien-Sheng Wu Arman Cohan ELM 46 58 0 15 Nov 2023
ContraDoc: Understanding Self-Contradictions in Documents with Large Language Models Jierui Li Vipul Raheja Dhruv Kumar SyDa 34 3 0 15 Nov 2023
A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Texts Nafis Irtiza Tripto Saranya Venkatraman Dominik Macko Robert Moro Ivan Srba Adaku Uchendu Thai V. Le Dongwon Lee DeLMO 35 17 0 14 Nov 2023
How You Prompt Matters! Even Task-Oriented Constraints in Instructions Affect LLM-Generated Text Detection Ryuto Koike Masahiro Kaneko Naoaki Okazaki DeLMO 21 6 0 14 Nov 2023
On-the-Fly Fusion of Large Language Models and Machine Translation Hieu T. Hoang Huda Khayrallah Marcin Junczys-Dowmunt 33 3 0 14 Nov 2023
Extrinsically-Focused Evaluation of Omissions in Medical Summarization Elliot Schumacher Daniel Rosenthal Varun Nair Luladay Price Geoffrey Tso Anitha Kannan 16 2 0 14 Nov 2023
Fair Abstractive Summarization of Diverse Perspectives Yusen Zhang Nan Zhang Yixin Liu Alexander R. Fabbri Junru Liu ... Caiming Xiong Jieyu Zhao Dragomir R. Radev Kathleen McKeown Rui Zhang 33 8 0 14 Nov 2023
Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval Nandan Thakur Jianmo Ni Gustavo Hernández Ábrego John Wieting Jimmy J. Lin Daniel Cer RALM 31 12 0 10 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 39 722 0 09 Nov 2023
Beyond Words: A Mathematical Framework for Interpreting Large Language Models Javier González Aditya V. Nori 6 1 0 06 Nov 2023
Hint-enhanced In-Context Learning wakes Large Language Models up for knowledge-intensive tasks Yifan Wang Qingyan Guo Xinzhe Ni Chufan Shi Lemao Liu Haiyun Jiang Yujiu Yang ReLM RALM 25 8 0 03 Nov 2023
Background Summarization of Event Timelines Adithya Pratapa Kevin Small Markus Dreyer 57 2 0 24 Oct 2023
LUNA: A Model-Based Universal Analysis Framework for Large Language Models Da Song Xuan Xie Jiayang Song Derui Zhu Yuheng Huang Felix Juefei Xu Lei Ma ALM 35 3 0 22 Oct 2023
Probing LLMs for hate speech detection: strengths and vulnerabilities Sarthak Roy Ashish Harshavardhan Animesh Mukherjee Punyajoy Saha 63 32 0 19 Oct 2023
Adaptation with Self-Evaluation to Improve Selective Prediction in LLMs Jiefeng Chen Jinsung Yoon Sayna Ebrahimi Sercan Ö. Arik Tomas Pfister Somesh Jha 25 31 0 18 Oct 2023
Zero-shot Faithfulness Evaluation for Text Summarization with Foundation Language Model Qi Jia Siyu Ren Yizhu Liu Kenny Q. Zhu ALM HILM 33 16 0 18 Oct 2023
Group Preference Optimization: Few-Shot Alignment of Large Language Models Siyan Zhao John Dang Aditya Grover 25 29 0 17 Oct 2023
On Context Utilization in Summarization with Large Language Models Mathieu Ravaut Aixin Sun Nancy F. Chen Shafiq R. Joty 33 13 0 16 Oct 2023
Harnessing the Power of LLMs: Evaluating Human-AI Text Co-Creation through the Lens of News Headline Generation Zijian Ding Alison Smith-Renner Wenjuan Zhang Joel R. Tetreault Alejandro Jaimes 21 23 0 16 Oct 2023
A Search for Prompts: Generating Structured Answers from Contracts Adam Roegiest Radha Chitta Jonathan Donnelly Maya Lash A. Vtyurina Franccois Longtin ELM AILaw 28 2 0 16 Oct 2023
KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models Yuyang Bai Shangbin Feng Vidhisha Balachandran Zhaoxuan Tan Shiqi Lou Tianxing He Yulia Tsvetkov ELM 40 2 0 15 Oct 2023
How Good is ChatGPT in Giving Advice on Your Visualization Design? Nam Wook Kim Grace Myers Benjamin Bach 28 20 0 14 Oct 2023
"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letters Yixin Wan George Pu Jiao Sun Aparna Garimella Kai-Wei Chang Nanyun Peng 34 160 0 13 Oct 2023
Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation Yuanyuan Liang Jianing Wang Hanlun Zhu Lei Wang Weining Qian Yunshi Lan LRM ReLM 18 36 0 12 Oct 2023
LLM for SoC Security: A Paradigm Shift Dipayan Saha Shams Tarek Katayoon Yahyaei S. Saha Jingbo Zhou M. Tehranipoor Farimah Farahmandi 61 46 0 09 Oct 2023
AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context Retrieval Qi Yan Raihan Seraj Jiawei He Li Meng Tristan Sylvain 19 9 0 03 Oct 2023
Compressing LLMs: The Truth is Rarely Pure and Never Simple Ajay Jaiswal Zhe Gan Xianzhi Du Bowen Zhang Zhangyang Wang Yinfei Yang MQ 38 45 0 02 Oct 2023
Efficient Streaming Language Models with Attention Sinks Michel Lang Yuandong Tian Beidi Chen Song Han Mike Lewis AI4TS RALM 32 644 0 29 Sep 2023
Human Feedback is not Gold Standard Tom Hosking Phil Blunsom Max Bartolo ALM 29 49 0 28 Sep 2023
Graph Neural Prompting with Large Language Models Yijun Tian Huan Song Zichen Wang Haozhu Wang Ziqing Hu Fang Wang Nitesh V. Chawla Panpan Xu AI4CE 37 44 0 27 Sep 2023
People's Perceptions Toward Bias and Related Concepts in Large Language Models: A Systematic Review Lu Wang Max Song R. Rezapour Bum Chul Kwon Jina Huh-Yoo AI4CE 30 1 0 25 Sep 2023
LongDocFACTScore: Evaluating the Factuality of Long Document Abstractive Summarisation Jennifer A Bishop Qianqian Xie Sophia Ananiadou HILM 17 9 0 21 Sep 2023
OpenMSD: Towards Multilingual Scientific Documents Similarity Measurement Yang Gao Ji Ma I. Korotkov Keith B. Hall Dana Alon Donald Metzler 13 0 0 19 Sep 2023
Summarization is (Almost) Dead Xiao Pu Mingqi Gao Xiaojun Wan HILM 81 39 0 18 Sep 2023
ODSum: New Benchmarks for Open Domain Multi-Document Summarization Yijie Zhou Kejian Shi Wencai Zhang Yixin Liu Yilun Zhao Arman Cohan RALM 34 2 0 16 Sep 2023