Benchmarking Large Language Models for News Summarization

31 January 2023

Tianyi Zhang

Faisal Ladhak

Esin Durmus

Percy Liang

Kathleen McKeown

Tatsunori B. Hashimoto

ELM

ArXiv PDF HTML

Papers citing "Benchmarking Large Language Models for News Summarization"

50 / 300 papers shown

Title
Towards Dataset-scale and Feature-oriented Evaluation of Text Summarization in Large Language Model Prompts Sam Yu-Te Lee Aryaman Bahukhandi Dongyu Liu Kwan-Liu Ma AAML 40 5 0 16 Jul 2024
AdaptEval: Evaluating Large Language Models on Domain Adaptation for Text Summarization Anum Afzal Ribin Chalumattu Florian Matthes Laura Mascarell ALM ELM 27 4 0 16 Jul 2024
Evaluating Large Language Models with fmeval Pola Schwöbel Luca Franceschi Muhammad Bilal Zafar Keerthan Vasist Aman Malhotra Tomer Shenhar Pinal Tailor Pinar Yilmaz Michael Diamond Michele Donini LM&MA ELM 19 2 0 15 Jul 2024
By My Eyes: Grounding Multimodal Large Language Models with Sensor Data via Visual Prompting Hyungjun Yoon Biniyam Aschalew Tolera Taesik Gong Kimin Lee Sung-Ju Lee 37 7 0 15 Jul 2024
Enhancing Few-Shot Stock Trend Prediction with Large Language Models Yiqi Deng Xingwei He Jiahao Hu Siu-Ming Yiu AIFin 30 1 0 12 Jul 2024
It Cannot Be Right If It Was Written by AI: On Lawyers' Preferences of Documents Perceived as Authored by an LLM vs a Human Jakub Harasta Tereza Novotná Jaromír Šavelka ELM 42 6 0 09 Jul 2024
EVA-Score: Evaluation of Long-form Summarization on Informativeness through Extraction and Validation Yuchen Fan Xin Zhong Chengsi Wang Gaoche Wu Bowen Zhou 34 2 0 06 Jul 2024
Applicability of Large Language Models and Generative Models for Legal Case Judgement Summarization Aniket Deroy Kripabandhu Ghosh Saptarshi Ghosh ELM AILaw 45 16 0 06 Jul 2024
Towards Enhancing Coherence in Extractive Summarization: Dataset and Experiments with LLMs Mihir Parmar Hanieh Deilamsalehy Franck Dernoncourt Seunghyun Yoon Ryan A. Rossi Trung Bui 32 2 0 05 Jul 2024
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations Md Tahmid Rahman Laskar Sawsan Alqahtani M Saiful Bari Mizanur Rahman Mohammad Abdullah Matin Khan ... Chee Wei Tan Md. Rizwan Parvez Enamul Hoque Shafiq R. Joty Jimmy Huang ELM ALM 29 28 0 04 Jul 2024
On Large Language Models in National Security Applications William N. Caballero Phillip R. Jenkins ELM 41 7 0 03 Jul 2024
Supporters and Skeptics: LLM-based Analysis of Engagement with Mental Health (Mis)Information Content on Video-sharing Platforms Viet Cuong Nguyen Mini Jain Abhijat Chauhan H. J. Soled Santiago Alvarez Lesmes Zihang Li Michael L. Birnbaum Sunny X. Tang Srijan Kumar M. D. Choudhury AI4MH 32 0 0 02 Jul 2024
Compare without Despair: Reliable Preference Evaluation with Generation Separability Sayan Ghosh Tejas Srinivasan Swabha Swayamdipta 45 2 0 02 Jul 2024
PerSEval: Assessing Personalization in Text Summarizers Sourish Dasgupta Ankush Chander Parth Borad Isha Motiyani Tanmoy Chakraborty 37 0 0 29 Jun 2024
AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning Yifan Yang Kai Zhen Ershad Banijamal Athanasios Mouchtaris Zheng Zhang 34 8 0 26 Jun 2024
Cascading Large Language Models for Salient Event Graph Generation Xingwei Tan Yuxiang Zhou Gabriele Pergola Yulan He 66 0 0 26 Jun 2024
Large Language Models are Interpretable Learners Ruochen Wang Si Si Felix X. Yu Dorothea Wiesmann Cho-Jui Hsieh Inderjit Dhillon 24 3 0 25 Jun 2024
PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection Jooyoung Lee Toshini Agrawal Adaku Uchendu Thai V. Le Jinghui Chen Dongwon Lee 31 1 0 24 Jun 2024
Factual Dialogue Summarization via Learning from Large Language Models Rongxin Zhu Jey Han Lau Jianzhong Qi HILM 52 1 0 20 Jun 2024
What Are the Odds? Language Models Are Capable of Probabilistic Reasoning Akshay Paruchuri Jake Garrison Shun Liao John Hernandez Jacob Sunshine Tim Althoff Xin Liu Daniel J. McDuff LRM 39 7 0 18 Jun 2024
Chumor 1.0: A Truly Funny and Challenging Chinese Humor Understanding Dataset from Ruo Zhi Ba Ruiqi He Yushu He Longju Bai Jiarui Liu Zhenjie Sun Zenghao Tang He Wang Hanchen Xia Naihao Deng 30 0 0 18 Jun 2024
D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models Zhongwei Wan Xinjian Wu Yu Zhang Yi Xin Chaofan Tao ... Xin Wang Siqi Luo Jing Xiong Mi Zhang Mi Zhang 29 0 0 18 Jun 2024
Prompt Design Matters for Computational Social Science Tasks but in Unpredictable Ways Shubham Atreja Joshua Ashkinaze Lingyao Li Julia Mendelsohn Libby Hemphill 50 12 0 17 Jun 2024
SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention Qianchao Zhu Jiangfei Duan Chang Chen Siran Liu Xiuhong Li ... Huanqi Cao Xiao Chuanfu Xingcheng Zhang Dahua Lin Chao Yang 30 15 0 17 Jun 2024
A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models Haopeng Zhang Philip S. Yu Jiawei Zhang 37 17 0 17 Jun 2024
Are Large Language Models a Good Replacement of Taxonomies? Yushi Sun Hao Xin Kai Sun Yongjun Xu Xiao Yang Xin Luna Dong Nan Tang Lei Chen AI4MH 35 7 0 17 Jun 2024
LLM Reading Tea Leaves: Automatically Evaluating Topic Models with Large Language Models Xiaohao Yang He Zhao Dinh Q. Phung Wray L. Buntine Lan Du ALM ELM 76 2 0 13 Jun 2024
Flexible and Adaptable Summarization via Expertise Separation Xiuying Chen Mingzhe Li Shen Gao Xin Cheng Qingqing Zhu Rui Yan Xin Gao Xiangliang Zhang MoE 41 3 0 08 Jun 2024
Key-Element-Informed sLLM Tuning for Document Summarization Sangwon Ryu Heejin Do Yunsu Kim G. G. Lee Jungseul Ok 29 6 0 07 Jun 2024
Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing Hadi Askari Anshuman Chhabra Muhao Chen Prasant Mohapatra 33 5 0 06 Jun 2024
Analyzing LLM Behavior in Dialogue Summarization: Unveiling Circumstantial Hallucination Trends S. Ramprasad Elisa Ferracane Zachary Chase Lipton HILM 19 12 0 05 Jun 2024
Multimodal Reasoning with Multimodal Knowledge Graph Junlin Lee Yequan Wang Jing Li Min Zhang 44 15 0 04 Jun 2024
Multi-Dimensional Optimization for Text Summarization via Reinforcement Learning Sangwon Ryu Heejin Do Yunsu Kim Gary Geunbae Lee Jungseul Ok 26 3 0 01 Jun 2024
Tool Learning with Large Language Models: A Survey Changle Qu Sunhao Dai Xiaochi Wei Hengyi Cai Shuaiqiang Wang Dawei Yin Jun Xu Jirong Wen LLMAG 34 80 0 28 May 2024
An Evaluation of Estimative Uncertainty in Large Language Models Zhi–Bin Tang Ke Shen Mayank Kejriwal ELM 33 4 0 24 May 2024
Eliciting Informative Text Evaluations with Large Language Models Yuxuan Lu Shengwei Xu Yichi Zhang Yuqing Kong Grant Schoenebeck 36 5 0 23 May 2024
Large Language Models Meet NLP: A Survey Libo Qin Qiguang Chen Xiachong Feng Yang Wu Yongheng Zhang Hai-Tao Zheng Min Li Wanxiang Che Philip S. Yu ALM LM&MA ELM LRM 52 47 0 21 May 2024
WisPerMed at BioLaySumm: Adapting Autoregressive Large Language Models for Lay Summarization of Scientific Articles T. M. G. Pakull Hendrik Damm Ahmad Idrissi-Yaghir Henning Schafer Peter A. Horn Christoph M. Friedrich 34 2 0 20 May 2024
Tell Me Why: Explainable Public Health Fact-Checking with Large Language Models Majid Zarharan Pascal Wullschleger Babak Behkam Kia Mohammad Taher Pilehvar Jennifer Foster LRM ELM LM&MA 26 3 0 15 May 2024
BLIP: Facilitating the Exploration of Undesirable Consequences of Digital Technologies Rock Yuren Pang Sebastin Santy René Just Katharina Reinecke 37 14 0 10 May 2024
Aspect-oriented Consumer Health Answer Summarization Rochana Chaturvedi Abari Bhattacharya S. Yadav 31 3 0 10 May 2024
Special Characters Attack: Toward Scalable Training Data Extraction From Large Language Models Yang Bai Ge Pei Jindong Gu Yong Yang Xingjun Ma 31 10 0 09 May 2024
KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation Minsik Cho Mohammad Rastegari Devang Naik 32 4 0 08 May 2024
Enhancing News Summarization with ELearnFit through Efficient In-Context Learning and Efficient Fine-Tuning Che Guan Andrew Chin Puya Vahabi 18 1 0 04 May 2024
How Did We Get Here? Summarizing Conversation Dynamics Yilun Hua Nicholas Chernogor Yuzhe Gu Seoyeon Julie Jeong Miranda Luo Cristian Danescu-Niculescu-Mizil 30 5 0 29 Apr 2024
ECC Analyzer: Extract Trading Signal from Earnings Conference Calls using Large Language Model for Stock Performance Prediction Yupeng Cao Zhi Chen Qingyun Pei Nathan Jinseok Lee K. P. Subbalakshmi Papa Momar Ndiaye AIFin 25 0 0 29 Apr 2024
Hallucination of Multimodal Large Language Models: A Survey Zechen Bai Pichao Wang Tianjun Xiao Tong He Zongbo Han Zheng Zhang Mike Zheng Shou VLM LRM 95 139 0 29 Apr 2024
Retrieval Augmented Generation for Domain-specific Question Answering Sanat Sharma David Seunghyun Yoon Franck Dernoncourt Dewang Sultania Karishma Bagga Mengjiao Zhang Trung Bui Varun Kotte RALM 46 9 0 23 Apr 2024
Zero-Shot Character Identification and Speaker Prediction in Comics via Iterative Multimodal Fusion Yingxuan Li Ryota Hinami Kiyoharu Aizawa Yusuke Matsui 27 6 0 22 Apr 2024
Generating Attractive and Authentic Copywriting from Customer Reviews Yu-Xiang Lin Wei-Yun Ma 42 2 0 22 Apr 2024