Benchmarking Large Language Models for News Summarization

31 January 2023

Tianyi Zhang

Faisal Ladhak

Esin Durmus

Percy Liang

Kathleen McKeown

Tatsunori B. Hashimoto

ELM

ArXiv PDF HTML

Papers citing "Benchmarking Large Language Models for News Summarization"

50 / 300 papers shown

Title
SubGCache: Accelerating Graph-based RAG with Subgraph-level KV Cache Qiuyu Zhu Liang Zhang Qianxiong Xu Cheng Long Jie Zhang 14 0 0 16 May 2025
Defending against Indirect Prompt Injection by Instruction Detection Tongyu Wen Chenglong Wang Xiyuan Yang Haoyu Tang Yueqi Xie Lingjuan Lyu Zhicheng Dou Fangzhao Wu AAML 31 0 0 08 May 2025
Interpretable Zero-shot Learning with Infinite Class Concepts Zihan Ye Shreyank N Gowda Shiming Chen Yaochu Jin Kaizhu Huang Xiaobo Jin VLM 37 0 0 06 May 2025
Towards Artificial Intelligence Research Assistant for Expert-Involved Learning Tianyu Liu Simeng Han Xiao Luo Haoyu Wang Pan Lu ... Arman Cohan Hua Xu Mark B. Gerstein James Zou Hongyu Zhao 39 0 0 03 May 2025
Multi-agents based User Values Mining for Recommendation L. Chen Wei Yuan Tong Chen Xiangyu Zhao Nguyen Quoc Viet Hung Hongzhi Yin OffRL 49 0 0 02 May 2025
From Inductive to Deductive: LLMs-Based Qualitative Data Analysis in Requirements Engineering Shri Kiran Srinivasan Mohamad Hussein Ann Barcomb Mohammad Moshirpour 50 0 0 27 Apr 2025
A Python Tool for Reconstructing Full News Text from GDELT A. Fronzetti Colladon R. Vestrelli 19 0 0 22 Apr 2025
The Viability of Crowdsourcing for RAG Evaluation Lukas Gienapp Tim Hagen Maik Frobe Matthias Hagen Benno Stein Martin Potthast Harrisen Scells 21 0 0 22 Apr 2025
The AI Co-Ethnographer: How Far Can Automation Take Qualitative Research? Fabian Retkowski Andreas Sudmann Alexander Waibel 23 0 0 21 Apr 2025
SCRAG: Social Computing-Based Retrieval Augmented Generation for Community Response Forecasting in Social Media Environments Dachun Sun You Lyu Jinning Li Yizhuo Chen Tianshi Wang Tomoyoshi Kimura Tarek F. Abdelzaher 26 0 0 18 Apr 2025
Aspect-Based Summarization with Self-Aspect Retrieval Enhanced Generation Yichao Feng Shuai Zhao Heng Chang Luwei Xiao Xiaobao Wu Anh Tuan Luu RALM 31 0 0 17 Apr 2025
ML For Hardware Design Interpretability: Challenges and Opportunities Raymond Baartmans Andrew Ensinger Victor Agostinelli Lizhong Chen 29 0 0 11 Apr 2025
Out of Style: RAG's Fragility to Linguistic Variation Tianyu Cao Neel Bhandari Akhila Yerukola Akari Asai Maarten Sap 27 0 0 11 Apr 2025
From Speech to Summary: A Comprehensive Survey of Speech Summarization Fabian Retkowski Maike Züfle Andreas Sudmann Dinah Pfau Jan Niehues Alexander Waibel 44 0 0 10 Apr 2025
PreSumm: Predicting Summarization Performance Without Summarizing Steven Koniaev Ori Ernst Jackie Chi Kit Cheung 31 0 0 07 Apr 2025
AccLLM: Accelerating Long-Context LLM Inference Via Algorithm-Hardware Co-Design Yanbiao Liang Huihong Shi Haikuo Shao Zhongfeng Wang 33 0 0 07 Apr 2025
A thorough benchmark of automatic text classification: From traditional approaches to large language models Washington Cunha Leonardo Rocha M. A. Gonçalves VLM 32 1 0 02 Apr 2025
News is More than a Collection of Facts: Moral Frame Preserving News Summarization Enrico Liscio Michela Lorandi P. Murukannaiah 41 0 0 01 Apr 2025
SalesRLAgent: A Reinforcement Learning Approach for Real-Time Sales Conversion Prediction and Optimization Nandakishor M 47 0 0 30 Mar 2025
Fwd2Bot: LVLM Visual Token Compression with Double Forward Bottleneck Adrian Bulat Yassine Ouali Georgios Tzimiropoulos 152 0 0 27 Mar 2025
Evaluating book summaries from internal knowledge in Large Language Models: a cross-model and semantic consistency approach Javier Coronado-Blázquez HILM ELM 74 0 0 27 Mar 2025
CAKE: Cascading and Adaptive KV Cache Eviction with Layer Preferences Ziran Qin Yuchen Cao Mingbao Lin Wen Hu Shixuan Fan Ke Cheng Weiyao Lin Jianguo Li 71 3 0 16 Mar 2025
Improving LLM-based Document-level Machine Translation with Multi-Knowledge Fusion Bin Liu Xinglin Lyu Junhui Li Daimeng Wei M. Zhang Shimin Tao Hao Yang 61 0 0 15 Mar 2025
TokenButler: Token Importance is Predictable Yash Akhauri Ahmed F. AbouElhamayed Yifei Gao Chi-chih Chang Nilesh Jain Mohamed S. Abdelfattah 50 0 0 10 Mar 2025
AI-Facilitated Collective Judgements Manon Revel Théophile Pénigaud 54 0 0 06 Mar 2025
Biases in Large Language Model-Elicited Text: A Case Study in Natural Language Inference Grace Proebsting Adam Poliak 55 0 0 06 Mar 2025
WeightedKV: Attention Scores Weighted Key-Value Cache Merging for Large Language Models Jian Yuan Ziwei He Haoli Bai Jingwen Leng Bo Jiang MoMe 39 0 0 03 Mar 2025
A Deep User Interface for Exploring LLaMa Divya Perumal Swaroop Panda 41 0 0 28 Feb 2025
Multi2: Multi-Agent Test-Time Scalable Framework for Multi-Document Processing Juntai Cao Xiang Zhang Raymond Li Chuyuan Li Shafiq R. Joty Giuseppe Carenini 59 1 0 27 Feb 2025
Evaluating the Effectiveness of Large Language Models in Automated News Article Summarization Lionel Richy Panlap Houamegni Fatih Gedikli 44 0 0 24 Feb 2025
NUTSHELL: A Dataset for Abstract Generation from Scientific Talks Maike Züfle Sara Papi Beatrice Savoldi Marco Gaido L. Bentivogli Jan Niehues 43 0 0 24 Feb 2025
Auto-Bench: An Automated Benchmark for Scientific Discovery in LLMs Tingting Chen Srinivas Anumasa Beibei Lin Vedant Shah Anirudh Goyal Dianbo Liu LLMAG 54 1 0 24 Feb 2025
Neural Attention Search Difan Deng Marius Lindauer 93 0 0 21 Feb 2025
Valuable Hallucinations: Realizable Non-realistic Propositions Qiucheng Chen Bo Wang LRM 59 0 0 16 Feb 2025
Evaluating Small Language Models for News Summarization: Implications and Factors Influencing Performance Borui Xu Yao Chen Zeyi Wen Weiguo Liu Bingsheng He 77 1 0 02 Feb 2025
FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Data Deren Lei Yaxi Li Siyao Li Mengya Hu Rui Xu Ken Archer Mingyu Wang Emily Ching Alex Deng SyDa HILM LRM 73 1 0 28 Jan 2025
Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models Jingwei Yi Yueqi Xie Bin Zhu Emre Kiciman Guangzhong Sun Xing Xie Fangzhao Wu AAML 62 65 0 28 Jan 2025
Efficient Prompt Compression with Evaluator Heads for Long-Context Transformer Inference Weizhi Fei Xueyan Niu Guoqing Xie Yingqing Liu Bo Bai Wei Han 33 1 0 22 Jan 2025
MPCache: MPC-Friendly KV Cache Eviction for Efficient Private Large Language Model Inference Wenxuan Zeng Ye Dong Jinjin Zhou Junming Ma Jin Tan Runsheng Wang Meng Li 49 0 0 12 Jan 2025
Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation Yuhui Zhang Yuchang Su Yiming Liu Xiaohan Wang James Burgess ... Josiah Aklilu Alejandro Lozano Anjiang Wei Ludwig Schmidt Serena Yeung-Levy 61 3 0 06 Jan 2025
Zero-Shot Strategies for Length-Controllable Summarization Fabian Retkowski A. Waibel 54 3 0 31 Dec 2024
Chumor 2.0: Towards Benchmarking Chinese Humor Understanding Ruiqi He Yushu He Longju Bai Jiarui Liu Zhenjie Sun Zenghao Tang He Wang Hanchen Xia Rada Mihalcea Naihao Deng 78 1 0 23 Dec 2024
Learning to Verify Summary Facts with Fine-Grained LLM Feedback Jihwan Oh J. Choi Nicole Hee-Yeon Kim Taewon Yun Hwanjun Song SyDa ALM HILM 76 1 0 14 Dec 2024
Modeling Story Expectations to Understand Engagement: A Generative Framework Using LLMs Hortense Fong George Gui HAI 86 0 0 13 Dec 2024
Text Generation Models for Luxembourgish with Limited Data: A Balanced Multilingual Strategy Alistair Plum Tharindu Ranasinghe Christoph Purschke 74 2 0 12 Dec 2024
DocSum: Domain-Adaptive Pre-training for Document Abstractive Summarization Phan Phuong Mai Chau Souhail Bakkali Antoine Doucet 71 0 0 11 Dec 2024
Coverage-based Fairness in Multi-document Summarization Haoyuan Li Yusen Zhang Rui Zhang Snigdha Chaturvedi 80 0 0 11 Dec 2024
Leveraging Large Language Models for Comparative Literature Summarization with Reflective Incremental Mechanisms Fernando Gabriela Garcia Spencer Burns Harrison Fuller 73 0 0 03 Dec 2024
Curriculum Demonstration Selection for In-Context Learning Duc Anh Vu Nguyen Tran Cong Duy Xiaobao Wu Hoang Minh Nhat Du Mingzhe Nguyen Thanh Thong Anh Tuan Luu 72 0 0 27 Nov 2024
Do Automatic Factuality Metrics Measure Factuality? A Critical Evaluation S. Ramprasad Byron C. Wallace LLMAG HILM 87 2 0 25 Nov 2024