Benchmarking Large Language Models for News Summarization

31 January 2023

Tianyi Zhang

Faisal Ladhak

Esin Durmus

Percy Liang

Kathleen McKeown

Tatsunori B. Hashimoto

ELM

ArXiv PDF HTML

Papers citing "Benchmarking Large Language Models for News Summarization"

50 / 300 papers shown

Title
RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation Chao Jin Zili Zhang Xuanlin Jiang Fangyue Liu Xin Liu Xuanzhe Liu Xin Jin 40 39 0 18 Apr 2024
Which questions should I answer? Salience Prediction of Inquisitive Questions Yating Wu Ritika Mangla A. Dimakis Greg Durrett Junyi Jessy Li 35 2 0 16 Apr 2024
MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents Liyan Tang Philippe Laban Greg Durrett HILM SyDa 43 76 0 16 Apr 2024
Auctions with LLM Summaries Kumar Avinava Dubey Zhe Feng Rahul Kidambi Aranyak Mehta Di Wang 38 10 0 11 Apr 2024
RiskLabs: Predicting Financial Risk Using Large Language Model based on Multimodal and Multi-Sources Data Yupeng Cao Zhi Chen Prashant Kumar Qingyun Pei Yangyang Yu Haohang Li Fabrizio Dimino Lorenzo Ausiello K. P. Subbalakshmi Papa Momar Ndiaye 30 0 0 11 Apr 2024
Scaling Up Video Summarization Pretraining with Large Language Models Dawit Mureja Argaw Seunghyun Yoon Fabian Caba Heilbron Hanieh Deilamsalehy Trung Bui Zhaowen Wang Franck Dernoncourt Joon Son Chung 43 9 0 04 Apr 2024
Learning to Plan and Generate Text with Citations Constanza Fierro Reinald Kim Amplayo Fantine Huot Nicola De Cao Joshua Maynez Shashi Narayan Mirella Lapata 32 17 0 04 Apr 2024
The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Education Paiheng Xu Jing Liu Nathan Jones Julie Cohen Wei Ai AI4Ed 38 5 0 03 Apr 2024
METAL: Towards Multilingual Meta-Evaluation Rishav Hada Varun Gumma Mohamed Ahmed Kalika Bali Sunayana Sitaram ELM 40 2 0 02 Apr 2024
Hallucination Diversity-Aware Active Learning for Text Summarization Yu Xia Xu Liu Tong Yu Sungchul Kim Ryan A. Rossi Anup B. Rao Tung Mai Shuai Li HILM 40 3 0 02 Apr 2024
Learning to Plan for Language Modeling from Unlabeled Data Nathan Cornille Marie-Francine Moens Florian Mai 38 7 0 31 Mar 2024
ReflectSumm: A Benchmark for Course Reflection Summarization Yang Zhong Mohamed S. Elaraby Diane Litman A. Butt Muhsin Menekse 26 1 0 27 Mar 2024
BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text Elliot Bolton Abhinav Venigalla Michihiro Yasunaga David Leo Wright Hall Betty Xiong ... R. Daneshjou Jonathan Frankle Percy Liang Michael Carbin Christopher D. Manning LM&MA MedIm 32 51 0 27 Mar 2024
Large Language Models Offer an Alternative to the Traditional Approach of Topic Modelling Yida Mu Chun Dong Kalina Bontcheva Xingyi Song 26 18 0 24 Mar 2024
Multi-Review Fusion-in-Context Aviv Slobodkin Ori Shapira Ran Levy Ido Dagan 81 1 0 22 Mar 2024
Information-Theoretic Distillation for Reference-less Summarization Jaehun Jung Ximing Lu Liwei Jiang Faeze Brahman Peter West Pang Wei Koh Yejin Choi 40 3 0 20 Mar 2024
S3LLM: Large-Scale Scientific Software Understanding with LLMs using Source, Metadata, and Document Kareem Shaik Dali Wang Weijian Zheng Qinglei Cao Heng Fan Peter Schwartz Yunhe Feng 22 1 0 15 Mar 2024
Enhancing Trust in Autonomous Agents: An Architecture for Accountability and Explainability through Blockchain and Large Language Models Laura Fernández-Becerra Miguel Ángel González Santamarta Ángel Manuel Guerrero Higueras Francisco J. Rodríguez-Lera Vicente Matellán Olivera 36 0 0 14 Mar 2024
TutoAI: A Cross-domain Framework for AI-assisted Mixed-media Tutorial Creation on Physical Tasks Yuexi Chen Vlad I. Morariu Anh Truong Zhicheng Liu DiffM VGen 45 4 0 12 Mar 2024
LLMvsSmall Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Model Linmei Hu Hongyu He Duokang Wang Ziwang Zhao Yingxia Shao Liqiang Nie 29 15 0 12 Mar 2024
From Instructions to Constraints: Language Model Alignment with Automatic Constraint Verification Fei Wang Chao Shang Sarthak Jain Shuai Wang Qiang Ning Bonan Min Vittorio Castelli Yassine Benajiba Dan Roth ALM 22 7 0 10 Mar 2024
ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publications Sotaro Takeshita Tommaso Green Ines Reinig Kai Eckert Simone Paolo Ponzetto 26 11 0 08 Mar 2024
A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods Hanlei Jin Yang Zhang Dan Meng Jun Wang Jinghua Tan 68 80 0 05 Mar 2024
WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citations Haolin Deng Chang Wang Xin Li Dezhang Yuan Junlang Zhan Tianhua Zhou Jin Ma Jun Gao Ruifeng Xu HILM 63 2 0 04 Mar 2024
Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writers Melanie Subbiah Sean Zhang Lydia B. Chilton Kathleen McKeown 54 14 0 02 Mar 2024
AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks Jiacen Xu Jack W. Stokes Geoff McDonald Xuesong Bai David Marshall Siyue Wang Adith Swaminathan Zhou Li 40 50 0 02 Mar 2024
Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries Zelalem Gero Chandan Singh Yiqing Xie Sheng Zhang Tristan Naumann Jianfeng Gao Hoifung Poon ELM ALM 39 4 0 01 Mar 2024
RAM-EHR: Retrieval Augmentation Meets Clinical Predictions on Electronic Health Records Ran Xu Wenqi Shi Yue Yu Yuchen Zhuang Bowen Jin M. D. Wang Joyce C. Ho Carl Yang 30 8 0 25 Feb 2024
Don't Forget Your Reward Values: Language Model Alignment via Value-based Calibration Xin Mao Fengming Li Huimin Xu Wei Zhang A. Luu ALM 45 6 0 25 Feb 2024
Social Convos: Capturing Agendas and Emotions on Social Media Ankita Bhaumik Ning Sa Gregorios A. Katsios T. Strzalkowski 33 1 0 23 Feb 2024
Can Large Language Models Detect Misinformation in Scientific News Reporting? Yupeng Cao Aishwarya Muralidharan Nair Elyon Eyimife Nastaran Jamalipour Soofi K. P. Subbalakshmi J. Wullert Chumki Basu David Shallcross 40 8 0 22 Feb 2024
An Evaluation of Large Language Models in Bioinformatics Research Hengchuang Yin Zhonghui Gu Fanhao Wang Yiparemu Abuduhaibaier Yanqiao Zhu Xinming Tu Xian-Sheng Hua Xiao Luo Yizhou Sun LM&MA 38 8 0 21 Feb 2024
Hybrid Reasoning Based on Large Language Models for Autonomous Car Driving Mehdi Azarafza M. Nayyeri Charles Steinmetz Steffen Staab A. Rettberg LRM 44 9 0 21 Feb 2024
GradSafe: Detecting Jailbreak Prompts for LLMs via Safety-Critical Gradient Analysis Yueqi Xie Minghong Fang Renjie Pi Neil Zhenqiang Gong 53 21 0 21 Feb 2024
Factual consistency evaluation of summarization in the Era of large language models Zheheng Luo Qianqian Xie Sophia Ananiadou HILM 35 1 0 21 Feb 2024
TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization Liyan Tang Igor Shalyminov Amy Wing-mei Wong Jon Burnsky Jake W. Vincent ... Hang Su Lijia Sun Yi Zhang Saab Mansour Kathleen McKeown HILM 18 44 0 20 Feb 2024
Me LLaMA: Foundation Large Language Models for Medical Applications Qianqian Xie Qingyu Chen Aokun Chen C.A.I. Peng Yan Hu ... Huan He Lucila Ohno-Machido Yonghui Wu Hua Xu Jiang Bian LM&MA AI4MH 70 4 0 20 Feb 2024
Graph-Based Retriever Captures the Long Tail of Biomedical Knowledge Julien Delile Srayanta Mukherjee Anton Van Pamel Leonid Zhukov RALM 21 18 0 19 Feb 2024
Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation Xunjian Yin Xu Zhang Jie Ruan Xiaojun Wan ELM 33 17 0 18 Feb 2024
BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge Filtering Haoyu Wang Ruirui Li Haoming Jiang Jinjin Tian Zhengyang Wang Chen Luo Xianfeng Tang Monica Cheng Tuo Zhao Jing Gao RALM KELM 41 16 0 16 Feb 2024
GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency Catherine Yeh Gonzalo A. Ramos Rachel Ng Andy Huntington Richard Banks LLMAG 49 20 0 13 Feb 2024
Natural Language Reinforcement Learning Xidong Feng Bo Liu Mengyue Yang Ziyan Wang Girish A. Koushiks Yali Du Ying Wen Jun Wang OffRL 35 3 0 11 Feb 2024
Calibrating Long-form Generations from Large Language Models Yukun Huang Yixin Liu Raghuveer Thirukovalluru Arman Cohan Bhuwan Dhingra 24 7 0 09 Feb 2024
Evaluating the Factuality of Zero-shot Summarizers Across Varied Domains S. Ramprasad Kundan Krishna Zachary Chase Lipton Byron C. Wallace HILM 46 6 0 05 Feb 2024
DeAL: Decoding-time Alignment for Large Language Models James Y. Huang Sailik Sengupta Daniele Bonadiman Yi-An Lai Arshit Gupta Nikolaos Pappas Saab Mansour Katrin Kirchoff Dan Roth 56 29 0 05 Feb 2024
Enhance Reasoning for Large Language Models in the Game Werewolf Shuang Wu Liwen Zhu Tao Yang Shiwei Xu Qiang Fu Yang Wei Haobo Fu LRM LLMAG 82 18 0 04 Feb 2024
ReSLLM: Large Language Models are Strong Resource Selectors for Federated Search Shuai Wang Shengyao Zhuang Bevan Koopman Guido Zuccon 24 5 0 31 Jan 2024
Combining Hierachical VAEs with LLMs for clinically meaningful timeline summarisation in social media Jiayu Song Jenny Chim Adam Tsakalidis Julia Ive Dana Atzil-Slonim M. Liakata 21 3 0 29 Jan 2024
An AI-Resilient Text Rendering Technique for Reading and Skimming Documents Ziwei Gu Ian Arawjo Kenneth Li Jonathan K. Kummerfeld Elena L. Glassman 48 17 0 19 Jan 2024
Can Large Language Model Summarizers Adapt to Diverse Scientific Communication Goals? Marcio Fonseca Shay B. Cohen 39 10 0 18 Jan 2024