Improving Factuality and Reasoning in Language Models through Multiagent Debate

23 May 2023

Yilun Du

Shuang Li

Antonio Torralba

Papers citing "Improving Factuality and Reasoning in Language Models through Multiagent Debate"

50 / 465 papers shown

Title
Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agents Yue Liu Sin Kit Lo Qinghua Lu Liming Zhu Dehai Zhao Xiwei Xu Stefan Harrer Jon Whittle LLMAG AI4CE 27 10 0 16 May 2024
DEBATE: Devil's Advocate-Based Assessment and Text Evaluation Alex G. Kim Keonwoo Kim Sangwon Yoon ELM 32 5 0 16 May 2024
DuetRAG: Collaborative Retrieval-Augmented Generation Dian Jiao Li Cai Jingsheng Huang Wenqiao Zhang Siliang Tang Yueting Zhuang 38 0 0 12 May 2024
Event GDR: Event-Centric Generative Document Retrieval Yong Guan Dingxiao Liu Jinchen Ma Hao Peng Xiaozhi Wang Lei Hou Ru Li 40 1 0 11 May 2024
LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Play Li-Chun Lu Shou-Jen Chen Tsung-Min Pai Chan-Hung Yu Hung-yi Lee Shao-Hua Sun LLMAG 56 40 0 10 May 2024
Smurfs: Leveraging Multiple Proficiency Agents with Context-Efficiency for Tool Planning Junzhi Chen Juhao Liang Benyou Wang LLMAG 28 3 0 09 May 2024
Chain of Thoughtlessness? An Analysis of CoT in Planning Kaya Stechly Karthik Valmeekam Subbarao Kambhampati LRM LM&Ro 75 40 0 08 May 2024
Enhancing the Efficiency and Accuracy of Underlying Asset Reviews in Structured Finance: The Application of Multi-agent Framework Xiangpeng Wan Haicheng Deng Kai Zou Shiqi Xu LLMAG 28 5 0 07 May 2024
Conformity, Confabulation, and Impersonation: Persona Inconstancy in Multi-Agent LLM Collaboration Razan Baltaji Babak Hemmatian L. Varshney LLMAG 43 1 0 06 May 2024
Argumentative Large Language Models for Explainable and Contestable Claim Verification Gabriel Freedman Adam Dejl Deniz Gorur Xiang Yin Antonio Rago Francesca Toni 37 7 0 03 May 2024
CoMM: Collaborative Multi-Agent, Multi-Reasoning-Path Prompting for Complex Problem Solving Pei Chen Boran Han Shuai Zhang LRM LLMAG 40 4 0 26 Apr 2024
When to Trust LLMs: Aligning Confidence with Response Quality Shuchang Tao Liuyi Yao Hanxing Ding Yuexiang Xie Qi Cao Fei Sun Jinyang Gao Huawei Shen Bolin Ding 37 15 0 26 Apr 2024
BattleAgent: Multi-modal Dynamic Emulation on Historical Battles to Complement Historical Analysis Shuhang Lin Wenyue Hua Lingyao Li Che-Jui Chang Lizhou Fan Jianchao Ji Hang Hua Mingyu Jin Jiebo Luo Yongfeng Zhang LM&Ro LLMAG 57 9 0 23 Apr 2024
Adaptive Collaboration Strategy for LLMs in Medical Decision Making Y. Kim Chanwoo Park Hyewon Jeong Yik Siu Chan X. Xu Daniel J. McDuff C. Breazeal Hae Won Park 34 4 0 22 Apr 2024
ISQA: Informative Factuality Feedback for Scientific Summarization Zekai Li Yanxia Qin Qian Liu Min-Yen Kan HILM 37 1 0 20 Apr 2024
AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaboration Bo Pan Jiaying Lu Ke Wang Li Zheng Zhen Wen Yingchaojie Feng Minfeng Zhu Wei Chen LLMAG 37 10 0 18 Apr 2024
Unveiling Imitation Learning: Exploring the Impact of Data Falsity to Large Language Model Hyunsoo Cho ALM 27 0 0 15 Apr 2024
Confidence Calibration and Rationalization for LLMs via Multi-Agent Deliberation Ruixin Yang Dheeraj Rajagopal S. Hayati Bin Hu Dongyeop Kang LLMAG 43 5 0 14 Apr 2024
ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models Jinheon Baek S. Jauhar Silviu Cucerzan Sung Ju Hwang AI4CE LLMAG LM&Ro 42 38 0 11 Apr 2024
A Survey on the Integration of Generative AI for Critical Thinking in Mobile Networks Athanasios Karapantelakis Alexandros Nikou Ajay Kattepur Jean Martins Leonid Mokrushin S. Mohalik Marin Orlic Aneta Vulgarakis Feljan 29 1 0 10 Apr 2024
Can Feedback Enhance Semantic Grounding in Large Vision-Language Models? Yuan-Hong Liao Rafid Mahmood Sanja Fidler David Acuna VLM 52 7 0 09 Apr 2024
RoT: Enhancing Large Language Models with Reflection on Search Trees Wenyang Hui Kewei Tu LRM 32 6 0 08 Apr 2024
Social Skill Training with Large Language Models Diyi Yang Caleb Ziems William B. Held Omar Shaikh Michael S. Bernstein John C. Mitchell LLMAG 51 8 0 05 Apr 2024
MIMIR: A Streamlined Platform for Personalized Agent Tuning in Domain Expertise Chunyuan Deng Xiangru Tang Yilun Zhao Hanming Wang Haoran Wang Wangchunshu Zhou Arman Cohan Mark B. Gerstein LLMAG MLLM 30 1 0 03 Apr 2024
An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing Ziwei Chai Guoyin Wang Jing Su Tianjie Zhang Xuanwen Huang ... Jingjing Xu Jianbo Yuan Hongxia Yang Fei Wu Yang Yang 39 7 0 25 Mar 2024
Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Art Neeloy Chakraborty Melkior Ornik Katherine Driggs-Campbell LRM 57 9 0 25 Mar 2024
AIOS: LLM Agent Operating System Kai Mei Zelong Li Wujiang Xu Wenyue Hua Mingyu Jin Yongfeng Zhang Shuyuan Xu Ruosong Ye Yingqiang Ge Yongfeng Zhang LLMAG 30 17 0 25 Mar 2024
A Picture Is Worth a Graph: Blueprint Debate on Graph for Multimodal Reasoning Changmeng Zheng Dayong Liang Wengyu Zhang Xiao Wei Tat-Seng Chua Qing Li 40 1 0 22 Mar 2024
Content Knowledge Identification with Multi-Agent Large Language Models (LLMs) Kaiqi Yang Yucheng Chu Taylor Darwin Ahreum Han Hang Li Hongzhi Wen Yasemin Copur-Gencturk Jiliang Tang Hui Liu 37 11 0 22 Mar 2024
ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting Xiaoxue Cheng Junyi Li Wayne Xin Zhao Ji-Rong Wen LRM AI4CE ReLM 52 7 0 21 Mar 2024
ERD: A Framework for Improving LLM Reasoning for Cognitive Distortion Classification Sehee Lim Yejin Kim Chi-Hyun Choi Jy-yong Sohn Byung-Hoon Kim 41 3 0 21 Mar 2024
Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices Sara Abdali Richard Anarfi C. Barberan Jia He PILM 73 24 0 19 Mar 2024
DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLM YiXuan Wu Yizhou Wang Shixiang Tang Wenhao Wu Tong He Wanli Ouyang Jian Wu Philip Torr ObjD VLM 32 19 0 19 Mar 2024
Can LLM-Augmented autonomous agents cooperate?, An evaluation of their cooperative capabilities through Melting Pot Manuel Mosquera Juan Sebastian Pinzon Manuel Rios Yesid Fonseca Luis Felipe Giraldo Nicanor Quijano Ruben Manrique 33 2 0 18 Mar 2024
A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges Xinrun Xu Yuxin Wang Chaoyi Xu Ziluo Ding Jiechuan Jiang Zhiming Ding Börje F. Karlsson LM&Ro LLMAG 96 15 0 15 Mar 2024
Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigation Zhonghan Zhao Kewei Chen Dongxu Guo Wenhao Chai Tianbo Ye Yanting Zhang Gaoang Wang 64 21 0 13 Mar 2024
ACFIX: Guiding LLMs with Mined Common RBAC Practices for Context-Aware Repair of Access Control Vulnerabilities in Smart Contracts Lyuye Zhang Kaixuan Li Kairan Sun Daoyuan Wu Ye Liu Haoye Tian Yang Liu 56 21 0 11 Mar 2024
$$\text{R}^2$-Bench: Benchmarking the Robustness of Referring Perception Models under Perturbations$ $\text{R}^2$ -Bench: Benchmarking the Robustness of Referring Perception Models under Perturbations Xiang Li Kai Qiu Jinglu Wang Xiaohao Xu Rita Singh Kashu Yamazaki Hao Chen Xiaonan Huang Bhiksha Raj VOS 40 2 0 07 Mar 2024
Learning to Use Tools via Cooperative and Interactive Agents Zhengliang Shi Shen Gao Xiuyi Chen Zhumin Chen Lingyong Yan Haibo Shi Dawei Yin Pengjie Ren Suzan Verberne Zhaochun Ren LLMAG 35 24 0 05 Mar 2024
Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systems Lingjiao Chen Jared Quincy Davis Boris Hanin Peter Bailis Ion Stoica Matei A. Zaharia James Zou LRM 29 0 0 04 Mar 2024
AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks Yifan Zeng Yiran Wu Xiao Zhang Huazheng Wang Qingyun Wu LLMAG AAML 42 59 0 02 Mar 2024
Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment Yiju Guo Ganqu Cui Lifan Yuan Ning Ding Jiexin Wang ... Ruobing Xie Jie Zhou Yankai Lin Zhiyuan Liu Maosong Sun 36 58 0 29 Feb 2024
Beyond Natural Language: LLMs Leveraging Alternative Formats for Enhanced Reasoning and Communication Weize Chen Chenfei Yuan Jiarui Yuan Yusheng Su Cheng Qian Cheng Yang Ruobing Xie Zhiyuan Liu Maosong Sun 31 9 0 28 Feb 2024
Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key? Qineng Wang Zihao Wang Ying Su Hanghang Tong Yangqiu Song LLMAG LRM 41 58 0 28 Feb 2024
Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimization Wenqi Zhang Ke Tang Hai Wu Mengna Wang Yongliang Shen Guiyang Hou Zeqi Tan Peng Li Yueting Zhuang Weiming Lu LLMAG 44 37 0 27 Feb 2024
MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoning Debrup Das Debopriyo Banerjee Somak Aditya Ashish Kulkarni ReLM LRM 36 10 0 27 Feb 2024
Large Language Model for Participatory Urban Planning Zhilun Zhou Yuming Lin Depeng Jin Yong Li LLMAG 39 26 0 27 Feb 2024
Language Agents as Optimizable Graphs Mingchen Zhuge Wenyi Wang Louis Kirsch Francesco Faccio Dmitrii Khizbullin Jürgen Schmidhuber LLMAG 29 19 0 26 Feb 2024
Navigating Complexity: Orchestrated Problem Solving with Multi-Agent LLMs Sumedh Rasal E. Hauer 32 0 0 26 Feb 2024
GenAINet: Enabling Wireless Collective Intelligence via Knowledge Transfer and Reasoning Han Zou Qiyang Zhao Lina Bariah Yu Tian M. Bennis S. Lasaulce 101 12 0 26 Feb 2024