Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents

4 May 2025

Papers citing "Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents"

46 / 46 papers shown

Title
Get Experience from Practice: LLM Agents with Record & Replay Erhu Feng Wenbo Zhou Zibin Liu Le Chen Yunpeng Dong ... Yisheng Zhao Dong Du Zhichao Hua Yubin Xia Haibo Chen 104 0 0 23 May 2025
REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites Divyansh Garg Shaun VanWeelden Diego Caples Andis Draguns Nikil Ravi ... Youngchul Joo Jindong Gu Charles London Christian Schroeder de Witt S. Motwani 137 3 0 15 Apr 2025
Frontier AI's Impact on the Cybersecurity Landscape Wenbo Guo Yujin Potter Tianneng Shi Zhun Wang Andy Zhang Dawn Song 93 2 0 07 Apr 2025
An Illusion of Progress? Assessing the Current State of Web Agents Tianci Xue Weijian Qi Tianneng Shi Chan Hee Song Boyu Gou Basel Alomair Huan Sun Yu Su LLMAG ELM Presented at ResearchTrend Connect \| LLMAG on 21 May 2025 249 13 1 02 Apr 2025
Attacking Multimodal OS Agents with Malicious Image Patches Lukas Aichberger Alasdair Paren Y. Gal Philip Torr Adel Bibi AAML 110 5 0 13 Mar 2025
Multi-Agent Security Tax: Trading Off Security and Collaboration Capabilities in Multi-Agent Systems Pierre Peigne-Lefebvre Mikolaj Kniejski Filip Sondej Matthieu David J. Hoelscher-Obermaier Christian Schroeder de Witt Esben Kran 117 7 0 26 Feb 2025
Multi-Agent Risks from Advanced AI Lewis Hammond Alan Chan Jesse Clifton J. Hoelscher-Obermaier Akbir Khan ... K. Larson Joel Lehman David C. Parkes Georgios Piliouras Iyad Rahwan 85 29 0 19 Feb 2025
LLM Agents Making Agent Tools Georg Wolflein Dyke Ferber Daniel Truhn Ognjen Arandjelovic Jakob Nikolas Kather LLMAG 110 6 0 17 Feb 2025
SMART: Self-Aware Agent for Tool Overuse Mitigation Cheng Qian Emre Can Acikgoz H. Wang Xiusi Chen Avirup Sil Dilek Hakkani-Tur Gokhan Tur Heng Ji LLMAG KELM LRM 159 9 0 17 Feb 2025
Authenticated Delegation and Authorized AI Agents Tobin South Samuele Marro Thomas Hardjono Robert Mahari Cedric Deslandes Whitney Dazza Greenwood Alan Chan Alex Pentland 116 7 0 17 Jan 2025
Agent Laboratory: Using LLM Agents as Research Assistants Samuel Schmidgall Yusheng Su Zihan Wang Xingwu Sun Jialian Wu Xiaodong Yu Jiang Liu Michael Moor Zicheng Liu Emad Barsoum LLMAG 85 60 2 08 Jan 2025
Neural Interactive Proofs Lewis Hammond Sam Adam-Day AAML 121 3 0 12 Dec 2024
Automated Red Teaming with GOAT: the Generative Offensive Agent Tester Maya Pavlova Erik Brinkman Krithika Iyer Vítor Albiero Joanna Bitton Hailey Nguyen Jingkai Li Cristian Canton Ferrer Ivan Evtimov Aaron Grattafiori ALM 67 12 0 02 Oct 2024
Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale Rogerio Bonatti Dan Zhao Francesco Bonacci Dillon Dupont Sara Abdali ... Justin Wagle K. Koishida A. Bucker Lawrence Jang Zack Hui LLMAG 111 45 0 12 Sep 2024
Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents Pranav Putta Edmund Mills Naman Garg S. Motwani Chelsea Finn Divyansh Garg Rafael Rafailov LLMAG LRM 79 87 0 13 Aug 2024
Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation Danny Halawi Alexander Wei Eric Wallace Tony T. Wang Nika Haghtalab Jacob Steinhardt SILM AAML 96 35 0 28 Jun 2024
AIOS: LLM Agent Operating System Kai Mei Zelong Li Wujiang Xu Wenyue Hua Mingyu Jin Yongfeng Zhang Shuyuan Xu Ruosong Ye Yingqiang Ge Yongfeng Zhang LLMAG 113 25 0 25 Mar 2024
Exploring LLM-based Agents for Root Cause Analysis Devjeet Roy Xuchao Zhang Rashi Bhave Chetan Bansal P. Las-Casas Rodrigo Fonseca Saravan Rajmohan 107 29 0 07 Mar 2024
AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks Jiacen Xu Jack W. Stokes Geoff McDonald Xuesong Bai David Marshall Siyue Wang Adith Swaminathan Zhou Li 100 58 0 02 Mar 2024
Teach LLMs to Phish: Stealing Private Information from Language Models Ashwinee Panda Christopher A. Choquette-Choo Zhengming Zhang Yaoqing Yang Prateek Mittal PILM 110 26 0 01 Mar 2024
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Xing Han Lù Zdeněk Kasner Siva Reddy 84 77 0 08 Feb 2024
Visibility into AI Agents Alan Chan Carson Ezell Max Kaufmann K. Wei Lewis Hammond ... Nitarshan Rajkumar David M. Krueger Noam Kolt Lennart Heim Markus Anderljung 113 42 0 23 Jan 2024
Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security Yuanchun Li Hao Wen Weijun Wang Xiangyu Li Yizhen Yuan ... Zhijun Li Peng Li Yang Liu Yaqiong Zhang Yunxin Liu LLMAG 94 189 0 10 Jan 2024
Cooperative AI via Decentralized Commitment Devices Xinyuan Sun Davide Crapis Matt Stephenson B. Monnot Thomas Thiery Jonathan Passerat-Palmbach 73 11 0 14 Nov 2023
Large-Language-Model-Powered Agent-Based Framework for Misinformation and Disinformation Research: Opportunities and Open Challenges Javier Pastor-Galindo Pantaleone Nespoli José A. Ruipérez-Valiente AI4CE LLMAG 51 4 0 11 Oct 2023
Decoding the Threat Landscape : ChatGPT, FraudGPT, and WormGPT in Social Engineering Attacks Polra Victor Falade AAML 59 35 0 09 Oct 2023
Scalable Learning of Intrusion Responses through Recursive Decomposition K. Hammar Rolf Stadler 46 8 0 06 Sep 2023
Universal and Transferable Adversarial Attacks on Aligned Language Models Andy Zou Zifan Wang Nicholas Carlini Milad Nasr J. Zico Kolter Matt Fredrikson 295 1,518 0 27 Jul 2023
WebArena: A Realistic Web Environment for Building Autonomous Agents Shuyan Zhou Frank F. Xu Hao Zhu Xuhui Zhou Robert Lo ... Tianyue Ou Yonatan Bisk Daniel Fried Uri Alon Graham Neubig LLMAG 178 494 0 25 Jul 2023
ReAct: Synergizing Reasoning and Acting in Language Models Shunyu Yao Jeffrey Zhao Dian Yu Nan Du Izhak Shafran Karthik Narasimhan Yuan Cao LLMAG ReLM LRM 450 2,982 0 06 Oct 2022
Learning to Deceive in Multi-Agent Hidden Role Games Matthew Aitchison L. Benke Penny Sweetser OffRL 42 5 0 04 Sep 2022
GPT-NeoX-20B: An Open-Source Autoregressive Language Model Sid Black Stella Biderman Eric Hallahan Quentin G. Anthony Leo Gao ... Shivanshu Purohit Laria Reynolds J. Tow Benqi Wang Samuel Weinbach 184 836 0 14 Apr 2022
Red Teaming Language Models with Language Models Ethan Perez Saffron Huang Francis Song Trevor Cai Roman Ring John Aslanides Amelia Glaese Nat McAleese G. Irving AAML 185 668 0 07 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 856 9,714 0 28 Jan 2022
Human Cognition through the Lens of Social Engineering Cyberattacks Rosana Montañez Rodriguez E. Golob Shouhuai Xu AAML 43 58 0 09 Jul 2020
Free-rider Attacks on Model Aggregation in Federated Learning Yann Fraboni Richard Vidal Marco Lorenzi FedML 64 131 0 21 Jun 2020
Advances and Open Problems in Federated Learning Peter Kairouz H. B. McMahan Brendan Avent A. Bellet M. Bennis ... Zheng Xu Qiang Yang Felix X. Yu Han Yu Sen Zhao FedML AI4CE 279 6,307 0 10 Dec 2019
Adversarial Policies: Attacking Deep Reinforcement Learning Adam Gleave Michael Dennis Cody Wild Neel Kant Sergey Levine Stuart J. Russell AAML 85 361 0 25 May 2019
Supervising strong learners by amplifying weak experts Paul Christiano Buck Shlegeris Dario Amodei 66 124 0 19 Oct 2018
Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments Ryan J. Lowe Yi Wu Aviv Tamar J. Harb Pieter Abbeel Igor Mordatch 164 4,520 0 07 Jun 2017
Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols Serhii Havrylov Ivan Titov LLMAG 94 288 0 31 May 2017
Counterfactual Multi-Agent Policy Gradients Jakob N. Foerster Gregory Farquhar Triantafyllos Afouras Nantas Nardelli Shimon Whiteson 158 2,090 0 24 May 2017
Multi-Agent Cooperation and the Emergence of (Natural) Language Angeliki Lazaridou A. Peysakhovich Marco Baroni LLMAG 125 434 0 21 Dec 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 414 17,615 0 17 Feb 2016
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 293 14,978 1 21 Dec 2013
Poisoning Attacks against Support Vector Machines Battista Biggio B. Nelson Pavel Laskov AAML 129 1,595 0 27 Jun 2012