v1v2 (latest)

AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agents

12 March 2025

Papers citing "AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agents"

37 / 37 papers shown

Title
Leaky Thoughts: Large Reasoning Models Are Not Private Thinkers Tommaso Green Martin Gubri Haritz Puerto Sangdoo Yun Seong Joon Oh PILM LRM 75 0 2 18 Jun 2025
LLM Agents Should Employ Security Principles Kaiyuan Zhang Zian Su Pin-Yu Chen E. Bertino Xiangyu Zhang Ninghui Li LLMAG Presented at ResearchTrend Connect \| LLMAG on 02 Jul 2025 78 1 0 29 May 2025
Keep Security! Benchmarking Security Policy Preservation in Large Language Model Contexts Against Indirect Attacks in Question Answering Hwan Chang Yumin Kim Yonghyun Jun Hwanhee Lee AAML ELM 70 0 0 21 May 2025
WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks Ivan Evtimov Arman Zharmagambetov Aaron Grattafiori Chuan Guo Kamalika Chaudhuri AAML 116 4 0 22 Apr 2025
DoomArena: A framework for Testing AI Agents Against Evolving Security Threats Léo Boisvert Mihir Bansal Chandra Kiran Reddy Evuru Gabriel Huang Abhay Puri ... Quentin Cappart Jason Stanley Alexandre Lacoste Alexandre Drouin Krishnamurthy Dvijotham 129 3 0 18 Apr 2025
Watch Out Your Album! On the Inadvertent Privacy Memorization in Multi-Modal Large Language Models Tianjie Ju Yi Hua Hao Fei Zhenyu Shao Yubin Zheng Haodong Zhao Mong Li Lee Wynne Hsu Zhuosheng Zhang Gongshen Liu 146 0 0 03 Mar 2025
PrivAgent: Agentic-based Red-teaming for LLM Privacy Leakage Yuzhou Nie Zhun Wang Ye Yu Xian Wu Xuandong Zhao Wenbo Guo Dawn Song AAML 106 6 0 07 Dec 2024
GPT-4o System Card OpenAI OpenAI : Aaron Hurst Adam Lerer Adam P. Goucher ... Yuchen He Yuchen Zhang Yujia Jin Yunxing Dai Yury Malkov MLLM 242 1,039 0 25 Oct 2024
Imprompter: Tricking LLM Agents into Improper Tool Use Xiaohan Fu Shuheng Li Zihan Wang Yong Liu Rajesh K. Gupta Taylor Berg-Kirkpatrick Earlence Fernandes SILM LLMAG 94 17 0 19 Oct 2024
CI-Bench: Benchmarking Contextual Integrity of AI Assistants on Synthetic Data Zhao Cheng Diane Wan Matthew Abueg Sahra Ghalebikesabi Ren Yi Eugene Bagdasarian Borja Balle S. Mellem S. O’Banion 55 6 0 20 Sep 2024
PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action Yijia Shao Tianshi Li Weiyan Shi Yanchen Liu Diyi Yang PILM 165 31 0 29 Aug 2024
Operationalizing Contextual Integrity in Privacy-Conscious Assistants Sahra Ghalebikesabi Eugene Bagdasaryan Ren Yi Itay Yona Ilia Shumailov ... Robert Stanforth Leonard Berrada Pushmeet Kohli Po-Sen Huang Borja Balle 102 13 0 05 Aug 2024
$τ$ -bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains Shunyu Yao Noah Shinn P. Razavi Karthik Narasimhan ALM 102 85 0 17 Jun 2024
Security of AI Agents Yifeng He Ethan Wang Yuyang Rong Zifei Cheng Hao Chen LLMAG 106 10 0 12 Jun 2024
AdvPrompter: Fast Adaptive Adversarial Prompting for LLMs Anselm Paulus Arman Zharmagambetov Chuan Guo Brandon Amos Yuandong Tian AAML 142 67 0 21 Apr 2024
A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systems Fangzhou Wu Ning Zhang Somesh Jha P. McDaniel Chaowei Xiao 98 75 0 28 Feb 2024
Do Membership Inference Attacks Work on Large Language Models? Michael Duan Anshuman Suri Niloofar Mireshghallah Sewon Min Weijia Shi Luke Zettlemoyer Yulia Tsvetkov Yejin Choi David Evans Hanna Hajishirzi MIALM 130 100 0 12 Feb 2024
LLM Agents can Autonomously Hack Websites Richard Fang R. Bindu Akul Gupta Qiusi Zhan Daniel Kang LLMAG 75 62 0 06 Feb 2024
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks Jing Yu Koh Robert Lo Lawrence Jang Vikram Duvvur Ming Chong Lim Po-Yu Huang Graham Neubig Shuyan Zhou Ruslan Salakhutdinov Daniel Fried 128 0 0 24 Jan 2024
GPT-4V(ision) is a Generalist Web Agent, if Grounded Boyuan Zheng Boyu Gou Jihyung Kil Huan Sun Yu-Chuan Su MLLM VLM LLMAG 140 264 0 03 Jan 2024
A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly Yifan Yao Jinhao Duan Kaidi Xu Yuanfang Cai Eric Sun Yue Zhang PILM ELM 119 561 0 04 Dec 2023
Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theory Niloofar Mireshghallah Hyunwoo J. Kim Xuhui Zhou Yulia Tsvetkov Maarten Sap Reza Shokri Yejin Choi PILM 99 91 0 27 Oct 2023
Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V Jianwei Yang Hao Zhang Feng Li Xueyan Zou Chun-yue Li Jianfeng Gao MLLM VLM 124 189 0 17 Oct 2023
Beyond Memorization: Violating Privacy Via Inference with Large Language Models Robin Staab Mark Vero Mislav Balunović Martin Vechev PILM 73 94 0 11 Oct 2023
Misusing Tools in Large Language Models With Visual Adversarial Examples Xiaohan Fu Zihan Wang Shuheng Li Rajesh K. Gupta Niloofar Mireshghallah Taylor Berg-Kirkpatrick Earlence Fernandes AAML 82 27 0 04 Oct 2023
Identifying the Risks of LM Agents with an LM-Emulated Sandbox Yangjun Ruan Honghua Dong Andrew Wang Silviu Pitis Yongchao Zhou Jimmy Ba Yann Dubois Chris J. Maddison Tatsunori Hashimoto LLMAG ELM 69 124 0 25 Sep 2023
Efficient Memory Management for Large Language Model Serving with PagedAttention Woosuk Kwon Zhuohan Li Siyuan Zhuang Ying Sheng Lianmin Zheng Cody Hao Yu Joseph E. Gonzalez Haotong Zhang Ion Stoica VLM 204 2,338 0 12 Sep 2023
WebArena: A Realistic Web Environment for Building Autonomous Agents Shuyan Zhou Frank F. Xu Hao Zhu Xuhui Zhou Robert Lo ... Tianyue Ou Yonatan Bisk Daniel Fried Uri Alon Graham Neubig LLMAG 212 496 0 25 Jul 2023
Gorilla: Large Language Model Connected with Massive APIs Shishir G. Patil Tianjun Zhang Xin Wang Joseph E. Gonzalez ELM CLL ALM SyDa 97 572 0 24 May 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.6K 14,828 0 15 Mar 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 445 4,666 0 30 Jan 2023
What Does it Mean for a Language Model to Preserve Privacy? Hannah Brown Katherine Lee Fatemehsadat Mireshghallah Reza Shokri Florian Tramèr PILM 104 243 0 11 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 948 9,784 0 28 Jan 2022
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown Basel Alomair Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 559 1,964 0 14 Dec 2020
Membership Inference Attacks against Machine Learning Models Reza Shokri M. Stronati Congzheng Song Vitaly Shmatikov SLR MIALM MIACV 306 4,174 0 18 Oct 2016
Deep Learning with Differential Privacy Martín Abadi Andy Chu Ian Goodfellow H. B. McMahan Ilya Mironov Kunal Talwar Li Zhang FedML SyDa 234 6,190 0 01 Jul 2016
Differentially Private Empirical Risk Minimization Kamalika Chaudhuri C. Monteleoni Anand D. Sarwate 218 1,491 0 01 Dec 2009