Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery

7 February 2023

Papers citing "Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery"

50 / 197 papers shown

Title
Visually Guided Decoding: Gradient-Free Hard Prompt Inversion with Language Models Donghoon Kim Minji Bae Kyuhong Shim B. Shim 38 0 0 13 May 2025
Evaluating the Effectiveness of Black-Box Prompt Optimization as the Scale of LLMs Continues to Grow Ziyu Zhou Yihang Wu J. Yang Zhan Xiao Rongjun Li LRM 34 0 0 13 May 2025
Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusion Anle Ke Xu Zhang Tong Chen Ming Lu Chao Zhou Jiawen Gu Zhan Ma DiffM 35 0 0 13 May 2025
PLHF: Prompt Optimization with Few-Shot Human Feedback Chun-Pai Yang Kan Zheng Shou-De Lin 24 0 0 11 May 2025
Divide, Optimize, Merge: Fine-Grained LLM Agent Optimization at Scale Jiale Liu Yifan Zeng Shaokun Zhang Chi Zhang Malte Højmark-Bertelsen Marie Normann Gadeberg H. Wang Qingyun Wu 41 0 0 06 May 2025
Demystifying optimized prompts in language models Rimon Melamed Lucas H. McCabe H. H. Huang 44 0 0 04 May 2025
OET: Optimization-based prompt injection Evaluation Toolkit Jinsheng Pan Xiaogeng Liu Chaowei Xiao AAML 73 0 0 01 May 2025
NeuRel-Attack: Neuron Relearning for Safety Disalignment in Large Language Models Yi Zhou Wenpeng Xing Dezhang Kong Changting Lin Meng Han MU KELM LLMSV 52 0 0 29 Apr 2025
YoChameleon: Personalized Vision and Language Generation Thao Nguyen Krishna Kumar Singh Jing Shi Trung H. Bui Yong Jae Lee Yuheng Li MLLM 82 0 0 29 Apr 2025
A Cryptographic Perspective on Mitigation vs. Detection in Machine Learning Greg Gluch Shafi Goldwasser AAML 39 0 0 28 Apr 2025
Enhancing Privacy-Utility Trade-offs to Mitigate Memorization in Diffusion Models Chong Chen Daochang Liu M. Shah Chang Xu 66 1 0 25 Apr 2025
What Lurks Within? Concept Auditing for Shared Diffusion Models at Scale Xiaoyong Yuan Xiaolong Ma Linke Guo Lan Zhang DiffM 42 0 0 21 Apr 2025
Diverse Prompts: Illuminating the Prompt Space of Large Language Models with MAP-Elites Gabriel Santos Rita Julia Marcelo Nascimento 31 0 0 19 Apr 2025
POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generation Evans Xu Han Alice Qian Zhang Hong Shen Haiyi Zhu Paul Pu Liang Jane Hsieh 40 0 0 18 Apr 2025
PR-Attack: Coordinated Prompt-RAG Attacks on Retrieval-Augmented Generation in Large Language Models via Bilevel Optimization Yang Jiao Xiao Wang Kai Yang AAML SILM 35 0 0 10 Apr 2025
Revealing the Intrinsic Ethical Vulnerability of Aligned Large Language Models Jiawei Lian Jianhong Pan L. Wang Yi Wang Shaohui Mei Lap-Pui Chau AAML 31 0 0 07 Apr 2025
A Framework for Lightweight Responsible Prompting Recommendation Tiago Machado Sara E. Berger Cassia Sanctos Vagner Figueiredo de Santana Lemara Williams Zhaoqing Wu 33 0 0 29 Mar 2025
IPGO: Indirect Prompt Gradient Optimization for Parameter-Efficient Prompt-level Fine-Tuning on Text-to-Image Models Jianping Ye Michel Wedel Kunpeng Zhang 44 0 0 25 Mar 2025
Reverse Prompt: Cracking the Recipe Inside Text-to-Image Generation Zhiyao Ren Yibing Zhan B. Yu Dacheng Tao DiffM 74 0 0 25 Mar 2025
MARS: A Multi-Agent Framework Incorporating Socratic Guidance for Automated Prompt Optimization Jian Zhang Zihan Wang Haiping Zhu Jun Liu Qika Lin Min Zhang LLMAG 83 1 0 21 Mar 2025
PerCoV2: Improved Ultra-Low Bit-Rate Perceptual Image Compression with Implicit Hierarchical Masked Image Modeling Nikolai Korber Eduard Kromer Andreas Siebert S. Hauke Daniel Mueller-Gritschneder Björn Schuller 56 0 0 12 Mar 2025
PromptMap: An Alternative Interaction Style for AI-Based Image Generation Krzysztof Adamkiewicz Paweł W. Woźniak Julia Dominiak Andrzej Romanowski Jakob Karolus Stanislav Frolov 67 1 0 12 Mar 2025
Automatic Prompt Optimization via Heuristic Search: A Survey Wendi Cui Jiaxin Zhang ZeLin Li Hao Sun Damien Lopez Kamalika Das Bradley Malin Sricharan Kumar 38 1 0 26 Feb 2025
Culture-TRIP: Culturally-Aware Text-to-Image Generation with Iterative Prompt Refinement Suchae Jeong Inseong Choi Youngsik Yun Jihie Kim DiffM 44 2 0 24 Feb 2025
On the Vulnerability of Concept Erasure in Diffusion Models Lucas Beerens Alex D. Richardson Peng Sun Dongdong Chen DiffM 68 2 0 24 Feb 2025
Attention Eclipse: Manipulating Attention to Bypass LLM Safety-Alignment Pedram Zaree Md Abdullah Al Mamun Quazi Mishkatul Alam Yue Dong Ihsen Alouani Nael B. Abu-Ghazaleh AAML 41 0 0 24 Feb 2025
REINFORCE Adversarial Attacks on Large Language Models: An Adaptive, Distributional, and Semantic Objective Simon Geisler Tom Wollschlager M. H. I. Abdalla Vincent Cohen-Addad Johannes Gasteiger Stephan Günnemann AAML 88 2 0 24 Feb 2025
A Comprehensive Survey on Concept Erasure in Text-to-Image Diffusion Models Changhoon Kim Yanjun Qi DiffM 49 2 0 17 Feb 2025
Has My System Prompt Been Used? Large Language Model Prompt Membership Inference Roman Levin Valeriia Cherepanova Abhimanyu Hans Avi Schwarzschild Tom Goldstein 215 1 0 14 Feb 2025
FIT-Print: Towards False-claim-resistant Model Ownership Verification via Targeted Fingerprint Shuo Shao Haozhe Zhu Hongwei Yao Yiming Li Tianwei Zhang Zhan Qin Kui Ren 212 0 0 28 Jan 2025
Refining Input Guardrails: Enhancing LLM-as-a-Judge Efficiency Through Chain-of-Thought Fine-Tuning and Alignment Melissa Kazemi Rad Huy Nghiem Andy Luo Sahil Wadhwa Mohammad Sorower Stephen Rawls AAML 93 2 0 22 Jan 2025
Lossy Compression with Pretrained Diffusion Models Jeremy Vonderfecht Feng Liu DiffM 105 1 0 20 Jan 2025
Differentiable Adversarial Attacks for Marked Temporal Point Processes Pritish Chakraborty Vinayak Gupta R. Raj Srikanta J. Bedathur A. De AAML 259 0 0 17 Jan 2025
LLM-Virus: Evolutionary Jailbreak Attack on Large Language Models Miao Yu Junfeng Fang Yingjie Zhou Xing Fan Kun Wang Shirui Pan Qingsong Wen AAML 65 0 0 03 Jan 2025
Dynamics of Adversarial Attacks on Large Language Model-Based Search Engines Xiyang Hu AAML 36 1 0 01 Jan 2025
SilVar: Speech Driven Multimodal Model for Reasoning Visual Question Answering and Object Localization Tan-Hanh Pham Hoang-Nam Le Phu-Vinh Nguyen Chris Ngo Truong-Son Hy AuLLM LRM 96 1 0 21 Dec 2024
From General to Specific: Tailoring Large Language Models for Personalized Healthcare Ruize Shi Hong Huang Wei Zhou Kehan Yin Kai Zhao Yun Zhao LM&MA AI4MH 81 0 0 20 Dec 2024
IntroStyle: Training-Free Introspective Style Attribution using Diffusion Features Anand Kumar Jiteng Mu Nuno Vasconcelos DiffM 88 0 0 19 Dec 2024
Rethinking the Intermediate Features in Adversarial Attacks: Misleading Robotic Models via Adversarial Distillation Ke Zhao Huayang Huang Miao Li Yu Wu AAML 71 1 0 21 Nov 2024
MC-LLaVA: Multi-Concept Personalized Vision-Language Model Ruichuan An Sihan Yang Ming Lu Kai Zeng Yulin Luo ... Hao Liang Qi She Shanghang Zhang Feiyu Xiong Wentao Zhang 90 5 0 18 Nov 2024
Human-inspired Perspectives: A Survey on AI Long-term Memory Zihong He Weizhe Lin Hao Zheng Fan Zhang Matt Jones Laurence Aitchison X. Xu Miao Liu Per Ola Kristensson Junxiao Shen 77 2 0 01 Nov 2024
Order Matters: Exploring Order Sensitivity in Multimodal Large Language Models Zhijie Tan Xu Chu Weiping Li Tong Mo 33 1 0 22 Oct 2024
GlitchMiner: Mining Glitch Tokens in Large Language Models via Gradient-based Discrete Optimization Zihui Wu Haichang Gao Ping Wang Shudong Zhang Zhaoxiang Liu Kai Wang 34 0 0 19 Oct 2024
Imprompter: Tricking LLM Agents into Improper Tool Use Xiaohan Fu Shuheng Li Zihan Wang Yong Liu Rajesh K. Gupta Taylor Berg-Kirkpatrick Earlence Fernandes SILM LLMAG 54 15 0 19 Oct 2024
Deciphering the Chaos: Enhancing Jailbreak Attacks via Adversarial Prompt Translation Qizhang Li Xiaochen Yang W. Zuo Yiwen Guo AAML 68 1 0 15 Oct 2024
StraGo: Harnessing Strategic Guidance for Prompt Optimization Yurong Wu Yan Gao Bin Benjamin Zhu Zineng Zhou Xiaodi Sun Sheng Yang Jian-Guang Lou Zhiming Ding Linjun Yang LLMAG 49 3 0 11 Oct 2024
Revealing the Unseen: Guiding Personalized Diffusion Models to Expose Training Data Xiaoyu Wu Jiaru Zhang Steven Wu 42 1 0 03 Oct 2024
HiddenGuard: Fine-Grained Safe Generation with Specialized Representation Router Lingrui Mei Shenghua Liu Yiwei Wang Baolong Bi Ruibin Yuan Xueqi Cheng 35 5 0 03 Oct 2024
Verbalized Graph Representation Learning: A Fully Interpretable Graph Model Based on Large Language Models Throughout the Entire Process Xingyu Ji Jiale Liu Lu Li Maojun Wang Zeyu Zhang 36 1 0 02 Oct 2024
PerCo (SD): Open Perceptual Compression Nikolai Korber Eduard Kromer Andreas Siebert S. Hauke Daniel Mueller-Gritschneder Björn Schuller 37 4 0 30 Sep 2024