Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,700 papers shown

Title
Fast or Slow? Integrating Fast Intuition and Deliberate Thinking for Enhancing Visual Question Answering Songtao Jiang Chenyi Zhou Yan Zhang Yeying Jin Zuozhu Liu LRM 57 1 0 01 Jun 2025
PFMBench: Protein Foundation Model Benchmark Zhangyang Gao Hao Wang Cheng Tan Chenrui Xu Mengdi Liu Bozhen Hu Linlin Chao Xiaoming Zhang Stan Z. Li 29 0 0 01 Jun 2025
FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts Xinyi Wang Lirong Gao Haobo Wang Yiming Zhang Junbo Zhao MoE 53 0 0 31 May 2025
Prompt-Tuned LLM-Augmented DRL for Dynamic O-RAN Network Slicing Fatemeh Lotfi Hossein Rajoli Fatemeh Afghah 41 0 0 31 May 2025
A Brain Graph Foundation Model: Pre-Training and Prompt-Tuning for Any Atlas and Disorder Xinxu Wei K. Zhao Yong Jiao Lifang He Yu Zhang AI4CE 39 0 0 31 May 2025
Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection Yeshwanth Venkatesha Souvik Kundu Priyadarshini Panda 38 1 0 31 May 2025
Structuring Radiology Reports: Challenging LLMs with Lightweight Models Johannes Moll Louisa Fay Asfandyar Azhar Sophie Ostmeier Tim Lueth S. Gatidis Curtis P. Langlotz Jean-Benoit Delbrouck 32 0 0 30 May 2025
Lossless Token Sequence Compression via Meta-Tokens John Harvill Ziwei Fan Hao Wang Yizhou Sun Hao Ding Luke Huan Anoop Deoras 42 0 0 30 May 2025
Position: Federated Foundation Language Model Post-Training Should Focus on Open-Source Models Nikita Agrawal Simon Mertel R. Mayer 95 0 0 29 May 2025
Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics Shiwei Li Xiandi Luo Xing Tang Haozhao Wang Hao Chen Weihong Luo Yuhua Li Xiuqiang He Ruixuan Li AI4CE 58 0 0 29 May 2025
MAP: Revisiting Weight Decomposition for Low-Rank Adaptation Chongjie Si Zhiyi Shi Yadao Wang Xiaokang Yang Susanto Rahardja Wei Shen 70 0 0 29 May 2025
Adaptive Federated LoRA in Heterogeneous Wireless Networks with Independent Sampling Yanzhao Hou Jiaxiang Geng Boyu Li Xiaofeng Tao Juncheng Wang Xiaodong Xu B. Luo 70 0 0 29 May 2025
Noise-Robustness Through Noise: Asymmetric LoRA Adaption with Poisoning Expert Zhaokun Wang Jinyu Guo Jingwen Pu Lingfeng Chen Hongli Pu Jie Ou.Libo Qin Libo Qin Wenhong Tian AAML 43 0 0 29 May 2025
Flexible Tool Selection through Low-dimensional Attribute Alignment of Vision and Language Guangfu Hao Haojie Wen Liangxuna Guo Yang Chen Yanchao Bi S. Yu 66 0 0 28 May 2025
MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning Dacao Zhang Kun Zhang Shimao Chu Le Wu Xin Li Si Wei MoE ALM OffRL 48 0 0 28 May 2025
On Geometry-Enhanced Parameter-Efficient Fine-Tuning for 3D Scene Segmentation Liyao Tang Zhe Chen Dacheng Tao 3DPC 62 0 0 28 May 2025
Improving Brain-to-Image Reconstruction via Fine-Grained Text Bridging Runze Xia Shuo Feng Renzhi Wang Congchi Yin Xuyun Wen Piji Li DiffM 55 0 0 28 May 2025
Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets Dongyue Li Ziniu Zhang Lu Wang Hongyang R. Zhang 41 1 0 28 May 2025
Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning Yongkang Liu Xingle Xu Ercong Nie Zijing Wang Shi Feng Daling Wang Qian Li Hinrich Schutze 43 0 0 28 May 2025
DenseLoRA: Dense Low-Rank Adaptation of Large Language Models Lin Mu Xiaoyu Wang Li Ni Yang Li Zhize Wu Peiquan Jin Yiwen Zhang ALM AI4CE 43 0 0 27 May 2025
Why Do More Experts Fail? A Theoretical Analysis of Model Merging Zijing Wang Xingle Xu Yongkang Liu Yiqun Zhang Peiqin Lin Shi Feng Xiaocui Yang Daling Wang Hinrich Schütze MoMe 66 0 0 27 May 2025
Improved Representation Steering for Language Models Zhengxuan Wu Qinan Yu Aryaman Arora Christopher D. Manning Christopher Potts LLMSV 86 0 0 27 May 2025
Information-Theoretic Complementary Prompts for Improved Continual Text Classification Duzhen Zhang Yong Ren Chenxing Li Dong Yu Tielin Zhang CLL VLM 116 0 0 27 May 2025
Exploring the Latent Capacity of LLMs for One-Step Text Generation Gleb Mezentsev Ivan Oseledets 46 0 0 27 May 2025
LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning Nurbek Tastan Stefanos Laskaridis Martin Takáč Karthik Nandakumar Samuel Horváth AI4CE 94 0 0 27 May 2025
SCIRGC: Multi-Granularity Citation Recommendation and Citation Sentence Preference Alignment Xiangyu Li Jingqiang Chen 3DV 75 0 0 26 May 2025
MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought Reasoning Thang Nguyen Peter Chin Yu-Wing Tai LRM 97 1 0 26 May 2025
MetaWriter: Personalized Handwritten Text Recognition Using Meta-Learned Prompt Tuning Wenhao Gu Li Gu Ching Yee Suen Yang Wang 83 0 0 26 May 2025
RefLoRA: Refactored Low-Rank Adaptation for Efficient Fine-Tuning of Large Models Yilang Zhang Bingcong Li G. Giannakis 253 1 0 24 May 2025
KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning Zhendong Mi Qitao Tan Xiaodong Yu Zining Zhu Geng Yuan Shaoyi Huang 210 0 0 24 May 2025
HD-PiSSA: High-Rank Distributed Orthogonal Adaptation Yiding Wang Fauxu meng Xuefeng Zhang Fan Jiang Pingzhi Tang Muhan Zhang 69 0 0 24 May 2025
LiSTEN: Learning Soft Token Embeddings for Neural Audio LLMs Pooneh Mousavi Shubham Gupta Cem Subakan Mirco Ravanelli 64 0 0 24 May 2025
ThanoRA: Task Heterogeneity-Aware Multi-Task Low-Rank Adaptation Jian Liang Wenke Huang Xianda Guo Guancheng Wan Bo Du Mang Ye MoMe MoE 81 0 0 24 May 2025
CoMoE: Contrastive Representation for Mixture-of-Experts in Parameter-Efficient Fine-tuning Jinyuan Feng Chaopeng Wei Tenghai Qiu Tianyi Hu Zhiqiang Pu MoE 101 0 0 23 May 2025
Enhancing Adversarial Robustness of Vision Language Models via Adversarial Mixture Prompt Tuning Shiji Zhao Qihui Zhu Shukun Xiong Shouwei Ruan Yize Fan Ranjie Duan Qing Guo Xingxing Wei AAML VLM 143 0 0 23 May 2025
Representation Discrepancy Bridging Method for Remote Sensing Image-Text Retrieval Hailong Ning Siying Wang Tao Lei Xiaopeng Cao Huanmin Dou Bin Zhao Asoke K. Nandi Petia Radeva 51 0 0 22 May 2025
Only Large Weights (And Not Skip Connections) Can Prevent the Perils of Rank Collapse Josh Alman Zhao Song 124 2 0 22 May 2025
Amplify Adjacent Token Differences: Enhancing Long Chain-of-Thought Reasoning with Shift-FFN Yao Xu Mingyu Xu Fangyu Lei Wangtao Sun Xiangrong Zeng Bingning Wang Guang Liu Shizhu He Jun Zhao Kang Liu LRM 89 1 0 22 May 2025
Understanding Prompt Tuning and In-Context Learning via Meta-Learning Tim Genewein Kevin Wenliang Li Jordi Grau-Moya Anian Ruoss Laurent Orseau Marcus Hutter VPVLM 109 1 0 22 May 2025
Few-Shot Adversarial Low-Rank Fine-Tuning of Vision-Language Models Sajjad Ghiasvand Haniyeh Ehsani Oskouie Mahnoosh Alizadeh Ramtin Pedarsani AAML VLM 82 0 0 21 May 2025
Joint Flashback Adaptation for Forgetting-Resistant Instruction Tuning Yukun Zhao Lingyong Yan Zhenyang Li Shuaiqiang Wang Zhumin Chen Zhaochun Ren Dawei Yin CLL KELM VLM LRM 100 0 0 21 May 2025
MoTE: Mixture of Task-specific Experts for Pre-Trained ModelBased Class-incremental Learning Linjie Li Zhenyu Wu Yang Ji MoE CLL 37 0 0 21 May 2025
Small Language Models in the Real World: Insights from Industrial Text Classification Lujun Li Lama Sleem Niccolo Gentile Geoffrey Nichil Radu State LLMAG 230 0 0 21 May 2025
Soft Prompts for Evaluation: Measuring Conditional Distance of Capabilities Ross Nordby 69 0 0 20 May 2025
Quaff: Quantized Parameter-Efficient Fine-Tuning under Outlier Spatial Stability Hypothesis Hong Huang Dapeng Wu 122 0 0 20 May 2025
Towards Rehearsal-Free Continual Relation Extraction: Capturing Within-Task Variance with Adaptive Prompting Bao-Ngoc Dao Quang Nguyen Luyen Ngo Dinh Minh Le Nam Le Linh Ngo Van CLL 73 0 0 20 May 2025
Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Space Hengli Li Chenxi Li Tong Wu Xuekai Zhu Yuxuan Wang ... Eric Hanchen Jiang Song-Chun Zhu Zixia Jia Ying Nian Wu Zilong Zheng LRM 130 1 0 19 May 2025
Prompt Stability Matters: Evaluating and Optimizing Auto-Generated Prompt in General-Purpose Systems Ke Chen Yufei Zhou Xitong Zhang Haohan Wang 109 1 0 19 May 2025
Distribution Prompting: Understanding the Expressivity of Language Models Through the Next-Token Distributions They Can Produce Haojin Wang Zining Zhu Freda Shi 67 0 0 18 May 2025
SRLoRA: Subspace Recomposition in Low-Rank Adaptation via Importance-Based Fusion and Reinitialization Haodong Yang Lei Wang Md Zakir Hossain 106 0 0 18 May 2025