Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,611 papers shown

Title
RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization Dongqi Pu Vera Demberg 56 5 0 01 May 2024
Efficient Sample-Specific Encoder Perturbations Yassir Fathullah Mark Gales 31 0 0 01 May 2024
MoPEFT: A Mixture-of-PEFTs for the Segment Anything Model Rajat Sahay Andreas E. Savakis MoE 58 0 0 01 May 2024
Constrained Decoding for Secure Code Generation Yanjun Fu Ethan Baker Yu Ding Yizheng Chen AAML 51 8 0 30 Apr 2024
StablePT: Towards Stable Prompting for Few-shot Learning via Input Separation Xiaoming Liu Chen Liu Zhaohan Zhang Chengzhengxu Li Longtian Wang Y. Lan Chao Shen VLM 55 4 0 30 Apr 2024
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition Yuxuan Yan Qianqian Yang Shunpu Tang Zhiguo Shi 56 14 0 29 Apr 2024
BlockLLM: Multi-tenant Finer-grained Serving for Large Language Models Jiamin Li Le Xu Hong-Yu Xu Aditya Akella 37 1 0 28 Apr 2024
Towards Incremental Learning in Large Language Models: A Critical Review M. Jovanovic Peter Voss ELM CLL KELM 46 5 0 28 Apr 2024
Parameter-Efficient Tuning Large Language Models for Graph Representation Learning Qi Zhu Da Zheng Xiang Song Shichang Zhang Bowen Jin Yizhou Sun George Karypis 68 2 0 28 Apr 2024
Prompt Customization for Continual Learning Yong Dai Xiaopeng Hong Yabin Wang Zhiheng Ma D. Jiang Yaowei Wang 53 0 0 28 Apr 2024
AAPL: Adding Attributes to Prompt Learning for Vision-Language Models Gahyeon Kim Sohee Kim Seokju Lee VLM 33 5 0 25 Apr 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 59 66 0 25 Apr 2024
Evolutionary Large Language Models for Hardware Security: A Comparative Survey Mohammad Akyash Hadi M Kamali 36 12 0 25 Apr 2024
Efficiency in Focus: LayerNorm as a Catalyst for Fine-tuning Medical Visual Language Pre-trained Models Jiawei Chen Dingkang Yang Yue Jiang Mingcheng Li Jinjie Wei Xiaolu Hou Lihua Zhang 61 6 0 25 Apr 2024
Training-Free Unsupervised Prompt for Vision-Language Models Sifan Long Linbin Wang Zhen Zhao Zichang Tan Yiming Wu Shengsheng Wang Jingdong Wang VLM VPVLM 66 1 0 25 Apr 2024
Online Personalizing White-box LLMs Generation with Neural Bandits Zekai Chen Weeden Daniel Po-yu Chen Francois Buet-Golfouse 44 3 0 24 Apr 2024
Leveraging Large Language Models for Multimodal Search Oriol Barbany Michael Huang Xinliang Zhu Arnab Dhua 36 9 0 24 Apr 2024
Gated Low-rank Adaptation for personalized Code-Switching Automatic Speech Recognition on the low-spec devices Gwantae Kim Bokyeung Lee Donghyeon Kim Hanseok Ko OffRL 33 0 0 24 Apr 2024
FL-TAC: Enhanced Fine-Tuning in Federated Learning via Low-Rank, Task-Specific Adapter Clustering Siqi Ping Yuzhu Mao Yang Liu Xiao-Ping Zhang Wenbo Ding FedML 39 4 0 23 Apr 2024
Simple, Efficient and Scalable Structure-aware Adapter Boosts Protein Language Models Yang Tan Mingchen Li Bingxin Zhou Bozitao Zhong Lirong Zheng P. Tan Ziyi Zhou Huiqun Yu Guisheng Fan Liang Hong 34 8 0 23 Apr 2024
Ultrasound SAM Adapter: Adapting SAM for Breast Lesion Segmentation in Ultrasound Images Zhengzheng Tu Le Gu Xixi Wang Bo Jiang MedIm 54 3 0 23 Apr 2024
Q-Tuning: Queue-based Prompt Tuning for Lifelong Few-shot Language Learning Yanhui Guo Shaoyuan Xu Jinmiao Fu Jia-Wei Liu Chaosheng Dong Bryan Wang VLM CLL 43 6 0 22 Apr 2024
A Survey on Efficient Inference for Large Language Models Zixuan Zhou Xuefei Ning Ke Hong Tianyu Fu Jiaming Xu ... Shengen Yan Guohao Dai Xiao-Ping Zhang Yuhan Dong Yu Wang 51 87 0 22 Apr 2024
ColA: Collaborative Adaptation with Gradient Learning Enmao Diao Qi Le Suya Wu Xinran Wang Ali Anwar Jie Ding Vahid Tarokh 42 1 0 22 Apr 2024
MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts Dengchun Li Yingzi Ma Naizheng Wang Zhengmao Ye Zhiyuan Cheng ... Yan Zhang Lei Duan Jie Zuo Cal Yang Mingjie Tang MoE 51 45 0 22 Apr 2024
Sample Design Engineering: An Empirical Study of What Makes Good Downstream Fine-Tuning Samples for LLMs Biyang Guo He Wang Wenyilin Xiao Hong Chen Zhuxin Lee Songqiao Han Hailiang Huang 36 2 0 19 Apr 2024
Progressive Multi-modal Conditional Prompt Tuning Xiaoyu Qiu Hao Feng Yuechen Wang Wen-gang Zhou Houqiang Li VLM 34 1 0 18 Apr 2024
Visual Prompting for Generalized Few-shot Segmentation: A Multi-scale Approach Mir Rayat Imtiaz Hossain Mennatullah Siam Leonid Sigal James J. Little VLM 40 6 0 17 Apr 2024
FedPFT: Federated Proxy Fine-Tuning of Foundation Models Zhaopeng Peng Xiaoliang Fan Yufan Chen Zheng Wang Shirui Pan Chenglu Wen Ruisheng Zhang Cheng-i Wang 72 8 0 17 Apr 2024
AdaIR: Exploiting Underlying Similarities of Image Restoration Tasks with Adapters Hao-Wei Chen Yu-Syuan Xu Kelvin C. K. Chan Hsien-Kai Kuo Chun-Yi Lee Ming-Hsuan Yang 42 1 0 17 Apr 2024
Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender System Sein Kim Hongseok Kang Seungyoon Choi Donghyun Kim Minchul Yang Chanyoung Park KELM 53 21 0 17 Apr 2024
Prompt-tuning for Clickbait Detection via Text Summarization Haoxiang Deng Yi Zhu Ye Wang Jipeng Qiang Yunhao Yuan Yun Li Runmei Zhang 38 0 0 17 Apr 2024
Shears: Unstructured Sparsity with Neural Low-rank Adapter Search J. P. Muñoz Jinjie Yuan Nilesh Jain 35 7 0 16 Apr 2024
Forcing Diffuse Distributions out of Language Models Yiming Zhang Avi Schwarzschild Nicholas Carlini Zico Kolter Daphne Ippolito ALM DiffM 51 17 0 16 Apr 2024
LoRA Dropout as a Sparsity Regularizer for Overfitting Control Yang Lin Xinyu Ma Xu Chu Yujie Jin Zhibang Yang Yasha Wang Hong-yan Mei 57 19 0 15 Apr 2024
Do LLMs Understand Visual Anomalies? Uncovering LLM's Capabilities in Zero-shot Anomaly Detection Jiaqi Zhu Shaofeng Cai Fang Deng Junran Wu Junran Wu 70 15 0 15 Apr 2024
TransformerFAM: Feedback attention is working memory Dongseong Hwang Weiran Wang Zhuoyuan Huo K. Sim P. M. Mengibar 40 12 0 14 Apr 2024
Distilling Reasoning Ability from Large Language Models with Adaptive Thinking Xiao Chen Sihang Zhou K. Liang Xinwang Liu ReLM LRM 42 4 0 14 Apr 2024
MING-MOE: Enhancing Medical Multi-Task Learning in Large Language Models with Sparse Mixture of Low-Rank Adapter Experts Yusheng Liao Shuyang Jiang Yu Wang Yanfeng Wang MoE 41 5 0 13 Apr 2024
Navigating the Landscape of Large Language Models: A Comprehensive Review and Analysis of Paradigms and Fine-Tuning Strategies Benjue Weng LM&MA 54 8 0 13 Apr 2024
MMA-DFER: MultiModal Adaptation of unimodal models for Dynamic Facial Expression Recognition in-the-wild K. Chumachenko Alexandros Iosifidis Moncef Gabbouj 34 6 0 13 Apr 2024
Intuition-aware Mixture-of-Rank-1-Experts for Parameter Efficient Finetuning Yijiang Liu Rongyu Zhang Huanrui Yang Kurt Keutzer Yuan Du Li Du Shanghang Zhang MoE 51 6 0 13 Apr 2024
MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking Tianwen Tang Tong Zhu Haodong Liu Yin Bai Jia Cheng Wenliang Chen MoE 34 0 0 12 Apr 2024
Improving Continuous Sign Language Recognition with Adapted Image Models Lianyu Hu Tongkai Shi Liqing Gao Zekang Liu Wei Feng VLM 33 5 0 12 Apr 2024
AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guarantees William Fleshman Aleem Khan Marc Marone Benjamin Van Durme CLL KELM 58 3 0 12 Apr 2024
Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models Tanmay Gautam Youngsuk Park Hao Zhou Parameswaran Raman Wooseok Ha 53 11 0 11 Apr 2024
On Unified Prompt Tuning for Request Quality Assurance in Public Code Review Xinyu Chen Lin Li Rui Zhang Peng Liang 38 1 0 11 Apr 2024
AmpleGCG: Learning a Universal and Transferable Generative Model of Adversarial Suffixes for Jailbreaking Both Open and Closed LLMs Zeyi Liao Huan Sun AAML 52 79 0 11 Apr 2024
Scalable Language Model with Generalized Continual Learning Bohao Peng Zhuotao Tian Shu Liu Mingchang Yang Jiaya Jia ALM CLL KELM 43 14 0 11 Apr 2024
Continuous Language Model Interpolation for Dynamic and Controllable Text Generation Sara Kangaslahti David Alvarez-Melis KELM 44 0 0 10 Apr 2024