Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,611 papers shown

Title
GraSAME: Injecting Token-Level Structural Information to Pretrained Language Models via Graph-guided Self-Attention Mechanism Shuzhou Yuan Michael Farber 45 2 0 10 Apr 2024
Privacy Preserving Prompt Engineering: A Survey Kennedy Edemacu Xintao Wu 75 20 0 09 Apr 2024
Finding Visual Task Vectors Alberto Hojel Yutong Bai Trevor Darrell Amir Globerson Amir Bar 70 7 0 08 Apr 2024
Certified PEFTSmoothing: Parameter-Efficient Fine-Tuning with Randomized Smoothing Chengyan Fu Wenjie Wang AAML 46 0 0 08 Apr 2024
DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model Chao Gao Sai Qian Zhang ALM 123 7 0 08 Apr 2024
Plug and Play with Prompts: A Prompt Tuning Approach for Controlling Text Generation R. Ajwani Zining Zhu Jonathan Rose Frank Rudzicz 27 1 0 08 Apr 2024
A Note on LoRA Vlad Fomenko Han Yu Jongho Lee Stanley Hsieh Weizhu Chen 55 5 0 07 Apr 2024
Facial Affective Behavior Analysis with Instruction Tuning Yifan Li Anh Dao Wentao Bao Zhen Tan Tianlong Chen Huan Liu Yu Kong CVBM 67 15 0 07 Apr 2024
Adapting LLMs for Efficient Context Processing through Soft Prompt Compression Cangqing Wang Yutian Yang Ruisi Li Dan Sun Ruicong Cai Yuzhu Zhang Chengqian Fu Lillian Floyd 37 16 0 07 Apr 2024
Q-PEFT: Query-dependent Parameter Efficient Fine-tuning for Text Reranking with Large Language Models Zhiyuan Peng Xuyang Wu Qifan Wang Sravanthi Rajanala Yi Fang 61 4 0 06 Apr 2024
Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models Songtao Jiang Yan Zhang Chenyi Zhou Yeying Jin Yang Feng Jian Wu Zuozhu Liu LRM VLM 61 4 0 06 Apr 2024
Exploring Autonomous Agents through the Lens of Large Language Models: A Review Saikat Barua LM&MA LLMAG 40 15 0 05 Apr 2024
Image-Text Co-Decomposition for Text-Supervised Semantic Segmentation Ji-Jia Wu Andy Chia-Hao Chang Chieh-Yu Chuang Chun-Pei Chen Yu-Lun Liu Min-Hung Chen Hou-Ning Hu Yung-Yu Chuang Yen-Yu Lin VLM 67 9 0 05 Apr 2024
Unlocking Parameter-Efficient Fine-Tuning for Low-Resource Language Translation Tong Su Xin Peng Sarubi Thillainathan David Guzmán Surangika Ranathunga En-Shiun Annie Lee 53 2 0 05 Apr 2024
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation Xinyu Ma Xu Chu Zhibang Yang Yang Lin Xin Gao Junfeng Zhao 51 8 0 05 Apr 2024
ReFT: Representation Finetuning for Language Models Zhengxuan Wu Aryaman Arora Zheng Wang Atticus Geiger Daniel Jurafsky Christopher D. Manning Christopher Potts OffRL 61 58 0 04 Apr 2024
Personalized LLM Response Generation with Parameterized Memory Injection Kai Zhang Lizhi Qing Yangyang Kang 39 11 0 04 Apr 2024
BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models Qi Luo Hengxu Yu Xiao Li 52 2 0 03 Apr 2024
FPT: Feature Prompt Tuning for Few-shot Readability Assessment Ziyang Wang Sanwoo Lee Hsiu-Yuan Huang Yunfang Wu AAML VLM 46 0 0 03 Apr 2024
On Linearizing Structured Data in Encoder-Decoder Language Models: Insights from Text-to-SQL Yutong Shao N. Nakashole 53 1 0 03 Apr 2024
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models Fanxu Meng Zhaohui Wang Muhan Zhang VLM 64 79 0 03 Apr 2024
Multi-BERT: Leveraging Adapters and Prompt Tuning for Low-Resource Multi-Domain Adaptation Parham AbedAzad Hamid Beigy 37 2 0 02 Apr 2024
Pre-trained Vision and Language Transformers Are Few-Shot Incremental Learners Keon-Hee Park Kyungwoo Song Gyeong-Moon Park VLM CLL 48 16 0 02 Apr 2024
Deconstructing In-Context Learning: Understanding Prompts via Corruption Namrata Shivagunde Vladislav Lialin Sherin Muckatira Anna Rumshisky 45 3 0 02 Apr 2024
A Survey on Large Language Model-Based Game Agents Sihao Hu Tiansheng Huang Gaowen Liu Ramana Rao Kompella Gaowen Liu Selim Furkan Tekin Yichang Xu Zachary Yahn Ling Liu LLMAG LM&Ro AI4CE LM&MA 71 53 0 02 Apr 2024
Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs Zheng Zhang Fan Yang Ziyan Jiang Zheng Chen Zhengyang Zhao Chengyuan Ma Liang Zhao Yang Liu 34 5 0 01 Apr 2024
UniArk: Improving Generalisation and Consistency for Factual Knowledge Extraction through Debiasing Yijun Yang Jie He Pinzhen Chen Víctor Gutiérrez-Basulto Jeff Z. Pan KELM HILM 38 0 0 01 Apr 2024
Effectively Prompting Small-sized Language Models for Cross-lingual Tasks via Winning Tickets Mingqi Li Feng Luo LRM 43 0 0 01 Apr 2024
Efficient Prompting Methods for Large Language Models: A Survey Kaiyan Chang Songcheng Xu Chenglong Wang Yingfeng Luo Tong Xiao Jingbo Zhu LRM 58 33 0 01 Apr 2024
Continual Learning for Smart City: A Survey Li Yang Zhipeng Luo Shi-sheng Zhang Fei Teng Tian-Jie Li HAI 43 8 0 01 Apr 2024
LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction Bo Zou Chao Yang Yu Qiao Chengbin Quan Youjian Zhao 58 6 0 01 Apr 2024
Prompt Learning via Meta-Regularization Jinyoung Park Juyeon Ko Hyunwoo J. Kim VLM VPVLM 61 15 0 01 Apr 2024
Rehearsal-Free Modular and Compositional Continual Learning for Language Models Mingyang Wang Heike Adel Lukas Lange Jannik Strötgen Hinrich Schütze KELM CLL 47 14 0 31 Mar 2024
Query-driven Relevant Paragraph Extraction from Legal Judgments Santosh T.Y.S.S Elvin Quero Hernandez Matthias Grabmair AILaw 52 2 0 31 Mar 2024
Humane Speech Synthesis through Zero-Shot Emotion and Disfluency Generation Rohan Chaudhury Mihir Godbole Aakash Garg Jinsil Hwaryoung Seo 53 0 0 31 Mar 2024
Shortcuts Arising from Contrast: Effective and Covert Clean-Label Attacks in Prompt-Based Learning Xiaopeng Xie Ming Yan Xiwen Zhou Chenlong Zhao Suli Wang Yong Zhang Joey Tianyi Zhou AAML 53 0 0 30 Mar 2024
UniMEEC: Towards Unified Multimodal Emotion Recognition and Emotion Cause Guimin Hu Zhihong Zhu Daniel Hershcovich Hasti Seifi Jiayuan Xie 45 7 0 30 Mar 2024
InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning Yan-Shuo Liang Wu-Jun Li CLL 50 41 0 30 Mar 2024
Semantic Map-based Generation of Navigation Instructions Chengzu Li Chao Zhang Simone Teufel R. Doddipatla Svetlana Stoyanchev 39 2 0 28 Mar 2024
Dual-Personalizing Adapter for Federated Foundation Models Yiyuan Yang Guodong Long Taoshu Shen Jing Jiang Michael Blumenstein 96 21 0 28 Mar 2024
HGT: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table Understanding Rihui Jin Yu Li Guilin Qi Nan Hu Yuan-Fang Li Jiaoyan Chen Jianan Wang Yongrui Chen Dehai Min LMTD 32 0 0 28 Mar 2024
Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction Inhwan Bae Junoh Lee Hae-Gon Jeon 65 15 0 27 Mar 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 53 10 0 27 Mar 2024
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning Rui Pan Xiang Liu Shizhe Diao Renjie Pi Jipeng Zhang Chi Han Tong Zhang 48 38 0 26 Mar 2024
Mix-Initiative Response Generation with Dynamic Prefix Tuning Yuxiang Nie Heyan Huang Xian-Ling Mao Lizi Liao 32 1 0 26 Mar 2024
ILLUMINER: Instruction-tuned Large Language Models as Few-shot Intent Classifier and Slot Filler Paramita Mirza Viju Sudhi S. Sahoo Sinchana Ramakanth Bhat 55 4 0 26 Mar 2024
Deja vu: Contrastive Historical Modeling with Prefix-tuning for Temporal Knowledge Graph Reasoning Miao Peng Ben Liu Wenjie Xu Zihao Jiang Jiahui Zhu Min Peng 37 1 0 25 Mar 2024
An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing Ziwei Chai Guoyin Wang Jing Su Tianjie Zhang Xuanwen Huang ... Jingjing Xu Jianbo Yuan Hongxia Yang Fei Wu Yang Yang 41 7 0 25 Mar 2024
ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models Zequan Liu Jiawen Lyn Wei-wei Zhu Xing Tian Yvette Graham OffRL 63 10 0 24 Mar 2024
Monotonic Paraphrasing Improves Generalization of Language Model Prompting Qin Liu Fei Wang Nan Xu Tianyi Yan Tao Meng Muhao Chen LRM 48 7 0 24 Mar 2024