Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,621 papers shown

Title
HGT: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table Understanding Rihui Jin Yu Li Guilin Qi Nan Hu Yuan-Fang Li Jiaoyan Chen Jianan Wang Yongrui Chen Dehai Min LMTD 37 0 0 28 Mar 2024
Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction Inhwan Bae Junoh Lee Hae-Gon Jeon 65 15 0 27 Mar 2024
Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning Huiyi Wang Haodong Lu Lina Yao Dong Gong KELM CLL 53 10 0 27 Mar 2024
LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning Rui Pan Xiang Liu Shizhe Diao Renjie Pi Jipeng Zhang Chi Han Tong Zhang 48 39 0 26 Mar 2024
Mix-Initiative Response Generation with Dynamic Prefix Tuning Yuxiang Nie Heyan Huang Xian-Ling Mao Lizi Liao 37 1 0 26 Mar 2024
ILLUMINER: Instruction-tuned Large Language Models as Few-shot Intent Classifier and Slot Filler Paramita Mirza Viju Sudhi S. Sahoo Sinchana Ramakanth Bhat 55 4 0 26 Mar 2024
Deja vu: Contrastive Historical Modeling with Prefix-tuning for Temporal Knowledge Graph Reasoning Miao Peng Ben Liu Wenjie Xu Zihao Jiang Jiahui Zhu Min Peng 37 1 0 25 Mar 2024
An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing Ziwei Chai Guoyin Wang Jing Su Tianjie Zhang Xuanwen Huang ... Jingjing Xu Jianbo Yuan Hongxia Yang Fei Wu Yang Yang 44 7 0 25 Mar 2024
ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models Zequan Liu Jiawen Lyn Wei-wei Zhu Xing Tian Yvette Graham OffRL 63 10 0 24 Mar 2024
Monotonic Paraphrasing Improves Generalization of Language Model Prompting Qin Liu Fei Wang Nan Xu Tianyi Yan Tao Meng Muhao Chen LRM 48 7 0 24 Mar 2024
LlamBERT: Large-scale low-cost data annotation in NLP Bálint Csanády Lajos Muzsai Péter Vedres Zoltán Nádasdy András Lukács 61 6 0 23 Mar 2024
Not All Attention is Needed: Parameter and Computation Efficient Transfer Learning for Multi-modal Large Language Models Qiong Wu Weihao Ye Yiyi Zhou Xiaoshuai Sun Rongrong Ji MoE 57 1 0 22 Mar 2024
KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation Xindi Luo Zequn Sun Jing-xin Zhao Zhe Zhao Wei Hu KELM 29 4 0 22 Mar 2024
A Single Linear Layer Yields Task-Adapted Low-Rank Matrices Hwichan Kim S. Sasaki Sho Hoshino Ukyo Honda 38 1 0 22 Mar 2024
Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey Zeyu Han Chao Gao Jinyang Liu Jeff Zhang Sai Qian Zhang 150 327 0 21 Mar 2024
FIT-RAG: Black-Box RAG with Factual Information and Token Reduction Yuren Mao Xuemei Dong Wenyi Xu Yunjun Gao Bin Wei Ying Zhang 43 9 0 21 Mar 2024
Improving the Robustness of Large Language Models via Consistency Alignment Zhao Yukun Lingyong Yan Weiwei Sun Guoliang Xing Shuaiqiang Wang Meng Chong Zhicong Cheng Zhaochun Ren Yin Dawei 40 19 0 21 Mar 2024
A Design Space for Intelligent and Interactive Writing Assistants Mina Lee Katy Ilonka Gero John Joon Young Chung S. Buckingham Shum Vipul Raheja ... Joonsuk Park Roy Pea Eugenia H Rho Shannon Zejiang Shen Pao Siangliulue 51 83 0 21 Mar 2024
Genetic Auto-prompt Learning for Pre-trained Code Intelligence Language Models Chengzhe Feng Yanan Sun Ke Li Pan Zhou Jiancheng Lv Aojun Lu 59 1 0 20 Mar 2024
AdaViPro: Region-based Adaptive Visual Prompt for Large-Scale Models Adapting Mengyu Yang Ye Tian Lanshan Zhang Xiao Liang Xuming Ran Wendong Wang VLM 61 1 0 20 Mar 2024
AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models Zeyu Liu Souvik Kundu Anni Li Junrui Wan Lianghao Jiang Peter A. Beerel 44 9 0 20 Mar 2024
Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts Sai Ashish Somayajula Youwei Liang Abhishek Singh Li Zhang Pengtao Xie 50 2 0 19 Mar 2024
Automated Data Curation for Robust Language Model Fine-Tuning Jiuhai Chen Jonas W. Mueller ALM 42 21 0 19 Mar 2024
BiLoRA: A Bi-level Optimization Framework for Overfitting-Resilient Low-Rank Adaptation of Large Pre-trained Models Rushi Qiang Ruiyi Zhang Pengtao Xie AI4CE 35 8 0 19 Mar 2024
Enhancing Security of AI-Based Code Synthesis with GitHub Copilot via Cheap and Efficient Prompt-Engineering Jakub Res I. Homoliak Martin Peresíni A. Smrčka K. Malinka P. Hanáček 51 3 0 19 Mar 2024
Factorized Learning Assisted with Large Language Model for Gloss-free Sign Language Translation Zhigang Chen Benjia Zhou Jun Li Jun Wan Zhen Lei Ning Jiang Quan Lu Guoqing Zhao SLR 54 5 0 19 Mar 2024
Prompt-based Graph Model for Joint Liberal Event Extraction and Event Schema Induction Haochen Li Di Geng 21 0 0 19 Mar 2024
Task-Customized Mixture of Adapters for General Image Fusion Pengfei Zhu Yang Sun Bing Cao Qinghua Hu MoMe 64 22 0 19 Mar 2024
Embodied LLM Agents Learn to Cooperate in Organized Teams Xudong Guo Kaixuan Huang Jiale Liu Wenhui Fan Natalia Vélez Qingyun Wu Huazheng Wang Thomas L. Griffiths Mengdi Wang LM&Ro LLMAG 56 39 0 19 Mar 2024
CrossTune: Black-Box Few-Shot Classification with Label Enhancement Danqing Luo Chen Zhang Yan Zhang Haizhou Li 45 2 0 19 Mar 2024
Cross-Lingual Transfer for Natural Language Inference via Multilingual Prompt Translator Xiaoyu Qiu Yuechen Wang Jiaxin Shi Wen-gang Zhou Houqiang Li LRM 56 3 0 19 Mar 2024
Characteristic AI Agents via Large Language Models Xi Wang Hongliang Dai Shen Gao Piji Li 68 3 0 19 Mar 2024
ADAPT to Robustify Prompt Tuning Vision Transformers Masih Eskandar Tooba Imtiaz Zifeng Wang Jennifer Dy VPVLM VLM AAML 43 0 0 19 Mar 2024
Improving LoRA in Privacy-preserving Federated Learning Youbang Sun Zitao Li Yaliang Li Bolin Ding 40 63 0 18 Mar 2024
SuperLoRA: Parameter-Efficient Unified Adaptation of Multi-Layer Attention Modules Xiangyu Chen Jing Liu Ye Wang Pu Wang Matthew Brand Guanghui Wang T. Koike-Akino 56 7 0 18 Mar 2024
Compositional Kronecker Context Optimization for Vision-Language Models Kun Ding Xiaohui Li Qiang Yu Ying Wang Haojian Zhang Shiming Xiang VLM 49 0 0 18 Mar 2024
Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language Model Haoyun Xu Runzhe Zhan Derek F. Wong Lidia S. Chao 36 3 0 18 Mar 2024
Reinforcement Learning with Token-level Feedback for Controllable Text Generation Wendi Li Xiaoye Qu Kaihe Xu Wenfeng Xie Dangyang Chen Yu Cheng 55 7 0 18 Mar 2024
Semantic Prompting with Image-Token for Continual Learning Jisu Han Jaemin Na Wonjun Hwang CLL VLM 56 1 0 18 Mar 2024
Continual Forgetting for Pre-trained Vision Models Hongbo Zhao Bolin Ni Haochen Wang Junsong Fan Fei Zhu Yuxi Wang Yuntao Chen Gaofeng Meng Zhaoxiang Zhang MU VLM 76 12 0 18 Mar 2024
Hiding and Recovering Knowledge in Text-to-Image Diffusion Models via Learnable Prompts Anh-Vu Bui Khanh Doan Trung Le Paul Montague Tamas Abraham Dinh Q. Phung 40 3 0 18 Mar 2024
Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding Zichen Wu Hsiu-Yuan Huang Fanyi Qu Hao Sun VLM MoE 39 4 0 17 Mar 2024
CPA-Enhancer: Chain-of-Thought Prompted Adaptive Enhancer for Object Detection under Unknown Degradations Yuwei Zhang Yan Wu Yanming Liu Xinyue Peng 61 5 0 17 Mar 2024
A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment Tianhe Wu Kede Ma Jie Liang Yujiu Yang Lei Zhang 39 19 0 16 Mar 2024
CoLeCLIP: Open-Domain Continual Learning via Joint Task Prompt and Vocabulary Learning Yukun Li Guansong Pang Wei Suo Chenchen Jing Yuling Xi Lingqiao Liu Hao Chen Guoqiang Liang Peng Wang CLL VLM 51 8 0 15 Mar 2024
RAFT: Adapting Language Model to Domain Specific RAG Tianjun Zhang Shishir G. Patil Naman Jain Sheng Shen Matei A. Zaharia Ion Stoica Joseph E. Gonzalez RALM 54 189 0 15 Mar 2024
OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning Lingyi Hong Shilin Yan Renrui Zhang Wanyun Li Xinyu Zhou ... Kaixun Jiang Yiting Chen Jinglun Li Zhaoyu Chen Wenqiang Zhang VLM 41 43 0 14 Mar 2024
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking E. Zelikman Georges Harik Yijia Shao Varuna Jayasiri Nick Haber Noah D. Goodman LLMAG ReLM LRM 60 123 0 14 Mar 2024
Introducing Routing Functions to Vision-Language Parameter-Efficient Fine-Tuning with Low-Rank Bottlenecks Tingyu Qu Tinne Tuytelaars Marie-Francine Moens MoE 51 2 0 14 Mar 2024
PYRA: Parallel Yielding Re-Activation for Training-Inference Efficient Task Adaptation Yizhe Xiong Hui Chen Tianxiang Hao Zijia Lin Jungong Han Yuesong Zhang Guoxin Wang Yongjun Bao Guiguang Ding 56 17 0 14 Mar 2024