Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,702 papers shown

Title
TP-Eval: Tap Multimodal LLMs' Potential in Evaluation by Customizing Prompts Yuxuan Xie Tianhua Li Wenqi Shao Jianchao Tan 74 0 0 23 Oct 2024
PETAH: Parameter Efficient Task Adaptation for Hybrid Transformers in a resource-limited Context Maximilian Augustin Syed Shakib Sarwar Mostafa Elhoushi Sai Qian Zhang Yuecheng Li B. D. Salvo 76 1 0 23 Oct 2024
Cross-model Control: Improving Multiple Large Language Models in One-time Training Jiayi Wu Hao Sun Hengyi Cai Lixin Su Shuaiqiang Wang D. Yin Xiang Li Ming Gao MU 70 0 0 23 Oct 2024
Which Client is Reliable?: A Reliable and Personalized Prompt-based Federated Learning for Medical Image Question Answering He Zhu Ren Togo Takahiro Ogawa Miki Haseyama MedIm 74 0 0 23 Oct 2024
Understanding Layer Significance in LLM Alignment Guangyuan Shi Zexin Lu Xiaoyu Dong Wenlong Zhang Xuanyu Zhang Yujie Feng Xiao-Ming Wu 159 3 0 23 Oct 2024
Closed-form merging of parameter-efficient modules for Federated Continual Learning Riccardo Salami Pietro Buzzega Matteo Mosconi Jacopo Bonato Luigi Sabetta Simone Calderara FedML MoMe CLL 136 4 0 23 Oct 2024
LoRA-C: Parameter-Efficient Fine-Tuning of Robust CNN for IoT Devices Chuntao Ding Xu Cao Jianhang Xie Linlin Fan Shangguang Wang Zhichao Lu 97 2 0 22 Oct 2024
xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memories Maurice Kraus Felix Divo Devendra Singh Dhami Kristian Kersting AI4TS 96 6 0 22 Oct 2024
Beyond Retrieval: Generating Narratives in Conversational Recommender Systems Krishna Sayana Raghavendra Vasudeva Yuri Vasilevski Kun Su Liam Hebert H. Pham Ambarish Jash Sukhdeep S. Sodhi 3DV 79 4 0 22 Oct 2024
Dynamic Adaptive Rank Space Exploration for Efficient Sentiment Analysis with Large Language Models Hongcheng Ding Fuzhen Hu Xuanze Zhao Zixiao Jiang Shamsul Nahar Abdullah Deshinta Arrova Dewi 69 0 0 22 Oct 2024
Towards Optimal Adapter Placement for Efficient Transfer Learning Aleksandra I. Nowak Otniel-Bogdan Mercea Anurag Arnab Jonas Pfeiffer Yann N. Dauphin Utku Evci 94 1 0 21 Oct 2024
Resource-Efficient Medical Report Generation using Large Language Models Abdullah Abdullah Ameer Hamza Seong Tae Kim LM&MA MedIm 60 0 0 21 Oct 2024
AMPLE: Emotion-Aware Multimodal Fusion Prompt Learning for Fake News Detection Xiaoman Xu Xiangrun Li Taihang Wang Ye Jiang 111 2 0 21 Oct 2024
LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics Thomas Robert M. Safaryan Ionut-Vlad Modoranu Dan Alistarh ODL 92 7 0 21 Oct 2024
GSSF: Generalized Structural Sparse Function for Deep Cross-modal Metric Learning Haiwen Diao Ying Zhang Shang Gao Jiawen Zhu Long Chen Huchuan Lu 73 5 0 20 Oct 2024
Imprompter: Tricking LLM Agents into Improper Tool Use Xiaohan Fu Shuheng Li Zihan Wang Yong Liu Rajesh K. Gupta Taylor Berg-Kirkpatrick Earlence Fernandes SILM LLMAG 94 17 0 19 Oct 2024
Implicit Regularization of Sharpness-Aware Minimization for Scale-Invariant Problems Bingcong Li Liang Zhang Niao He 118 8 0 18 Oct 2024
A Lightweight Multi Aspect Controlled Text Generation Solution For Large Language Models Chenyang Zhang Jiayi Lin Haibo Tong Bingxuan Hou Dongyu Zhang Jialin Li Junli Wang 67 1 0 18 Oct 2024
Understanding the Difficulty of Low-Precision Post-Training Quantization for LLMs Zifei Xu Sayeh Sharify W. Yazar T. Webb Xin Eric Wang MQ 80 0 0 18 Oct 2024
A Unified View of Delta Parameter Editing in Post-Trained Large-Scale Models Qiaoyu Tang Le Yu Bowen Yu Hongyu Lin Keming Lu Yaojie Lu Jia Zheng Le Sun MoMe 90 1 0 17 Oct 2024
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-Tuning Yiming Shi Jiwei Wei Yujia Wu Ran Ran Chengwei Sun Shiyuan He Yang Yang ALM 109 1 0 17 Oct 2024
DEeR: Deviation Eliminating and Noise Regulating for Privacy-preserving Federated Low-rank Adaptation Meilu Zhu Axiu Mao Jun Liu Yixuan Yuan 105 3 0 16 Oct 2024
Prompt Compression for Large Language Models: A Survey Zongqian Li Yinhong Liu Yixuan Su Nigel Collier MQ 122 17 0 16 Oct 2024
CCSBench: Evaluating Compositional Controllability in LLMs for Scientific Document Summarization Yixi Ding Jiaying Wu Tongyao Zhu Yanxia Qin Qian Liu Min-Yen Kan CoGe 63 0 0 16 Oct 2024
Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models Sajjad Ghiasvand Yifan Yang Zhiyu Xue Mahnoosh Alizadeh Zheng Zhang Ramtin Pedarsani FedML 177 5 0 16 Oct 2024
Layer-wise Importance Matters: Less Memory for Better Performance in Parameter-efficient Fine-tuning of Large Language Models Kai Yao P. Gao Lichun Li Yuan Zhao Xiaofeng Wang Wei Wang Jianke Zhu 67 3 0 15 Oct 2024
Eliciting Textual Descriptions from Representations of Continuous Prompts Dana Ramati Daniela Gottesman Mor Geva 110 0 0 15 Oct 2024
Enhance Graph Alignment for Large Language Models Haitong Luo Xuying Meng Suhang Wang Tianxiang Zhao Fali Wang Hanyun Cao Yujun Zhang 442 2 0 15 Oct 2024
Tree of Attributes Prompt Learning for Vision-Language Models Tong Ding Wanhua Li Zhongqi Miao Hanspeter Pfister VLM 201 1 0 15 Oct 2024
Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent Bo Chen Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao Song 158 22 0 15 Oct 2024
Transfer Learning with Foundational Models for Time Series Forecasting using Low-Rank Adaptations M. Germán-Morales A. J. Rivera-Rivas M. J. del Jesus Díaz C. J. Carmona AI4TS AI4CE 310 1 0 15 Oct 2024
Is Parameter Collision Hindering Continual Learning in LLMs? Shuo Yang Hai-Jian Ke Yu-Yang Liu Jia-Yu Yao Yong-Hong Tian Yi-Bing Song Li Yuan MoMe CLL 112 4 0 14 Oct 2024
PromptGCN: Bridging Subgraph Gaps in Lightweight GCNs Shengwei Ji Yujie Tian Fei Liu Xinlu Li Le Wu GNN 85 0 0 14 Oct 2024
RoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates Md. Kowsher Tara Esmaeilbeig Chun-Nam Yu Chen Chen Mojtaba Soltanalian Niloofar Yousefi 92 1 0 14 Oct 2024
Understanding Robustness of Parameter-Efficient Tuning for Image Classification Jiacheng Ruan Xian Gao Suncheng Xiang Mingye Xie Ting Liu Yuzhuo Fu AAML VLM 57 0 0 13 Oct 2024
Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models Fei Wang Li Shen Liang Ding Chao Xue Ye Liu Changxing Ding 117 2 0 13 Oct 2024
Targeted Vaccine: Safety Alignment for Large Language Models against Harmful Fine-Tuning via Layer-wise Perturbation Guozhi Liu Weiwei Lin Tiansheng Huang Ruichao Mo Qi Mu Li Shen AAML 145 17 0 13 Oct 2024
t-READi: Transformer-Powered Robust and Efficient Multimodal Inference for Autonomous Driving Pengfei Hu Yuhang Qian Tianyue Zheng Ang Li Zhe Chen Yue Gao Xiuzhen Cheng Jun Luo 97 0 0 13 Oct 2024
Empirical Study of Mutual Reinforcement Effect and Application in Few-shot Text Classification Tasks via Prompt Chengguang Gan Tatsunori Mori 77 0 0 13 Oct 2024
Towards Efficient Visual-Language Alignment of the Q-Former for Visual Reasoning Tasks Sungkyung Kim Adam Lee Junyoung Park Andrew Chung Jusang Oh Jay-Yoon Lee 61 3 0 12 Oct 2024
Fine-grained Attention I/O Complexity: Comprehensive Analysis for Backward Passes Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao Song Yufa Zhou 98 18 0 12 Oct 2024
Prompting Video-Language Foundation Models with Domain-specific Fine-grained Heuristics for Video Question Answering Ting Yu Kunhao Fu Shuhui Wang Qingming Huang Jun Yu 127 2 0 12 Oct 2024
DARE the Extreme: Revisiting Delta-Parameter Pruning For Fine-Tuned Models Wenlong Deng Yize Zhao V. Vakilian Minghui Chen Xiaoxiao Li Christos Thrampoulidis 238 7 0 12 Oct 2024
MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning Yaming Yang Dilxat Muhtar Yelong Shen Yuefeng Zhan Jianfeng Liu ... Denvy Deng Feng Sun Qi Zhang Weizhu Chen Yunhai Tong MoE MoMe 155 5 0 12 Oct 2024
Extra Global Attention Designation Using Keyword Detection in Sparse Transformer Architectures Evan Lucas Dylan Kangas Timothy C Havens 72 1 0 11 Oct 2024
Calibrated Cache Model for Few-Shot Vision-Language Model Adaptation Kun Ding Qiang Yu Haojian Zhang Gaofeng Meng Shiming Xiang VLM 77 0 0 11 Oct 2024
StraGo: Harnessing Strategic Guidance for Prompt Optimization Yurong Wu Yan Gao Bin Benjamin Zhu Zineng Zhou Xiaodi Sun Sheng Yang Jian-Guang Lou Zhiming Ding Linjun Yang LLMAG 88 6 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge Tuning Nusrat Jahan Prottasha Asif Mahmud Md. Shohanur Islam Sobuj Prakash Bhat Md. Kowsher Niloofar Yousefi O. Garibay 121 7 0 11 Oct 2024
Context-Aware Adapter Tuning for Few-Shot Relation Learning in Knowledge Graphs Ran Liu Zhongzhou Liu Xiaoli Li Yuan Fang 90 0 0 11 Oct 2024
Zeroth-Order Fine-Tuning of LLMs in Random Subspaces Ziming Yu Pan Zhou Sike Wang Jia Li Hua Huang Hua Huang 84 0 0 11 Oct 2024