Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,701 papers shown

Title
How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenario Shih-Heng Wang Zih-Ching Chen Jiatong Shi Ming-To Chuang Guan-Ting Lin Kuan Po Huang David Harwath Shang-Wen Li Hung-yi Lee 130 1 0 27 Nov 2024
Evaluating and Improving the Robustness of Security Attack Detectors Generated by LLMs Samuele Pasini Jinhan Kim Tommaso Aiello Rocío Cabrera Lozoya Antonino Sabetta Paolo Tonella 104 1 0 27 Nov 2024
Instance-Aware Graph Prompt Learning Jiazheng Li Jundong Li Chuxu Zhang VLM 133 4 0 26 Nov 2024
One Mind, Many Tongues: A Deep Dive into Language-Agnostic Knowledge Neurons in Large Language Models Pengfei Cao Yuheng Chen Zhuoran Jin Yubo Chen Kang Liu Jun Zhao KELM 124 0 0 26 Nov 2024
Soft-TransFormers for Continual Learning Haeyong Kang Chang D. Yoo CLL 152 0 0 25 Nov 2024
Predicting Emergent Capabilities by Finetuning Charlie Snell Eric Wallace Dan Klein Sergey Levine ELM LRM 151 6 0 25 Nov 2024
LoRA-Mini : Adaptation Matrices Decomposition and Selective Training Ayush Singh Rajdeep Aher Shivank Garg 142 1 0 24 Nov 2024
Panther: Illuminate the Sight of Multimodal LLMs with Instruction-Guided Visual Prompts Honglin Li Yuting Gao Chenglu Zhu Jingdong Chen M. Yang Lin Yang MLLM 207 0 0 21 Nov 2024
Parameter Efficient Mamba Tuning via Projector-targeted Diagonal-centric Linear Transformation Seokil Ham H. Kim Sangmin Woo Changick Kim Mamba 522 0 0 21 Nov 2024
LightLLM: A Versatile Large Language Model for Predictive Light Sensing J. Hu Hong Jia Mahbub Hassan Lina Yao Brano Kusy Wen Hu 115 1 0 20 Nov 2024
Advancing Large Language Models for Spatiotemporal and Semantic Association Mining of Similar Environmental Events Yuanyuan Tian Wenwen Li Lei Hu Xinyu Chen Michael Brook Michael Brubaker Fan Zhang A. Liljedahl KELM 152 2 0 19 Nov 2024
MC-LLaVA: Multi-Concept Personalized Vision-Language Model Ruichuan An Sihan Yang Ming Lu Kai Zeng Yulin Luo ... Hao Liang Qi She Shanghang Zhang Wentao Zhang Wentao Zhang 214 11 0 18 Nov 2024
Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generation Md. Asif Haider Ayesha Binte Mostofa Sk. Sabit Bin Mosaddek Anindya Iqbal Toufique Ahmed ALM 112 3 0 15 Nov 2024
Evidential Federated Learning for Skin Lesion Image Classification Rutger Hendrix Federica Proietto Salanitri C. Spampinato S. Palazzo Ulas Bagci VLM FedML 53 0 0 15 Nov 2024
PTR: Precision-Driven Tool Recommendation for Large Language Models Hang Gao Yongfeng Zhang KELM 80 0 0 14 Nov 2024
A Practical Guide to Fine-tuning Language Models with Limited Data Márton Szép Daniel Rueckert Rüdiger von Eisenhart-Rothe Florian Hinterwimmer SyDa ALM 142 2 0 14 Nov 2024
New Emerged Security and Privacy of Pre-trained Model: a Survey and Outlook Meng Yang Tianqing Zhu Chi Liu Wanlei Zhou Shui Yu Philip S. Yu AAML ELM PILM 112 1 0 12 Nov 2024
Knowledge-Augmented Multimodal Clinical Rationale Generation for Disease Diagnosis with Small Language Models Shuai Niu Jing Ma Hongzhan Lin Liang Bai Zhihua Wang Yida Xu Yunya Song Xian Yang 67 1 0 12 Nov 2024
On Active Privacy Auditing in Supervised Fine-tuning for White-Box Language Models Qian Sun Hanpeng Wu Xi Sheryl Zhang 81 0 0 11 Nov 2024
Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass Tong Chen Hao Fang Patrick Xia Xiaodong Liu Benjamin Van Durme Luke Zettlemoyer Jianfeng Gao Hao Cheng KELM 128 2 0 08 Nov 2024
Stepping Forward on the Last Mile Chen Feng Shaojie Zhuo Xiaopeng Zhang R. Ramakrishnan Zhaocong Yuan Andrew Zou Li 139 0 0 06 Nov 2024
MambaPEFT: Exploring Parameter-Efficient Fine-Tuning for Mamba Masakazu Yoshimura Teruaki Hayashi Yota Maeda Mamba 313 2 0 06 Nov 2024
Unified Pathological Speech Analysis with Prompt Tuning Fei Yang Xuenan Xu Mengyue Wu Kai Yu 58 0 0 05 Nov 2024
Self-Calibrated Tuning of Vision-Language Models for Out-of-Distribution Detection Geng Yu Jianing Zhu Jiangchao Yao Bo Han OODD 82 2 0 05 Nov 2024
Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention Xingtai Lv Ning Ding Kaiyan Zhang Ermo Hua Ganqu Cui Bowen Zhou 75 3 0 04 Nov 2024
Masked Autoencoders are Parameter-Efficient Federated Continual Learners Yuchen He Xiangfeng Wang CLL FedML 94 0 0 04 Nov 2024
FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework Yuchen He Chuyun Shen Xiangfeng Wang Bo Jin FedML 144 1 0 04 Nov 2024
Parameter-Efficient Fine-Tuning of Large Language Models for Unit Test Generation: An Empirical Study André Storhaug Jingyue Li ALM 90 2 0 04 Nov 2024
Expanding Sparse Tuning for Low Memory Usage Shufan Shen Junshu Sun Xiangyang Ji Qingming Huang Shuhui Wang 116 0 0 04 Nov 2024
RuAG: Learned-rule-augmented Generation for Large Language Models Yudi Zhang Pei Xiao Lu Wang Chen Zhang Meng Fang ... Qingwei Lin Mykola Pechenizkiy Dongmei Zhang Saravan Rajmohan Qi Zhang LRM 89 1 0 04 Nov 2024
Optical Flow Representation Alignment Mamba Diffusion Model for Medical Video Generation Zhenbin Wang Lei Zhang Lituan Wang Minjuan Zhu Zhenwei Zhang VGen MedIm 112 3 0 03 Nov 2024
Open LLMs are Necessary for Current Private Adaptations and Outperform their Closed Alternatives Vincent Hanke Tom Blanchard Franziska Boenisch Iyiola Emmanuel Olatunji Michael Backes Adam Dziedzic PILM 128 6 0 02 Nov 2024
Pin-Tuning: Parameter-Efficient In-Context Tuning for Few-Shot Molecular Property Prediction Liang Wang Qiang Liu Shaozhen Liu Xin Sun Shu Wu Liang Wang 116 2 0 02 Nov 2024
MoTaDual: Modality-Task Dual Alignment for Enhanced Zero-shot Composed Image Retrieval Haiwen Li Fei Su Zhicheng Zhao 81 0 0 31 Oct 2024
CleaR: Towards Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Label Learning Yeachan Kim Junho Kim SangKeun Lee NoLa AAML 151 2 0 31 Oct 2024
An Individual Identity-Driven Framework for Animal Re-Identification Yihao Wu Di Zhao Jingfeng Zhang Yun Sing Koh 81 0 0 30 Oct 2024
MALoRA: Mixture of Asymmetric Low-Rank Adaptation for Enhanced Multi-Task Learning Xujia Wang Haiyan Zhao Shuo Wang Hanqing Wang Zhiyuan Liu MoMe MoE 69 1 0 30 Oct 2024
Active Learning for Vision-Language Models Bardia Safaei Vishal M. Patel VLM 130 7 0 29 Oct 2024
Preserving Pre-trained Representation Space: On Effectiveness of Prefix-tuning for Large Multi-modal Models Donghoon Kim Gusang Lee Kyuhong Shim B. Shim 104 1 0 29 Oct 2024
A Hierarchical Language Model For Interpretable Graph Reasoning Sambhav Khurana Xiner Li Shurui Gui Shuiwang Ji LRM 140 0 0 29 Oct 2024
SVIP: Towards Verifiable Inference of Open-source Large Language Models Yifan Sun Yuhang Li Yue Zhang Yuchen Jin Huan Zhang 93 2 0 29 Oct 2024
AdaptGCD: Multi-Expert Adapter Tuning for Generalized Category Discovery Yuxun Qu Yongqiang Tang Chenyang Zhang Wensheng Zhang 179 0 0 29 Oct 2024
Knowledge-Guided Prompt Learning for Request Quality Assurance in Public Code Review Lin Li Xinchun Yu Xinyu Chen Peng Liang 90 0 0 29 Oct 2024
IntLoRA: Integral Low-rank Adaptation of Quantized Diffusion Models Hang Guo Yawei Li Tao Dai Shu-Tao Xia Luca Benini MQ 137 2 0 29 Oct 2024
Vector Quantization Prompting for Continual Learning L. Jiao Qiuxia Lai Yu LI Qiang Xu VLM CLL 79 5 0 27 Oct 2024
LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization Jui-Nan Yen Si Si Zhao Meng Felix X. Yu Sai Surya Duvvuri Inderjit Dhillon Cho-Jui Hsieh Sanjiv Kumar 90 5 0 27 Oct 2024
LanFL: Differentially Private Federated Learning with Large Language Models using Synthetic Samples Huiyu Wu Diego Klabjan FedML 167 1 0 24 Oct 2024
On the Crucial Role of Initialization for Matrix Factorization Bingcong Li Liang Zhang Aryan Mokhtari Niao He 169 6 0 24 Oct 2024
Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies Liwen Wang Sheng Chen Linnan Jiang Shu Pan Runze Cai Sen Yang Fei Yang 201 7 0 24 Oct 2024
TP-Eval: Tap Multimodal LLMs' Potential in Evaluation by Customizing Prompts Yuxuan Xie Tianhua Li Wenqi Shao Jianchao Tan 74 0 0 23 Oct 2024