Prefix-Tuning: Optimizing Continuous Prompts for Generation

1 January 2021

Xiang Lisa Li

Papers citing "Prefix-Tuning: Optimizing Continuous Prompts for Generation"

50 / 2,607 papers shown

Title
Computation-Efficient Semi-Supervised Learning for ECG-based Cardiovascular Diseases Detection Rushuang Zhou Zijun Liu Lei A. Clifton David Clifton Kannie W. Y. Chan Yuan-Ting Zhang Yining Dong 31 1 0 20 Jun 2024
Raising the Bar: Investigating the Values of Large Language Models via Generative Evolving Testing Han Jiang Xiaoyuan Yi Zhihua Wei Shu Wang Xing Xie Xing Xie ALM ELM 59 5 0 20 Jun 2024
On the Utility of Domain-Adjacent Fine-Tuned Model Ensembles for Few-shot Problems Md. Ibrahim Ibne Alam Parikshit Ram Soham Dan Horst Samulowitz Koushik Kar 46 0 0 19 Jun 2024
Towards Minimal Targeted Updates of Language Models with Targeted Negative Training Lily H. Zhang Rajesh Ranganath Arya Tafvizi 38 1 0 19 Jun 2024
Dual-Phase Accelerated Prompt Optimization Muchen Yang Moxin Li Yongle Li Zijun Chen Chongming Gao Junqi Zhang Yangyang Li Fuli Feng 43 0 0 19 Jun 2024
Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gates Cristian Meo Ksenia Sycheva Anirudh Goyal Justin Dauwels MQ 32 4 0 18 Jun 2024
Synergizing Foundation Models and Federated Learning: A Survey Shenghui Li Fanghua Ye Meng Fang Jiaxu Zhao Yun-Hin Chan Edith C. -H. Ngai Thiemo Voigt AI4CE 65 6 0 18 Jun 2024
From Insights to Actions: The Impact of Interpretability and Analysis Research on NLP Marius Mosbach Vagrant Gautam Tomás Vergara-Browne Dietrich Klakow Mor Geva AI4CE 46 6 0 18 Jun 2024
Low-Redundant Optimization for Large Language Model Alignment Zhipeng Chen Kun Zhou Wayne Xin Zhao Jingyuan Wang Ji-Rong Wen 44 2 0 18 Jun 2024
PromptDSI: Prompt-based Rehearsal-free Instance-wise Incremental Learning for Document Retrieval Tuan-Luc Huynh Thuy-Trang Vu Weiqing Wang Yinwei Wei Trung Le D. Gašević Yuan-Fang Li Thanh-Toan Do VLM CLL 45 0 0 18 Jun 2024
Fighting Randomness with Randomness: Mitigating Optimisation Instability of Fine-Tuning using Delayed Ensemble and Noisy Interpolation Branislav Pecher Ján Cegin Róbert Belanec Jakub Simko Ivan Srba Maria Bielikova 52 1 0 18 Jun 2024
Mitigate Negative Transfer with Similarity Heuristic Lifelong Prompt Tuning Chenyuan Wu Gangwei Jiang Defu Lian CLL 39 0 0 18 Jun 2024
From Instance Training to Instruction Learning: Task Adapters Generation from Instructions Huanxuan Liao Yao Xu Shizhu He Yuanzhe Zhang Yanchao Hao Shengping Liu Kang Liu Jun Zhao 56 1 0 18 Jun 2024
Soft Prompting for Unlearning in Large Language Models Karuna Bhaila Minh-Hao Van Xintao Wu MU KELM 38 4 0 17 Jun 2024
Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization Seungwoo Son Wonpyo Park Woohyun Han Kyuyeun Kim Jaeho Lee MQ 37 10 0 17 Jun 2024
Dialogue Action Tokens: Steering Language Models in Goal-Directed Dialogue with a Multi-Turn Planner Kenneth Li Yiming Wang Fernanda Viégas Martin Wattenberg 43 6 0 17 Jun 2024
Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs Krista Opsahl-Ong Michael J Ryan Josh Purtell David Broman Christopher Potts Matei A. Zaharia Omar Khattab 45 27 0 17 Jun 2024
DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling Pala Tej Deep Rishabh Bhardwaj Soujanya Poria MoMe 38 24 0 17 Jun 2024
Save It All: Enabling Full Parameter Tuning for Federated Large Language Models via Cycle Block Gradient Descent Lin Wang Zhichao Wang Xiaoying Tang 54 1 0 17 Jun 2024
On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion Chenghao Fan Zhenyi Lu Wei Wei Jie Tian Xiaoye Qu Dangyang Chen Yu Cheng MoMe 55 5 0 17 Jun 2024
Are Large Language Models a Good Replacement of Taxonomies? Yushi Sun Hao Xin Kai Sun Yongjun Xu Xiao Yang Xin Luna Dong Nan Tang Lei Chen AI4MH 41 7 0 17 Jun 2024
Promoting Data and Model Privacy in Federated Learning through Quantized LoRA Jianhao Zhu Changze Lv Xiaohua Wang Muling Wu Tianlong Li Changze Lv Zixuan Ling Cenyuan Zhang Xiaoqing Zheng Xuanjing Huang 49 4 0 16 Jun 2024
COOL: Comprehensive Knowledge Enhanced Prompt Learning for Domain Adaptive Few-shot Fake News Detection Yi Ouyang Peng Wu Li Pan 72 0 0 16 Jun 2024
RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning Haoyu Wang Tianci Liu Ruirui Li Monica Cheng Tuo Zhao Jing Gao 33 7 0 16 Jun 2024
ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation Yurun Song Junchen Zhao Ian G. Harris Sangeetha Abdu Jyothi 34 3 0 16 Jun 2024
Mixture-of-Subspaces in Low-Rank Adaptation Taiqiang Wu Jiahao Wang Zhe Zhao Ngai Wong 54 22 0 16 Jun 2024
Concentrate Attention: Towards Domain-Generalizable Prompt Optimization for Language Models Chengzhengxu Li Xiaoming Liu Zhaohan Zhang Yichen Wang Chen Liu Y. Lan Chao Shen 65 2 0 15 Jun 2024
Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Models Ruchao Fan Natarajan Balaji Shankar Abeer Alwan 45 8 0 15 Jun 2024
A Unified Graph Selective Prompt Learning for Graph Neural Networks Bo Jiang Hao Wu Ziyan Zhang Beibei Wang Jin Tang 55 1 0 15 Jun 2024
Personalized Pieces: Efficient Personalized Large Language Models through Collaborative Efforts Zhaoxuan Tan Zheyuan Liu Meng Jiang 43 23 0 15 Jun 2024
FZI-WIM at SemEval-2024 Task 2: Self-Consistent CoT for Complex NLI in Biomedical Domain Jin Liu Steffen Thoma LRM 46 2 0 14 Jun 2024
Group and Shuffle: Efficient Structured Orthogonal Parametrization Mikhail Gorbunov Nikolay Yudin Vera Soboleva Aibek Alanov Alexey Naumov Maxim Rakhuba 50 1 0 14 Jun 2024
Open-Vocabulary Semantic Segmentation with Image Embedding Balancing Xiangheng Shan Dongyue Wu Guilin Zhu Yuanjie Shao Nong Sang Changxin Gao VLM 29 16 0 14 Jun 2024
FreeCtrl: Constructing Control Centers with Feedforward Layers for Learning-Free Controllable Text Generation Zijian Feng Hanzhang Zhou Zixiao Zhu Kezhi Mao 47 1 0 14 Jun 2024
A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations Jinqiang Wang Huansheng Ning Yi Peng Qikai Wei Daniel Tesfai Wenwei Mao Tao Zhu Runhe Huang LM&MA AI4MH ELM 54 5 0 14 Jun 2024
Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection Shruti Palaskar Oggi Rudovic Sameer Dharur Florian Pesce G. Krishna Aswin Sivaraman Jack Berkowitz Ahmed Hussen Abdelaziz Saurabh N. Adya Ahmed H. Tewfik VLM 60 0 0 13 Jun 2024
Yo'LLaVA: Your Personalized Language and Vision Assistant Thao Nguyen Haotian Liu Yuheng Li Mu Cai Utkarsh Ojha Yong Jae Lee VLM MLLM 64 16 0 13 Jun 2024
Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models Lukas Thede Karsten Roth Olivier J. Hénaff Matthias Bethge Zeynep Akata CLL 49 5 0 13 Jun 2024
Vertical LoRA: Dense Expectation-Maximization Interpretation of Transformers Zhuolin Fu 47 0 0 13 Jun 2024
PC-LoRA: Low-Rank Adaptation for Progressive Model Compression with Knowledge Distillation Injoon Hwang Haewon Park Youngwan Lee Jooyoung Yang SunJae Maeng AI4CE 27 0 0 13 Jun 2024
No perspective, no perception!! Perspective-aware Healthcare Answer Summarization Gauri Naik Sharad Chandakacherla S. Yadav Md. Shad Akhtar 40 6 0 13 Jun 2024
MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning Hanqing Wang Zeguan Xiao Shuo Wang Guanhua Chen Guanhua Chen 49 19 0 13 Jun 2024
ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasets Jiatong Shi Shih-Heng Wang William Chen Martijn Bartelds Vanya Bannihatti Kumar ... Xuankai Chang Dan Jurafsky Karen Livescu Hung-yi Lee Shinji Watanabe AuLLM 82 5 0 12 Jun 2024
Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey Hao Yang Yanyan Zhao Yang Wu Shilong Wang Tian Zheng Hongbo Zhang Zongyang Ma Wanxiang Che Bing Qin 54 9 0 12 Jun 2024
Understanding Visual Concepts Across Models Brandon Trabucco Max Gurinas Kyle Doherty Ruslan Salakhutdinov VLM 45 0 0 11 Jun 2024
TextGrad: Automatic "Differentiation" via Text Mert Yuksekgonul Federico Bianchi Joseph Boen Sheng Liu Zhi Huang Carlos Guestrin James Zou LLMAG OOD AI4CE 51 34 0 11 Jun 2024
BvSP: Broad-view Soft Prompting for Few-Shot Aspect Sentiment Quad Prediction Yinhao Bai Yalan Xie Xiaoyi Liu Yuhua Zhao Zhixin Han Mengting Hu Hang Gao Renhong Cheng 43 4 0 11 Jun 2024
AIM: Let Any Multi-modal Large Language Models Embrace Efficient In-Context Learning Jun Gao Qian Qiao Ziqiang Cao Zili Wang Wenjie Li 48 3 0 11 Jun 2024
Adapters Strike Back Jan-Martin O. Steitz Stefan Roth 40 5 0 10 Jun 2024
Survey for Landing Generative AI in Social and E-commerce Recsys -- the Industry Perspectives Da Xu Danqing Zhang Guangyu Yang Bo Yang Shuyuan Xu Lingling Zheng Cindy Liang 32 2 0 10 Jun 2024