v1v2 (latest)

The Power of Scale for Parameter-Efficient Prompt Tuning

18 April 2021

Papers citing "The Power of Scale for Parameter-Efficient Prompt Tuning"

50 / 2,607 papers shown

Title
Privacy-Preserving Prompt Tuning for Large Language Model Services Yansong Li Zhixing Tan Yang Liu SILM VLM 112 69 0 10 May 2023
Synthetic Query Generation for Privacy-Preserving Deep Retrieval Systems using Differentially Private Language Models Aldo G. Carranza Rezsa Farahani Natalia Ponomareva Alexey Kurakin Matthew Jagielski Milad Nasr SyDa 82 7 0 10 May 2023
Towards Building the Federated GPT: Federated Instruction Tuning Jianyi Zhang Saeed Vahidian Martin Kuo Chunyuan Li Ruiyi Zhang Tong Yu Yufan Zhou Guoyin Wang Yiran Chen ALM FedML 87 132 0 09 May 2023
Adapt and Align to Improve Zero-Shot Sketch-Based Image Retrieval Shiyin Dong Mingrui Zhu N. Wang Xinbo Gao VLM 81 3 0 09 May 2023
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation Anchun Gui Han Xiao 60 5 0 08 May 2023
Controllable Mixed-Initiative Dialogue Generation through Prompting Maximillian Chen Xiao Yu Weiyan Shi Urvi Awasthi Zhou Yu 64 28 0 06 May 2023
DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognition Chunkit Chan Xin Liu Cheng Jiayang Zihan Li Yangqiu Song Ginny Wong Simon See 82 31 0 06 May 2023
Residual Prompt Tuning: Improving Prompt Tuning with Residual Reparameterization Anastasia Razdaibiedina Yuning Mao Rui Hou Madian Khabsa M. Lewis Jimmy Ba Amjad Almahairi VLM 81 51 0 06 May 2023
COLA: A Benchmark for Compositional Text-to-image Retrieval Arijit Ray Filip Radenovic Abhimanyu Dubey Bryan A. Plummer Ranjay Krishna Kate Saenko CoGe VLM 112 38 0 05 May 2023
Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge Jiawei Liu Ziteng Xiong Yi-ping Jiang Yongqiang Ma Wei Lu Yong Huang Qikai Cheng 49 1 0 05 May 2023
Personalize Segment Anything Model with One Shot Renrui Zhang Zhengkai Jiang Ziyu Guo Shilin Yan Junting Pan Xianzheng Ma Hao Dong Peng Gao Hongsheng Li MLLM VLM 113 219 0 04 May 2023
Automatic Prompt Optimization with "Gradient Descent" and Beam Search Reid Pryzant Dan Iter Jerry Li Y. Lee Chenguang Zhu Michael Zeng 97 359 0 04 May 2023
Unified Model Learning for Various Neural Machine Translation Yunlong Liang Fandong Meng Jinan Xu Jiaan Wang Jinan Xu Jie Zhou 81 1 0 04 May 2023
Prompt-ICM: A Unified Framework towards Image Coding for Machines with Task-driven Prompts Ruoyu Feng Jinming Liu Xin Jin Xiaohan Pan Heming Sun Zhibo Chen VLM 112 13 0 04 May 2023
Black-box Prompt Tuning with Subspace Learning Yuanhang Zheng Zhixing Tan Peng Li Yang Liu VLM 147 11 0 04 May 2023
PTP: Boosting Stability and Performance of Prompt Tuning with Perturbation-Based Regularizer Lichang Chen Heng-Chiao Huang Varun Madhavan AAML 176 12 0 03 May 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes Lokesh Nagalapatti Chun-Liang Li Chih-Kuan Yeh Hootan Nakhost Yasuhisa Fujii Alexander Ratner Ranjay Krishna Chen-Yu Lee Tomas Pfister ALM 360 562 0 03 May 2023
Making the Most of What You Have: Adapting Pre-trained Visual Language Models in the Low-data Regime Chuhan Zhang Antoine Miech Jiajun Shen Jean-Baptiste Alayrac Pauline Luc VLM VPVLM 90 2 0 03 May 2023
Learngene: Inheriting Condensed Knowledge from the Ancestry Model to Descendant Models Qiufeng Wang Xu Yang Shuxia Lin Jing Wang Xin Geng 80 13 0 03 May 2023
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner Zhengxiang Shi Aldo Lipani VLM CLL 80 22 0 02 May 2023
Distill or Annotate? Cost-Efficient Fine-Tuning of Compact Models Junmo Kang Wei Xu Alan Ritter 128 15 0 02 May 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models Deming Ye Yankai Lin Zhengyan Zhang Maosong Sun KELM 55 0 0 02 May 2023
Parameter-Efficient Cross-lingual Transfer of Vision and Language Models via Translation-based Alignment Zhen Zhang Jialu Wang Xinze Wang VLM 104 2 0 02 May 2023
VPGTrans: Transfer Visual Prompt Generator across LLMs Ao Zhang Hao Fei Yuan Yao Wei Ji Li Li Zhiyuan Liu Tat-Seng Chua MLLM VLM 89 89 0 02 May 2023
Prompt as Triggers for Backdoor Attack: Examining the Vulnerability in Language Models Shuai Zhao Jinming Wen Anh Tuan Luu Jiaqi Zhao Jie Fu SILM 176 99 0 02 May 2023
RadAdapt: Radiology Report Summarization via Lightweight Domain Adaptation of Large Language Models Dave Van Veen Cara Van Uden Maayane Attias Anuj Pareek Christian Blüthgen ... Jean-Benoit Delbrouck Juan Manuel Zambrano Chaves C. Langlotz Akshay S. Chaudhari John M. Pauly LM&MA 87 29 0 02 May 2023
Consolidator: Mergeable Adapter with Grouped Connections for Visual Adaptation Tianxiang Hao Hui Chen Yuchen Guo Guiguang Ding 132 16 0 30 Apr 2023
Reliable Gradient-free and Likelihood-free Prompt Tuning Maohao Shen S. Ghosh P. Sattigeri Subhro Das Yuheng Bu G. Wornell VLM 115 12 0 30 Apr 2023
POUF: Prompt-oriented unsupervised fine-tuning for large pre-trained models Korawat Tanwisuth Shujian Zhang Huangjie Zheng Pengcheng He Mingyuan Zhou VLM VPVLM 188 28 0 29 Apr 2023
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT Zhe Xiao Yuzhong Chen Lu Zhang Jun Yao Zihao Wu ... Yixuan Yuan Dinggang Shen Dajiang Zhu Tianming Liu Xi Jiang VLM MLLM 138 17 0 29 Apr 2023
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model Peng Gao Jiaming Han Renrui Zhang Ziyi Lin Shijie Geng ... Pan Lu Conghui He Xiangyu Yue Hongsheng Li Yu Qiao MLLM 120 588 0 28 Apr 2023
Empirical Analysis of the Strengths and Weaknesses of PEFT Techniques for LLMs George Pu Anirudh Jain Jihan Yin Russell Kaplan 75 43 0 28 Apr 2023
Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessment Haoning Wu Liang Liao Annan Wang Chaofeng Chen Jingwen Hou Wenxiu Sun Qiong Yan Weisi Lin 102 15 0 28 Apr 2023
Prompt Engineering for Healthcare: Methodologies and Applications Jiaqi Wang Enze Shi Sigang Yu Zihao Wu Chong Ma ... Dajiang Zhu Yixuan Yuan Dinggang Shen Tianming Liu Shu Zhang LM&MA 131 116 0 28 Apr 2023
$π$ -Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation Chengyue Wu Teng Wang Yixiao Ge Zeyu Lu Rui-Zhi Zhou Ying Shan Ping Luo MoMe 145 37 0 27 Apr 2023
CONSCENDI: A Contrastive and Scenario-Guided Distillation Approach to Guardrail Models for Virtual Assistants A. Sun Varun Nair Elliot Schumacher Anitha Kannan 80 3 0 27 Apr 2023
FVP: Fourier Visual Prompting for Source-Free Unsupervised Domain Adaptation of Medical Image Segmentation Yan Wang Jian Cheng Yixin Chen Shuai Shao Lanyun Zhu Zhenzhou Wu Tianming Liu Haogang Zhu OOD MedIm 126 26 0 26 Apr 2023
CitePrompt: Using Prompts to Identify Citation Intent in Scientific Papers Avishek Lahiri Debarshi Kumar Sanyal Imon Mukherjee 35 8 0 25 Apr 2023
PEFT-Ref: A Modular Reference Architecture and Typology for Parameter-Efficient Finetuning Techniques Mohammed Sabry Anya Belz 109 8 0 24 Apr 2023
AMR Parsing with Instruction Fine-tuned Pre-trained Language Models Young-Suk Lee Ramón Fernández Astudillo Radu Florian Tahira Naseem Salim Roukos 66 4 0 24 Apr 2023
LaMP: When Large Language Models Meet Personalization Alireza Salemi Sheshera Mysore Michael Bendersky Hamed Zamani RALM 131 241 0 22 Apr 2023
RPLKG: Robust Prompt Learning with Knowledge Graph Yewon Kim Yongtaek Lim Dokyung Yoon Kyungwoo Song Kyungwoo Song VLM 21 0 0 21 Apr 2023
Multi-view Vision-Prompt Fusion Network: Can 2D Pre-trained Model Boost 3D Point Cloud Data-scarce Learning? Hao Peng Baopu Li Bo Zhang Xin Chen Tao Chen Erik Cambria 3DPC 97 1 0 20 Apr 2023
AdapterGNN: Parameter-Efficient Fine-Tuning Improves Generalization in GNNs Shengrui Li Xueting Han Jing Bai AI4CE 45 12 0 19 Apr 2023
MixPro: Simple yet Effective Data Augmentation for Prompt-based Learning Bohan Li Longxu Dou Yutai Hou Yunlong Feng Honglin Mu Qingfu Zhu Qinghua Sun Wanxiang Che VLM 76 4 0 19 Apr 2023
D2CSE: Difference-aware Deep continuous prompts for Contrastive Sentence Embeddings HyunJae Lee VLM 52 0 0 18 Apr 2023
Hyper-Decision Transformer for Efficient Online Policy Adaptation Mengdi Xu Yuchen Lu Songlin Yang Shun Zhang Ding Zhao Chuang Gan OffRL 73 41 0 17 Apr 2023
Towards Robust Prompts on Vision-Language Models Jindong Gu Ahmad Beirami Xuezhi Wang Alex Beutel Philip Torr Yao Qin VLM VPVLM 86 8 0 17 Apr 2023
Learning to Compress Prompts with Gist Tokens Jesse Mu Xiang Lisa Li Noah D. Goodman VLM 148 227 0 17 Apr 2023
LongForm: Effective Instruction Tuning with Reverse Instructions Abdullatif Köksal Timo Schick Anna Korhonen Hinrich Schütze SyDa ALM 162 40 0 17 Apr 2023