PPT: Pre-trained Prompt Tuning for Few-shot Learning

9 September 2021

Yuxian Gu

Xu Han

Zhiyuan Liu

Minlie Huang

VLM

ArXiv PDF HTML

Papers citing "PPT: Pre-trained Prompt Tuning for Few-shot Learning"

50 / 204 papers shown

Title
A Communication Theory Perspective on Prompting Engineering Methods for Large Language Models Yuanfeng Song Yuanqin He Xuefang Zhao Hanlin Gu Di Jiang Haijun Yang Lixin Fan Qiang Yang 32 3 0 24 Oct 2023
Topic-DPR: Topic-based Prompts for Dense Passage Retrieval Q. Xiao Shuangyin Li Lei Chen 31 2 0 10 Oct 2023
Model Tuning or Prompt Tuning? A Study of Large Language Models for Clinical Concept and Relation Extraction C.A.I. Peng Xi Yang Kaleb E. Smith Zehao Yu Aokun Chen Jiang Bian Yonghui Wu VLM LRM 33 28 0 10 Oct 2023
How Reliable Are AI-Generated-Text Detectors? An Assessment Framework Using Evasive Soft Prompts Tharindu Kumarage Paras Sheth Raha Moraffah Joshua Garland Huan Liu DeLMO 26 23 0 08 Oct 2023
Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning Liam Collins Shanshan Wu Sewoong Oh K. Sim FedML 34 9 0 06 Oct 2023
Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language Jingyuan Sun Xiaohan Zhang Marie-Francine Moens 51 4 0 05 Oct 2023
Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models Zihao Lin Yan Sun Yifan Shi Xueqian Wang Lifu Huang Li Shen Dacheng Tao 34 11 0 04 Oct 2023
Prompting-based Temporal Domain Generalization Sepidehsadat Hosseini Mengyao Zhai Hossein Hajimirsadegh Frederick Tung AI4TS AI4CE OOD 25 0 0 03 Oct 2023
Parameter-Efficient Tuning Helps Language Model Alignment Tianci Xue Ziqi Wang Heng Ji ALM 38 6 0 01 Oct 2023
VPA: Fully Test-Time Visual Prompt Adaptation Jiachen Sun Mark Ibrahim Melissa Hall Ivan Evtimov Z. Morley Mao Cristian Canton Ferrer C. Hazirbas VLM 43 6 0 26 Sep 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning J. Wang Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 31 4 0 26 Sep 2023
Query-Dependent Prompt Evaluation and Optimization with Offline Inverse RL Hao Sun Alihan Huyuk M. Schaar OffRL LRM 20 27 0 13 Sep 2023
DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning Zhengxiang Shi Aldo Lipani VLM 28 30 0 11 Sep 2023
TransPrompt v2: A Transferable Prompting Framework for Cross-task Text Classification J. Wang Chengyu Wang Cen Chen Ming Gao Jun Huang Aoying Zhou VLM 30 0 0 29 Aug 2023
Read-only Prompt Optimization for Vision-Language Few-shot Learning Dongjun Lee Seokwon Song Jihee G. Suh Joonmyeong Choi S. Lee Hyunwoo J.Kim VLM 39 42 0 29 Aug 2023
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory Haiwen Diao Bo Wan Yuhang Zhang Xuecong Jia Huchuan Lu Long Chen VLM 31 18 0 28 Aug 2023
Large Language Models for Software Engineering: A Systematic Literature Review Xinying Hou Yanjie Zhao Yue Liu Zhou Yang Kailong Wang Li Li Xiapu Luo David Lo John C. Grundy Haoyu Wang 39 323 0 21 Aug 2023
Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training Xiaoyang Wu Zhuotao Tian Xin Wen Bohao Peng Xihui Liu Kaicheng Yu Hengshuang Zhao 26 46 0 18 Aug 2023
Knowledge Prompt-tuning for Sequential Recommendation Jian F. Zhai Xiawu Zheng Changjian Wang Hui Li Yonghong Tian VLM 27 23 0 14 Aug 2023
Emotion-Conditioned Text Generation through Automatic Prompt Optimization Yarik Menchaca Resendiz Roman Klinger 19 5 0 09 Aug 2023
LoRA-FA: Memory-efficient Low-rank Adaptation for Large Language Models Fine-tuning Longteng Zhang Lin Zhang S. Shi X. Chu Bo-wen Li AI4CE 18 91 0 07 Aug 2023
PromptSum: Parameter-Efficient Controllable Abstractive Summarization Mathieu Ravaut Hailin Chen Ruochen Zhao Chengwei Qin Shafiq R. Joty Nancy Chen 29 2 0 06 Aug 2023
Low-Parameter Federated Learning with Large Language Models Jing Jiang Xiangyang Liu Chenyou Fan 21 24 0 26 Jul 2023
Multimodal Prompt Learning for Product Title Generation with Extremely Limited Labels Bang-ju Yang Fenglin Liu Zheng Li Qingyu Yin Chenyu You Bing Yin Yuexian Zou VLM 33 5 0 05 Jul 2023
Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue Generation Weihao Zeng Lulu Zhao Keqing He Ruotong Geng Jingang Wang Wei Yu Wu Weiran Xu 40 3 0 17 Jun 2023
Soft Language Clustering for Multilingual Model Pre-training Jiali Zeng Yu Jiang Yongjing Yin Yingqi Jing Fandong Meng Binghuai Lin Yunbo Cao Jie Zhou 25 4 0 13 Jun 2023
Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learning Hengyuan Zhang Dawei Li Yanran Li Chenming Shang Chufan Shi Yong-jia Jiang 43 13 0 09 Jun 2023
InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding Junda Wu Tong Yu Rui Wang Zhao-quan Song Ruiyi Zhang Handong Zhao Chaochao Lu Shuai Li Ricardo Henao VLM 33 23 0 08 Jun 2023
Adapting Pre-trained Language Models to Vision-Language Tasks via Dynamic Visual Prompting Shubin Huang Qiong Wu Yiyi Zhou Weijie Chen Rongsheng Zhang Xiaoshuai Sun Rongrong Ji VLM VPVLM LRM 16 0 0 01 Jun 2023
Exploring Lottery Prompts for Pre-trained Language Models Yulin Chen Ning Ding Xiaobin Wang Shengding Hu Haitao Zheng Zhiyuan Liu Pengjun Xie VLM LRM 21 7 0 31 May 2023
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey Chen Ling Xujiang Zhao Jiaying Lu Chengyuan Deng Can Zheng ... Chris White Quanquan Gu Jian Pei Carl Yang Liang Zhao ALM 27 126 0 30 May 2023
Entailment as Robust Self-Learner Jiaxin Ge Hongyin Luo Yoon Kim James R. Glass 42 3 0 26 May 2023
Neural Architecture Search for Parameter-Efficient Fine-tuning of Large Pre-trained Language Models Neal Lawton Anoop Kumar Govind Thattai Aram Galstyan Greg Ver Steeg 17 16 0 26 May 2023
Zero-shot Approach to Overcome Perturbation Sensitivity of Prompts Mohna Chakraborty Adithya Kulkarni Qi Li VLM 22 9 0 25 May 2023
Robust Prompt Optimization for Large Language Models Against Distribution Shifts Moxin Li Wenjie Wang Fuli Feng Yixin Cao Jizhi Zhang Tat-Seng Chua OffRL 42 15 0 23 May 2023
Prefix Propagation: Parameter-Efficient Tuning for Long Sequences Jonathan Li Will Aitken R. Bhambhoria Xiao-Dan Zhu 17 14 0 20 May 2023
Parameter-Efficient Learning for Text-to-Speech Accent Adaptation Lijie Yang Chao-Han Huck Yang Jen-Tzung Chien 16 10 0 18 May 2023
Flatness-Aware Prompt Selection Improves Accuracy and Sample Efficiency Lingfeng Shen Weiting Tan Boyuan Zheng Daniel Khashabi VLM 39 6 0 18 May 2023
MolXPT: Wrapping Molecules with Text for Generative Pre-training Zequn Liu Wei Zhang Yingce Xia Lijun Wu Shufang Xie Tao Qin M. Zhang Tie-Yan Liu 25 66 0 18 May 2023
When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario Chengcheng Han Liqing Cui Renyu Zhu J. Wang Nuo Chen Qiushi Sun Xiang Li Ming Gao 30 7 0 17 May 2023
Prompt-Tuning Decision Transformer with Preference Ranking Shengchao Hu Li Shen Ya-Qin Zhang Dacheng Tao OffRL 28 14 0 16 May 2023
Pre-Training to Learn in Context Yuxian Gu Li Dong Furu Wei Minlie Huang CLIP LRM ReLM 113 37 0 16 May 2023
Parameter-Efficient Fine-Tuning with Layer Pruning on Free-Text Sequence-to-Sequence Modeling Y. Zhu Xuebing Yang Yuanyuan Wu Wensheng Zhang MedIm 20 2 0 15 May 2023
MMG-Ego4D: Multi-Modal Generalization in Egocentric Action Recognition Xinyu Gong S. Mohan Naina Dhingra Jean-Charles Bazin Yilei Li Zhangyang Wang Rakesh Ranjan EgoV 56 17 0 12 May 2023
Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner Zhengxiang Shi Aldo Lipani VLM CLL 37 21 0 02 May 2023
Instruction-ViT: Multi-Modal Prompts for Instruction Learning in ViT Zhe Xiao Yuzhong Chen Lu Zhang Jun Yao Zihao Wu ... Yixuan Yuan Dinggang Shen Dajiang Zhu Tianming Liu Xi Jiang VLM MLLM 63 17 0 29 Apr 2023
PVP: Pre-trained Visual Parameter-Efficient Tuning Zhao-quan Song Ke Yang Naiyang Guan Junjie Zhu Peng Qiao Qingyong Hu VPVLM VLM 32 3 0 26 Apr 2023
RPLKG: Robust Prompt Learning with Knowledge Graph Yewon Kim Yongtaek Lim Dokyung Yoon Kyungwoo Song VLM 6 0 0 21 Apr 2023
TransHP: Image Classification with Hierarchical Prompting Wenhao Wang Yifan Sun W. Li Yi Yang 21 16 0 13 Apr 2023
Global Prompt Cell: A Portable Control Module for Effective Prompt Tuning Chi-Liang Liu Hao Wang Nuwa Xi Sendong Zhao Bing Qin VLM 16 1 0 12 Apr 2023