Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners

30 August 2021

Ningyu Zhang

Luoqiu Li

Xiang Chen

Shumin Deng

Zhen Bi

Chuanqi Tan

Fei Huang

Huajun Chen

VLM

ArXiv PDF HTML

Papers citing "Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners"

35 / 35 papers shown

Title
Retrieval-Enhanced Few-Shot Prompting for Speech Event Extraction Máté Gedeon RALM 55 0 0 30 Apr 2025
Impeding LLM-assisted Cheating in Introductory Programming Assignments via Adversarial Perturbation Saiful Islam Salim Rubin Yuchan Yang Alexander Cooper Suryashree Ray Saumya Debray Sazzadur Rahaman AAML 47 0 0 12 Oct 2024
Paraphrase Types Elicit Prompt Engineering Capabilities Jan Philip Wahle Terry Ruas Yang Xu Bela Gipp 36 5 0 28 Jun 2024
SSP: Self-Supervised Prompting for Cross-Lingual Transfer to Low-Resource Languages using Large Language Models Vipul Rathore Aniruddha Deb Ankish Chandresh Parag Singla Mausam LRM 52 0 0 27 Jun 2024
ICE-SEARCH: A Language Model-Driven Feature Selection Approach T. Yang Tim Tianyi Yang Fuyuan Lyu Shaoshan Liu Xue Xue Liu 36 4 0 28 Feb 2024
Fine-tune Language Models to Approximate Unbiased In-context Learning Timothy Chu Zhao-quan Song Chiwun Yang 27 15 0 05 Oct 2023
Manifold-based Verbalizer Space Re-embedding for Tuning-free Prompt-based Classification Hao Wang Sendong Zhao Chi-Liang Liu Nuwa Xi Muzhen Cai Bing Qin Ting Liu 29 1 0 08 Sep 2023
Integrating Action Knowledge and LLMs for Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Andy Kaminski Chad Esselink Shiqi Zhang LM&Ro 34 49 0 27 May 2023
Flatness-Aware Prompt Selection Improves Accuracy and Sample Efficiency Lingfeng Shen Weiting Tan Boyuan Zheng Daniel Khashabi VLM 39 6 0 18 May 2023
Revisiting Automated Prompting: Are We Actually Doing Better? Yulin Zhou Yiren Zhao Ilia Shumailov Robert D. Mullins Y. Gal 23 8 0 07 Apr 2023
Rethinking Visual Prompt Learning as Masked Visual Token Modeling Ning Liao Bowen Shi Xiaopeng Zhang Min Cao Junchi Yan Qi Tian VLM 34 7 0 09 Mar 2023
STA: Self-controlled Text Augmentation for Improving Text Classifications Congcong Wang Gonzalo Fiz Pontiveros Steven Derby Tri Kurniawan Wijaya 46 3 0 24 Feb 2023
Few-shot Multimodal Multitask Multilingual Learning Aman Chadha Vinija Jain 53 0 0 19 Feb 2023
Scalable Prompt Generation for Semi-supervised Learning with Language Models Yuhang Zhou Suraj Maharjan Bei Liu VLM 34 13 0 18 Feb 2023
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 24 121 0 11 Nov 2022
Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning Yu Meng Martin Michalski Jiaxin Huang Yu Zhang Tarek F. Abdelzaher Jiawei Han VLM 51 46 0 06 Nov 2022
Two-stage LLM Fine-tuning with Less Specialization and More Generalization Yihan Wang Si Si Daliang Li Michal Lukasik Felix X. Yu Cho-Jui Hsieh Inderjit S Dhillon Sanjiv Kumar 43 29 0 01 Nov 2022
Discriminative Language Model as Semantic Consistency Scorer for Prompt-based Few-Shot Text Classification Zhipeng Xie Yahe Li 24 0 0 23 Oct 2022
Robot Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Chad Esselink Shiqi Zhang LM&Ro 28 19 0 04 Oct 2022
Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models Zichun Yu Tianyu Gao Zhengyan Zhang Yankai Lin Zhiyuan Liu Maosong Sun Jie Zhou VLM LRM 35 1 0 20 Sep 2022
The Creativity of Text-to-Image Generation J. Oppenlaender 25 192 0 13 May 2022
Improving In-Context Few-Shot Learning via Self-Supervised Training Mingda Chen Jingfei Du Ramakanth Pasunuru Todor Mihaylov Srini Iyer Ves Stoyanov Zornitsa Kozareva SSL AI4MH 38 63 0 03 May 2022
Prototypical Verbalizer for Prompt-based Few-shot Tuning Ganqu Cui Shengding Hu Ning Ding Longtao Huang Zhiyuan Liu VLM 20 96 0 18 Mar 2022
Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt Lianzhe Huang Shuming Ma Dongdong Zhang Furu Wei Houfeng Wang VLM LRM 14 32 0 23 Feb 2022
Prompt-Guided Injection of Conformation to Pre-trained Protein Model Qiang Zhang Zeyuan Wang Yuqiang Han Haoran Yu Xurui Jin Huajun Chen 31 3 0 07 Feb 2022
Eliciting Knowledge from Pretrained Language Models for Prototypical Prompt Verbalizer Yinyi Wei Tong Mo Yong-jia Jiang Weiping Li Wen Zhao VLM 29 15 0 14 Jan 2022
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population Ningyu Zhang Xin Xu Li Tao Haiyang Yu Hongbin Ye ... Qiang Chen Feiyu Xiong Fei Huang Guozhou Zheng Huajun Chen VLM HAI 35 42 0 10 Jan 2022
Few-shot Learning with Multilingual Language Models Xi Lin Todor Mihaylov Mikel Artetxe Tianlu Wang Shuohui Chen ... Luke Zettlemoyer Zornitsa Kozareva Mona T. Diab Ves Stoyanov Xian Li BDL ELM LRM 64 285 0 20 Dec 2021
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu Kaixuan Ji Yicheng Fu Weng Lam Tam Zhengxiao Du Zhilin Yang Jie Tang VLM 238 806 0 14 Oct 2021
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu Max Bartolo Alastair Moore Sebastian Riedel Pontus Stenetorp AILaw LRM 279 1,124 0 18 Apr 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,848 0 18 Apr 2021
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 275 1,312 0 17 Jan 2021
WARP: Word-level Adversarial ReProgramming Karen Hambardzumyan Hrant Khachatrian Jonathan May AAML 254 342 0 01 Jan 2021
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 243 1,919 0 31 Dec 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 258 1,589 0 21 Jan 2020