Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown

Title
Not Just Pretty Pictures: Toward Interventional Data Augmentation Using Text-to-Image Generators Jianhao Yuan Francesco Pinto Adam Davies Philip Torr DiffM 87 12 0 21 Dec 2022
Language Models as Inductive Reasoners Zonglin Yang Li Dong Xinya Du Hao Cheng Min Zhang Xiaodong Liu Jianfeng Gao Furu Wei ReLM LRM 96 37 0 21 Dec 2022
MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning Zhiyang Xu Ying Shen Lifu Huang MLLM 141 120 0 21 Dec 2022
MolCPT: Molecule Continuous Prompt Tuning to Generalize Molecular Representation Learning Cameron Diao Kaixiong Zhou Zirui Liu Xiao Huang Helen Zhou 67 15 0 20 Dec 2022
Unleashing the Power of Visual Prompting At the Pixel Level Junyang Wu Xianhang Li Chen Wei Huiyu Wang Alan Yuille Yuyin Zhou Cihang Xie VPVLM VLM 99 32 0 20 Dec 2022
Task Ambiguity in Humans and Language Models Alex Tamkin Kunal Handa Ava Shrestha Noah D. Goodman UQLM 124 23 0 20 Dec 2022
MULTI3NLU++: A Multilingual, Multi-Intent, Multi-Domain Dataset for Natural Language Understanding in Task-Oriented Dialogue Nikita Moghe E. Razumovskaia Liane Guillou Ivan Vulić Anna Korhonen Alexandra Birch 90 13 0 20 Dec 2022
Large Language Models Are Reasoning Teachers Namgyu Ho Laura Schmid Se-Young Yun ReLM ELM LRM 153 351 0 20 Dec 2022
When Do Decompositions Help for Machine Reading? Kangda Wei Dawn J Lawrie Benjamin Van Durme Yunmo Chen Orion Weller ReLM 152 3 0 20 Dec 2022
One Embedder, Any Task: Instruction-Finetuned Text Embeddings Hongjin Su Weijia Shi Jungo Kasai Yizhong Wang Yushi Hu Mari Ostendorf Wen-tau Yih Noah A. Smith Luke Zettlemoyer Tao Yu 119 303 0 19 Dec 2022
Position-guided Text Prompt for Vision-Language Pre-training Alex Jinpeng Wang Pan Zhou Mike Zheng Shou Shuicheng Yan VLM 70 38 0 19 Dec 2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting Zheng-Xin Yong Hailey Schoelkopf Niklas Muennighoff Alham Fikri Aji David Ifeoluwa Adelani ... Genta Indra Winata Stella Biderman Edward Raff Dragomir R. Radev Vassilina Nikoulina CLL VLM AI4CE LRM 147 89 0 19 Dec 2022
E-NER -- An Annotated Named Entity Recognition Corpus of Legal Text Ting Wai Terence Au Ingemar J. Cox Vasileios Lampos AILaw 72 28 0 19 Dec 2022
PoE: a Panel of Experts for Generalized Automatic Dialogue Assessment Chen Zhang L. F. D’Haro Qiquan Zhang Thomas Friedrichs Haizhou Li 81 7 0 18 Dec 2022
Foundation models in brief: A historical, socio-technical focus Johannes Schneider VLM 71 9 0 17 Dec 2022
Decoder Tuning: Efficient Language Understanding as Decoding Ganqu Cui Wentao Li Ning Ding Longtao Huang Zhiyuan Liu Maosong Sun 78 6 0 16 Dec 2022
FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks Weilong Dong Xinwei Wu Junzhuo Li Shuangzhi Wu Chao Bian Deyi Xiong FedML 106 6 0 16 Dec 2022
Controllable Text Generation via Probability Density Estimation in the Latent Space Yuxuan Gu Xiaocheng Feng Sicheng Ma Lingyuan Zhang Heng Gong Weihong Zhong Bing Qin 92 18 0 16 Dec 2022
Transformers learn in-context by gradient descent J. Oswald Eyvind Niklasson E. Randazzo João Sacramento A. Mordvintsev A. Zhmoginov Max Vladymyrov MLT 154 497 0 15 Dec 2022
Artificial Intelligence for Health Message Generation: Theory, Method, and an Empirical Study Using Prompt Engineering Sue Lim Ralf Schmälzle 62 59 0 14 Dec 2022
Federated Few-Shot Learning for Mobile NLP Dongqi Cai Shangguang Wang Yaozong Wu F. Lin Mengwei Xu FedML 93 12 0 12 Dec 2022
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization Yiwei Qin Graham Neubig Pengfei Liu 72 4 0 12 Dec 2022
PromptCAL: Contrastive Affinity Learning via Auxiliary Prompts for Generalized Novel Category Discovery Shengxiang Zhang Salman Khan Zhiqiang Shen Muzammal Naseer Guangyi Chen Fahad Shahbaz Khan CLL VLM 71 64 0 11 Dec 2022
From Cloze to Comprehension: Retrofitting Pre-trained Masked Language Model to Pre-trained Machine Reader Weiwen Xu Xin Li Wenxuan Zhang Meng Zhou W. Lam Luo Si Lidong Bing 90 2 0 09 Dec 2022
Task Bias in Vision-Language Models Sachit Menon I. Chandratreya Carl Vondrick VLM SSL 72 6 0 08 Dec 2022
Harnessing the Power of Multi-Task Pretraining for Ground-Truth Level Natural Language Explanations Björn Plüster Jakob Ambsdorf Lukas Braach Jae Hee Lee S. Wermter 78 6 0 08 Dec 2022
Learning Domain Invariant Prompt for Vision-Language Models Cairong Zhao Yubin Wang Xinyang Jiang Yifei Shen Kaitao Song Dongsheng Li Duoqian Miao VLM VPVLM 90 27 0 08 Dec 2022
Decorate the Newcomers: Visual Domain Prompt for Continual Test Time Adaptation Yulu Gan Yan Bai Yihang Lou Xianzheng Ma Renrui Zhang Nian Shi Lin Luo OOD VLM 83 100 0 08 Dec 2022
LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Models Chan Hee Song Jiaman Wu Clay Washington Brian M Sadler Wei-Lun Chao Yu-Chuan Su LLMAG LM&Ro 190 425 0 08 Dec 2022
Discovering Latent Knowledge in Language Models Without Supervision Collin Burns Haotian Ye Dan Klein Jacob Steinhardt 166 386 0 07 Dec 2022
Robustness of Learning from Task Instructions Jiasheng Gu Hongyu Zhao Hanzi Xu Liang Nie Hongyuan Mei Wenpeng Yin OOD 101 34 0 07 Dec 2022
ViTPose++: Vision Transformer for Generic Body Pose Estimation Yufei Xu Jing Zhang Qiming Zhang Dacheng Tao ViT 184 46 0 07 Dec 2022
Towards using Few-Shot Prompt Learning for Automating Model Completion Meriem Ben Chaaben Lola Burgueño H. Sahraoui VLM LRM 108 34 0 07 Dec 2022
Automated Identification of Eviction Status from Electronic Health Record Notes Zonghai Yao J. Tsai Weisong Liu David Levy Emily Druhl J. Reisman Hongfeng Yu 97 11 0 06 Dec 2022
In-context Examples Selection for Machine Translation Sweta Agrawal Chunting Zhou M. Lewis Luke Zettlemoyer Marjan Ghazvininejad LRM 137 198 0 05 Dec 2022
Legal Prompt Engineering for Multilingual Legal Judgement Prediction Dietrich Trautmann Alina Petrova Frank Schilder ELM AILaw 102 80 0 05 Dec 2022
Controllable Image Captioning via Prompting Ning Wang Jiahao Xie Jihao Wu Mingbo Jia Linlin Li 66 24 0 04 Dec 2022
Towards Robust NLG Bias Evaluation with Syntactically-diverse Prompts Arshiya Aggarwal Jiao Sun Nanyun Peng 75 7 0 03 Dec 2022
CoP: Factual Inconsistency Detection by Controlling the Preference Shuaijie She Xiang Geng Shujian Huang Jiajun Chen 100 5 0 03 Dec 2022
Designing Ecosystems of Intelligence from First Principles Karl J. Friston M. Ramstead Alex B. Kiefer Alexander Tschantz Christopher L. Buckley ... K. Fung Jason G. Fox Steven Swanson D. Mapes Gabriel René 81 34 0 02 Dec 2022
SumREN: Summarizing Reported Speech about Events in News R. Reddy Heba Elfardy Hou Pong Chan Kevin Small Chenhui Xu 64 5 0 02 Dec 2022
Cloud-Device Collaborative Adaptation to Continual Changing Environments in the Real-world Yulu Gan Mingjie Pan Rongyu Zhang Zijian Ling Lingran Zhao Jiaming Liu Shanghang Zhang VLM 73 15 0 02 Dec 2022
Few-Shot Nested Named Entity Recognition Hong Ming Jiaoyun Yang Lili Jiang Yan Pan Ning An 81 10 0 02 Dec 2022
Context-Aware Robust Fine-Tuning Xiaofeng Mao YueFeng Chen Xiaojun Jia Rong Zhang Hui Xue Zhao Li VLM CLIP 85 28 0 29 Nov 2022
Action-GPT: Leveraging Large-scale Language Models for Improved and Generalized Action Generation Sai Shashank Kalakonda Shubh Maheshwari Ravi Kiran Sarvadevabhatla 114 28 0 28 Nov 2022
On the Security Vulnerabilities of Text-to-SQL Models Xutan Peng Yipeng Zhang Jingfeng Yang Mark Stevenson SILM 89 10 0 28 Nov 2022
Arguments to Key Points Mapping with Prompt-based Learning Ahnaf Mozib Samin Behrooz Nikandish Jingyan Chen AAML 52 2 0 28 Nov 2022
PUnifiedNER: A Prompting-based Unified NER System for Diverse Datasets Jinghui Lu Rui Zhao Brian Mac Namee Fei Tan 97 21 0 27 Nov 2022
Navigation as Attackers Wish? Towards Building Robust Embodied Agents under Federated Learning Yunchao Zhang Zonglin Di KAI-QING Zhou Cihang Xie Xin Eric Wang FedML AAML 88 2 0 27 Nov 2022
BadPrompt: Backdoor Attacks on Continuous Prompts Xiangrui Cai Haidong Xu Sihan Xu Ying Zhang Xiaojie Yuan SILM 85 67 0 27 Nov 2022