Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021

Graham Neubig

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,826 papers shown

Title
FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers Jinyu Chen Wenchao Xu Song Guo Junxiao Wang Jie Zhang Yining Qi FedML 40 32 0 15 Nov 2022
Federated Adaptive Prompt Tuning for Multi-Domain Collaborative Learning Shangchao Su Min Yang Bin Li Xiangyang Xue VLM FedML 48 18 0 15 Nov 2022
Prompting Language Models for Linguistic Structure Terra Blevins Hila Gonen Luke Zettlemoyer LRM 81 40 0 15 Nov 2022
GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost Qingcheng Zeng Lucas Garay Peilin Zhou Dading Chong Yining Hua Jiageng Wu Yi-Cheng Pan Han Zhou Rob Voigt Jie Yang VLM 31 26 0 13 Nov 2022
Few-shot Multimodal Sentiment Analysis based on Multimodal Probabilistic Fusion Prompts Xiaocui Yang Shi Feng Daling Wang Pengfei Hong Soujanya Poria 34 21 0 12 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 41 125 0 11 Nov 2022
EvEntS ReaLM: Event Reasoning of Entity States via Language Models Evangelia Spiliopoulou Artidoro Pagnoni Yonatan Bisk Eduard H. Hovy LRM ReLM 43 10 0 10 Nov 2022
Grammatical Error Correction: A Survey of the State of the Art Christopher Bryant Zheng Yuan Muhammad Reza Qorib Hannan Cao Hwee Tou Ng Ted Briscoe 3DV 34 82 0 09 Nov 2022
Prompting Large Pre-trained Vision-Language Models For Compositional Concept Learning Guangyue Xu Parisa Kordjamshidi J. Chai VLM CoGe LRM 32 10 0 09 Nov 2022
Prompt-Based Metric Learning for Few-Shot NER Yanru Chen Yanan Zheng Zhilin Yang VLM 47 27 0 08 Nov 2022
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models Hao Peng Xiaozhi Wang Shengding Hu Hailong Jin Lei Hou Juanzi Li Zhiyuan Liu Qun Liu 55 23 0 08 Nov 2022
Continuous Prompt Tuning Based Textual Entailment Model for E-commerce Entity Typing Yibo Wang Congying Xia Guan Wang Philip Yu 26 6 0 04 Nov 2022
Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book Stephen MacNeil Andrew Tran Arto Hellas Joanne Kim Sami Sarsa Paul Denny Seth Bernstein Juho Leinonen 56 180 0 04 Nov 2022
Integrated Parameter-Efficient Tuning for General-Purpose Audio Models Ju-ho Kim Ju-Sung Heo Hyun-Seo Shin Chanmann Lim Ha-Jin Yu 26 5 0 04 Nov 2022
Could Giant Pretrained Image Models Extract Universal Representations? Yutong Lin Ze Liu Zheng Zhang Han Hu Nanning Zheng Stephen Lin Yue Cao VLM 54 9 0 03 Nov 2022
Joint Chinese Word Segmentation and Span-based Constituency Parsing Zhicheng Wang Tianyuan Shi Cong Liu 19 0 0 03 Nov 2022
Fine-grained Visual-Text Prompt-Driven Self-Training for Open-Vocabulary Object Detection Yanxin Long Jianhua Han Runhu Huang Xu Hang Yi Zhu Chunjing Xu Xiaodan Liang VLM ObjD 48 18 0 02 Nov 2022
Learning a Condensed Frame for Memory-Efficient Video Class-Incremental Learning Yixuan Pei Zhiwu Qing Jun Cen Xiang Wang Shiwei Zhang Yaxiong Wang Mingqian Tang Nong Sang Xueming Qian 37 13 0 02 Nov 2022
Order-sensitive Neural Constituency Parsing Zhicheng Wang Tianyuan Shi Liyin Xiao Cong Liu 35 0 0 01 Nov 2022
A Close Look into the Calibration of Pre-trained Language Models Yangyi Chen Lifan Yuan Ganqu Cui Zhiyuan Liu Heng Ji 72 48 0 31 Oct 2022
Learning New Tasks from a Few Examples with Soft-Label Prototypes Avyav Kumar Singh Ekaterina Shutova H. Yannakoudakis VLM 58 0 0 31 Oct 2022
Probability-Dependent Gradient Decay in Large Margin Softmax Siyuan Zhang Linbo Xie Ying-Cong Chen 39 0 0 31 Oct 2022
GPS: Genetic Prompt Search for Efficient Few-shot Learning Hanwei Xu Yujun Chen Yulun Du Nan Shao Yanggang Wang Haiyu Li Zhilin Yang VLM 20 28 0 31 Oct 2022
Beyond Prompting: Making Pre-trained Language Models Better Zero-shot Learners by Clustering Representations Yu Fei Ping Nie Zhao Meng Roger Wattenhofer Mrinmaya Sachan VLM 53 20 0 29 Oct 2022
Bi-Directional Iterative Prompt-Tuning for Event Argument Extraction Lu Dai Bang Wang Wei Xiang Yijun Mo 28 16 0 28 Oct 2022
Leveraging Label Correlations in a Multi-label Setting: A Case Study in Emotion Georgios Chochlakis Gireesh Mahajan Sabyasachee Baruah Keith Burghardt Kristina Lerman Shrikanth Narayanan 46 24 0 28 Oct 2022
Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language Paul Denny Viraj Kumar Nasser Giacaman 26 239 0 27 Oct 2022
A Case for Business Process-Specific Foundation Models Sadhana Kumaravel Praveen Venkateswaran Vatche Isahagian Vinod Muthusamy AI4CE 38 9 0 26 Oct 2022
Weakly Supervised Data Augmentation Through Prompting for Dialogue Understanding Maximillian Chen Alexandros Papangelis Chenyang Tao Andrew Rosenbaum Seokhwan Kim Yang Liu Zhou Yu Dilek Z. Hakkani-Tür 44 33 0 25 Oct 2022
This joke is [MASK]: Recognizing Humor and Offense with Prompting Junze Li Mengjie Zhao Yubo Xie Antonis Maronikolakis Pearl Pu Hinrich Schütze AAML 39 1 0 25 Oct 2022
Better Few-Shot Relation Extraction with Label Prompt Dropout Peiyuan Zhang Wei Lu VLM 30 24 0 25 Oct 2022
PALT: Parameter-Lite Transfer of Language Models for Knowledge Graph Completion Jianhao Shen Chenguang Wang Ye Yuan Jiawei Han Heng Ji Koushik Sen Ming Zhang Dawn Song KELM ALM VPVLM 42 7 0 25 Oct 2022
Towards Better Few-Shot and Finetuning Performance with Forgetful Causal Language Models Hao Liu Xinyang Geng Lisa Lee Igor Mordatch Sergey Levine Sharan Narang Pieter Abbeel KELM CLL 45 2 0 24 Oct 2022
TAPE: Assessing Few-shot Russian Language Understanding Ekaterina Taktasheva Tatiana Shavrina Alena Fenogenova Denis Shevelev Nadezhda Katricheva ... Svetlana Iordanskaia Alena Spiridonova Valentina Kurenshchikova Ekaterina Artemova Vladislav Mikhailov AAML 50 10 0 23 Oct 2022
Discriminative Language Model as Semantic Consistency Scorer for Prompt-based Few-Shot Text Classification Zhipeng Xie Yahe Li 37 0 0 23 Oct 2022
Generative Prompt Tuning for Relation Classification Jiale Han Shuai Zhao Bo Cheng Shengkun Ma Wei Lu VLM 49 25 0 22 Oct 2022
Varifocal Question Generation for Fact-checking N. Ousidhoum Moy Yuan Andreas Vlachos 69 25 0 22 Oct 2022
Enhancing Tabular Reasoning with Pattern Exploiting Training Abhilash Shankarampeta Vivek Gupta Shuo Zhang LMTD RALM ReLM 85 6 0 21 Oct 2022
Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks Laura Aina Nikos Voskarides Roi Blanco 50 0 0 21 Oct 2022
Using Large Language Models to Enhance Programming Error Messages Juho Leinonen Arto Hellas Sami Sarsa B. Reeves Paul Denny James Prather Brett A. Becker 29 181 0 20 Oct 2022
Boosting Natural Language Generation from Instructions with Meta-Learning Budhaditya Deb Guoqing Zheng Ahmed Hassan Awadallah 36 13 0 20 Oct 2022
Dense Paraphrasing for Textual Enrichment Jingxuan Tu Kyeongmin Rim E. Holderness James Pustejovsky 43 5 0 20 Oct 2022
Tele-Knowledge Pre-training for Fault Analysis Zhuo Chen Wen Zhang Yufen Huang Yin Hua Yuxia Geng ... Song Jiang Zhaoyang Lian Yuchen Li Lei Cheng Hua-zeng Chen 63 17 0 20 Oct 2022
Robustness of Demonstration-based Learning Under Limited Data Scenario Hongxin Zhang Yanzhe Zhang Ruiyi Zhang Diyi Yang 55 14 0 19 Oct 2022
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining Renqian Luo Liai Sun Yingce Xia Tao Qin Sheng Zhang Hoifung Poon Tie-Yan Liu MedIm AI4CE LM&MA 69 805 0 19 Oct 2022
Leveraging Non-dialogue Summaries for Dialogue Summarization Seongmin Park Dongchan Shin Jihwa Lee 40 4 0 17 Oct 2022
Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task Generalization Yuxian Gu Pei Ke Xiaoyan Zhu Minlie Huang ALM 44 17 0 17 Oct 2022
Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation Xiaohui Song Longtao Huang Hui Xue Songlin Hu 21 84 0 17 Oct 2022
NormSAGE: Multi-Lingual Multi-Cultural Norm Discovery from Conversations On-the-Fly Yi R. Fung Tuhin Chakraborty Hao Guo Owen Rambow Smaranda Muresan Heng Ji 26 39 0 16 Oct 2022
TestAug: A Framework for Augmenting Capability-based NLP Tests Guanqun Yang Mirazul Haque Qiaochu Song Wei Yang Xueqing Liu ELM 39 0 0 14 Oct 2022