ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2107.13586
  4. Cited By
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods
  in Natural Language Processing

Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021
Pengfei Liu
Weizhe Yuan
Jinlan Fu
Zhengbao Jiang
Hiroaki Hayashi
Graham Neubig
    VLMSyDa
ArXiv (abs)PDFHTML

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown
Title
PRBoost: Prompt-Based Rule Discovery and Boosting for Interactive
  Weakly-Supervised Learning
PRBoost: Prompt-Based Rule Discovery and Boosting for Interactive Weakly-Supervised Learning
Rongzhi Zhang
Yue Yu
Pranav Shetty
Le Song
Chao Zhang
136
25
0
18 Mar 2022
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and
  Implicit Hate Speech Detection
ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection
Thomas Hartvigsen
Saadia Gabriel
Hamid Palangi
Maarten Sap
Dipankar Ray
Ece Kamar
92
392
0
17 Mar 2022
How Many Data Samples is an Additional Instruction Worth?
How Many Data Samples is an Additional Instruction Worth?
Ravsehaj Singh Puri
Swaroop Mishra
Mihir Parmar
Chitta Baral
77
17
0
17 Mar 2022
RelationPrompt: Leveraging Prompts to Generate Synthetic Data for
  Zero-Shot Relation Triplet Extraction
RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction
Yew Ken Chia
Lidong Bing
Soujanya Poria
Luo Si
80
111
0
17 Mar 2022
Speaker Information Can Guide Models to Better Inductive Biases: A Case
  Study On Predicting Code-Switching
Speaker Information Can Guide Models to Better Inductive Biases: A Case Study On Predicting Code-Switching
Alissa Ostapenko
S. Wintner
Melinda Fricke
Yulia Tsvetkov
89
5
0
16 Mar 2022
ConTinTin: Continual Learning from Task Instructions
ConTinTin: Continual Learning from Task Instructions
Wenpeng Yin
Jia Li
Caiming Xiong
CLL
101
30
0
16 Mar 2022
Continuous Detection, Rapidly React: Unseen Rumors Detection based on
  Continual Prompt-Tuning
Continuous Detection, Rapidly React: Unseen Rumors Detection based on Continual Prompt-Tuning
Yuhui Zuo
Wei Zhu
Guoyong Cai
CLLVLM
90
11
0
16 Mar 2022
Iteratively Prompt Pre-trained Language Models for Chain of Thought
Iteratively Prompt Pre-trained Language Models for Chain of Thought
Boshi Wang
Xiang Deng
Huan Sun
KELMReLMLRM
133
103
0
16 Mar 2022
Multilingual Generative Language Models for Zero-Shot Cross-Lingual
  Event Argument Extraction
Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction
Kuan-Hao Huang
I-Hung Hsu
Premkumar Natarajan
Kai-Wei Chang
Nanyun Peng
67
68
0
15 Mar 2022
Things not Written in Text: Exploring Spatial Commonsense from Visual
  Signals
Things not Written in Text: Exploring Spatial Commonsense from Visual Signals
Xiao Liu
Da Yin
Yansong Feng
Dongyan Zhao
LRM
80
46
0
15 Mar 2022
Modular and Parameter-Efficient Multimodal Fusion with Prompting
Modular and Parameter-Efficient Multimodal Fusion with Prompting
Sheng Liang
Mengjie Zhao
Hinrich Schütze
93
45
0
15 Mar 2022
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large
  Language Models
GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models
Archiki Prasad
Peter Hase
Xiang Zhou
Joey Tianyi Zhou
123
124
0
14 Mar 2022
CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual
  Entailment
CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment
Haoyu Song
Li Dong
Weinan Zhang
Ting Liu
Furu Wei
VLMCLIP
89
139
0
14 Mar 2022
Towards Unifying the Label Space for Aspect- and Sentence-based
  Sentiment Analysis
Towards Unifying the Label Space for Aspect- and Sentence-based Sentiment Analysis
Yiming Zhang
Min Zhang
Sai Wu
Jiaqi Zhao
46
16
0
14 Mar 2022
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for
  Pre-trained Language Models
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
Ning Ding
Yujia Qin
Guang Yang
Fu Wei
Zonghan Yang
...
Jianfei Chen
Yang Liu
Jie Tang
Juan Li
Maosong Sun
108
205
0
14 Mar 2022
Towards Visual-Prompt Temporal Answering Grounding in Medical
  Instructional Video
Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Video
Bin Li
Yixuan Weng
Bin Sun
Shutao Li
157
33
0
13 Mar 2022
Low-Rank Softmax Can Have Unargmaxable Classes in Theory but Rarely in
  Practice
Low-Rank Softmax Can Have Unargmaxable Classes in Theory but Rarely in Practice
Andreas Grivas
Nikolay Bogoychev
Adam Lopez
43
10
0
12 Mar 2022
Conditional Prompt Learning for Vision-Language Models
Conditional Prompt Learning for Vision-Language Models
Kaiyang Zhou
Jingkang Yang
Chen Change Loy
Ziwei Liu
VLMCLIPVPVLM
161
1,362
0
10 Mar 2022
Internet-augmented language models through few-shot prompting for
  open-domain question answering
Internet-augmented language models through few-shot prompting for open-domain question answering
Angeliki Lazaridou
E. Gribovskaya
Wojciech Stokowiec
N. Grigorev
KELMLRM
76
139
0
10 Mar 2022
HealthPrompt: A Zero-shot Learning Paradigm for Clinical Natural
  Language Processing
HealthPrompt: A Zero-shot Learning Paradigm for Clinical Natural Language Processing
Sonish Sivarajkumar
Yanshan Wang
VLMLM&MA
103
58
0
09 Mar 2022
HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both
  Language and Vision-and-Language Tasks
HyperPELT: Unified Parameter-Efficient Language Model Tuning for Both Language and Vision-and-Language Tasks
Zhengkun Zhang
Wenya Guo
Xiaojun Meng
Yasheng Wang
Yadao Wang
Xin Jiang
Qun Liu
Zhenglu Yang
80
17
0
08 Mar 2022
Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Models
Input-Tuning: Adapting Unfamiliar Inputs to Frozen Pretrained Models
Shengnan An
Yifei Li
Zeqi Lin
Qian Liu
Bei Chen
Qiang Fu
Weizhu Chen
Nanning Zheng
Jian-Guang Lou
VLMAAML
93
43
0
07 Mar 2022
Dialogue Summaries as Dialogue States (DS2), Template-Guided
  Summarization for Few-shot Dialogue State Tracking
Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Tracking
Jamin Shin
Hangyeol Yu
Hyeongdon Moon
Andrea Madotto
Juneyoung Park
84
29
0
03 Mar 2022
QaNER: Prompting Question Answering Models for Few-shot Named Entity
  Recognition
QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition
Andy T. Liu
Wei Xiao
Henghui Zhu
Dejiao Zhang
Shang-Wen Li
Andrew O. Arnold
76
27
0
03 Mar 2022
EPPAC: Entity Pre-typing Relation Classification with Prompt AnswerCentralizing
Jiejun Tan
Wenbin Hu
Weiwei Liu
86
1
0
01 Mar 2022
Paper Plain: Making Medical Research Papers Approachable to Healthcare
  Consumers with Natural Language Processing
Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processing
Tal August
Lucy Lu Wang
Jonathan Bragg
Marti A. Hearst
Andrew Head
Kyle Lo
94
45
0
28 Feb 2022
SemSup: Semantic Supervision for Simple and Scalable Zero-shot
  Generalization
SemSup: Semantic Supervision for Simple and Scalable Zero-shot Generalization
Austin W. Hanjie
Ameet Deshpande
Karthik Narasimhan
VLM
80
2
0
26 Feb 2022
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event
  Argument Extraction
Prompt for Extraction? PAIE: Prompting Argument Interaction for Event Argument Extraction
Yubo Ma
Zehao Wang
Yixin Cao
Mukai Li
Meiqi Chen
Kunze Wang
Jing Shao
109
135
0
24 Feb 2022
Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified
  Multilingual Prompt
Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt
Lianzhe Huang
Shuming Ma
Dongdong Zhang
Furu Wei
Houfeng Wang
VLMLRM
96
32
0
23 Feb 2022
Prompt-Learning for Short Text Classification
Prompt-Learning for Short Text Classification
Yi Zhu
Xinke Zhou
Jipeng Qiang
Yun Li
Yunhao Yuan
Xindong Wu
VLM
69
36
0
23 Feb 2022
Contextual Semantic Embeddings for Ontology Subsumption Prediction
Contextual Semantic Embeddings for Ontology Subsumption Prediction
Jiaoyan Chen
Yuan He
Yuxia Geng
Ernesto Jiménez-Ruiz
Hang Dong
Ian Horrocks
100
55
0
20 Feb 2022
Revisiting Parameter-Efficient Tuning: Are We Really There Yet?
Revisiting Parameter-Efficient Tuning: Are We Really There Yet?
Guanzheng Chen
Fangyu Liu
Zaiqiao Meng
Shangsong Liang
64
95
0
16 Feb 2022
ZeroGen: Efficient Zero-shot Learning via Dataset Generation
ZeroGen: Efficient Zero-shot Learning via Dataset Generation
Jiacheng Ye
Jiahui Gao
Qintong Li
Hang Xu
Jiangtao Feng
Zhiyong Wu
Tao Yu
Lingpeng Kong
SyDa
134
222
0
16 Feb 2022
Personalized Prompt Learning for Explainable Recommendation
Personalized Prompt Learning for Explainable Recommendation
Lei Li
Yongfeng Zhang
Li Chen
LRM
75
175
0
15 Feb 2022
On Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot
  Pools
On Tracking Dialogue State by Inheriting Slot Values in Mentioned Slot Pools
Zhoujian Sun
Zhengxing Huang
Nai Ding
60
7
0
15 Feb 2022
Domain Adaptation via Prompt Learning
Domain Adaptation via Prompt Learning
Chunjiang Ge
Rui Huang
Mixue Xie
Zihang Lai
Shiji Song
Shuang Li
Gao Huang
VPVLMVLM
115
154
0
14 Feb 2022
Investigating Explainability of Generative AI for Code through
  Scenario-based Design
Investigating Explainability of Generative AI for Code through Scenario-based Design
Jiao Sun
Q. V. Liao
Michael J. Muller
Mayank Agarwal
Stephanie Houde
Kartik Talamadupula
Justin D. Weisz
83
165
0
10 Feb 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP
AdaPrompt: Adaptive Model Training for Prompt-based NLP
Yulong Chen
Yang Liu
Li Dong
Shuohang Wang
Chenguang Zhu
Michael Zeng
Yue Zhang
VLM
102
48
0
10 Feb 2022
Exploring the Limits of Domain-Adaptive Training for Detoxifying
  Large-Scale Language Models
Exploring the Limits of Domain-Adaptive Training for Detoxifying Large-Scale Language Models
Wei Ping
Ming-Yu Liu
Chaowei Xiao
Peng Xu
M. Patwary
Mohammad Shoeybi
Yue Liu
Anima Anandkumar
Bryan Catanzaro
104
71
0
08 Feb 2022
Prompt-Guided Injection of Conformation to Pre-trained Protein Model
Prompt-Guided Injection of Conformation to Pre-trained Protein Model
Qiang Zhang
Zeyuan Wang
Yuqiang Han
Haoran Yu
Xurui Jin
Huajun Chen
60
3
0
07 Feb 2022
PromptSource: An Integrated Development Environment and Repository for
  Natural Language Prompts
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
Stephen H. Bach
Victor Sanh
Zheng-Xin Yong
Albert Webson
Colin Raffel
...
Khalid Almubarak
Xiangru Tang
Dragomir R. Radev
Mike Tian-Jian Jiang
Alexander M. Rush
VLM
356
356
0
02 Feb 2022
Co-training Improves Prompt-based Learning for Large Language Models
Co-training Improves Prompt-based Learning for Large Language Models
Hunter Lang
Monica Agrawal
Yoon Kim
David Sontag
VLMLRM
213
41
0
02 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Jason W. Wei
Xuezhi Wang
Dale Schuurmans
Maarten Bosma
Brian Ichter
F. Xia
Ed H. Chi
Quoc Le
Denny Zhou
LM&RoLRMAI4CEReLM
1.0K
9,796
0
28 Jan 2022
Synchromesh: Reliable code generation from pre-trained language models
Synchromesh: Reliable code generation from pre-trained language models
Gabriel Poesia
Oleksandr Polozov
Vu Le
A. Tiwari
Gustavo Soares
Christopher Meek
Sumit Gulwani
78
163
0
26 Jan 2022
Learning to Compose Diversified Prompts for Image Emotion Classification
Learning to Compose Diversified Prompts for Image Emotion Classification
Sinuo Deng
Lifang Wu
Ge Shi
Lehao Xing
Meng Jian
Ye Xiang
CLIPVLM
57
31
0
26 Jan 2022
Relational Memory Augmented Language Models
Relational Memory Augmented Language Models
Qi Liu
Dani Yogatama
Phil Blunsom
KELMRALM
131
32
0
24 Jan 2022
Description-Driven Task-Oriented Dialog Modeling
Description-Driven Task-Oriented Dialog Modeling
Jeffrey Zhao
Raghav Gupta
Yuan Cao
Dian Yu
Mingqiu Wang
Harrison Lee
Abhinav Rastogi
Izhak Shafran
Yonghui Wu
106
65
0
21 Jan 2022
Context-Tuning: Learning Contextualized Prompts for Natural Language
  Generation
Context-Tuning: Learning Contextualized Prompts for Natural Language Generation
Tianyi Tang
Junyi Li
Wayne Xin Zhao
Ji-Rong Wen
83
17
0
21 Jan 2022
Black-box Prompt Learning for Pre-trained Language Models
Black-box Prompt Learning for Pre-trained Language Models
Shizhe Diao
Zhichao Huang
Ruijia Xu
Xuechun Li
Yong Lin
Xiao Zhou
Tong Zhang
VLMAAML
102
71
0
21 Jan 2022
Fooling MOSS Detection with Pretrained Language Models
Fooling MOSS Detection with Pretrained Language Models
Stella Biderman
Edward Raff
DeLMO
74
36
0
19 Jan 2022
Previous
123...34353637
Next