ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2107.13586
  4. Cited By
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods
  in Natural Language Processing

Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing

28 July 2021
Pengfei Liu
Weizhe Yuan
Jinlan Fu
Zhengbao Jiang
Hiroaki Hayashi
Graham Neubig
    VLMSyDa
ArXiv (abs)PDFHTML

Papers citing "Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing"

50 / 1,829 papers shown
Title
QRelScore: Better Evaluating Generated Questions with Deeper
  Understanding of Context-aware Relevance
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance
Xiaoqiang Wang
Bang Liu
Siliang Tang
Lingfei Wu
82
9
0
29 Apr 2022
Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text
  Generation
Tailor: A Prompt-Based Approach to Attribute-Based Controlled Text Generation
Kexin Yang
Dayiheng Liu
Wenqiang Lei
Baosong Yang
Mingfeng Xue
Boxing Chen
Jun Xie
79
29
0
28 Apr 2022
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural
  Language Understanding in Task-Oriented Dialogue
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue
I. Casanueva
Ivan Vulić
Georgios P. Spithourakis
Paweł Budzianowski
88
11
0
27 Apr 2022
Probing Simile Knowledge from Pre-trained Language Models
Probing Simile Knowledge from Pre-trained Language Models
Weijie Chen
Yongzhu Chang
Rongsheng Zhang
Jiashu Pu
Guandan Chen
Le Zhang
Yadong Xi
Yijiang Chen
Chang Su
78
11
0
27 Apr 2022
On the Limitations of Dataset Balancing: The Lost Battle Against
  Spurious Correlations
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations
Roy Schwartz
Gabriel Stanovsky
102
26
0
27 Apr 2022
ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation
ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation
Yufei Xu
Jing Zhang
Qiming Zhang
Dacheng Tao
ViT
131
542
0
26 Apr 2022
Natural Language to Code Translation with Execution
Natural Language to Code Translation with Execution
Freda Shi
Daniel Fried
Marjan Ghazvininejad
Luke Zettlemoyer
Sida I. Wang
127
129
0
25 Apr 2022
Decorate the Examples: A Simple Method of Prompt Design for Biomedical
  Relation Extraction
Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction
Hui-Syuan Yeh
Thomas Lavergne
Pierre Zweigenbaum
51
12
0
21 Apr 2022
Unsupervised Ranking and Aggregation of Label Descriptions for Zero-Shot
  Classifiers
Unsupervised Ranking and Aggregation of Label Descriptions for Zero-Shot Classifiers
Angelo Basile
Marc Franco-Salvador
Paolo Rosso
VLM
57
2
0
20 Apr 2022
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented
  Visual Models
ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li
Haotian Liu
Liunian Harold Li
Pengchuan Zhang
J. Aneja
...
Ping Jin
Houdong Hu
Zicheng Liu
Yong Jae Lee
Jianfeng Gao
101
152
0
19 Apr 2022
Empirical Evaluation and Theoretical Analysis for Representation
  Learning: A Survey
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey
Kento Nozawa
Issei Sato
AI4TS
139
5
0
18 Apr 2022
OMG: Observe Multiple Granularities for Natural Language-Based Vehicle
  Retrieval
OMG: Observe Multiple Granularities for Natural Language-Based Vehicle Retrieval
Yunhao Du
Binyu Zhang
Xiang Ruan
Fei Su
Zhicheng Zhao
Hong Chen
56
5
0
18 Apr 2022
Multi-Modal Few-Shot Object Detection with Meta-Learning-Based
  Cross-Modal Prompting
Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting
G. Han
Long Chen
Jiawei Ma
Shiyuan Huang
Ramalingam Chellappa
Shih-Fu Chang
VLM
112
21
0
16 Apr 2022
A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based
  Sentiment Analysis
A Contrastive Cross-Channel Data Augmentation Framework for Aspect-based Sentiment Analysis
Bing Wang
Liang Ding
Qihuang Zhong
Ximing Li
Dacheng Tao
83
33
0
16 Apr 2022
UniGDD: A Unified Generative Framework for Goal-Oriented
  Document-Grounded Dialogue
UniGDD: A Unified Generative Framework for Goal-Oriented Document-Grounded Dialogue
Chang Gao
Wenxuan Zhang
W. Lam
143
13
0
16 Apr 2022
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning
In-BoXBART: Get Instructions into Biomedical Multi-Task Learning
Mihir Parmar
Swaroop Mishra
Mirali Purohit
Man Luo
M. H. Murad
Chitta Baral
97
23
0
15 Apr 2022
mGPT: Few-Shot Learners Go Multilingual
mGPT: Few-Shot Learners Go Multilingual
Oleh Shliazhko
Alena Fenogenova
Maria Tikhonova
Vladislav Mikhailov
Anastasia Kozlova
Tatiana Shavrina
131
155
0
15 Apr 2022
Image Captioning In the Transformer Age
Image Captioning In the Transformer Age
Yangliu Xu
Li Li
Haiyang Xu
Songfang Huang
Fei Huang
Jianfei Cai
ViT
59
6
0
15 Apr 2022
Rows from Many Sources: Enriching row completions from Wikidata with a
  pre-trained Language Model
Rows from Many Sources: Enriching row completions from Wikidata with a pre-trained Language Model
Carina Negreanu
Alperen Karaoglu
Jack Williams
Shuang Chen
Daniel Fabian
Andrew D. Gordon
Chin-Yew Lin
RALMAIMatLMTD
38
2
0
14 Apr 2022
A Unified Multi-task Learning Framework for Multi-goal Conversational
  Recommender Systems
A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systems
Yang Deng
Wenxuan Zhang
Weiwen Xu
Wenqiang Lei
Tat-Seng Chua
W. Lam
LRM
104
66
0
14 Apr 2022
Impossible Triangle: What's Next for Pre-trained Language Models?
Impossible Triangle: What's Next for Pre-trained Language Models?
Chenguang Zhu
Michael Zeng
78
1
0
13 Apr 2022
A Review on Language Models as Knowledge Bases
A Review on Language Models as Knowledge Bases
Badr AlKhamissi
Millicent Li
Asli Celikyilmaz
Mona T. Diab
Marjan Ghazvininejad
KELM
103
187
0
12 Apr 2022
Exploring the Universal Vulnerability of Prompt-based Learning Paradigm
Exploring the Universal Vulnerability of Prompt-based Learning Paradigm
Lei Xu
Yangyi Chen
Ganqu Cui
Hongcheng Gao
Zhiyuan Liu
SILMVPVLM
117
76
0
11 Apr 2022
Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0
Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0
F. Toni
Christopher Akiki
Javier de la Rosa
Clémentine Fourrier
Enrique Manjavacas
Stefan Schweter
Daniel Alexander van Strien
73
11
0
11 Apr 2022
Generative Biomedical Entity Linking via Knowledge Base-Guided
  Pre-training and Synonyms-Aware Fine-tuning
Generative Biomedical Entity Linking via Knowledge Base-Guided Pre-training and Synonyms-Aware Fine-tuning
Hongyi Yuan
Zheng Yuan
Sheng Yu
MedIm
82
46
0
11 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual
  Learning
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning
Zifeng Wang
Zizhao Zhang
Sayna Ebrahimi
Ruoxi Sun
Han Zhang
...
Xiaoqi Ren
Guolong Su
Vincent Perot
Jennifer Dy
Tomas Pfister
CLLVLMVPVLM
134
504
0
10 Apr 2022
Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained
  Language Models For Classification Tasks
Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained Language Models For Classification Tasks
Haoran Yang
Piji Li
Wai Lam
77
4
0
10 Apr 2022
Contrastive Demonstration Tuning for Pre-trained Language Models
Contrastive Demonstration Tuning for Pre-trained Language Models
Xiaozhuan Liang
Ningyu Zhang
Shuyang Cheng
Zhenru Zhang
Chuanqi Tan
Huajun Chen
VLMALMVPVLM
111
9
0
09 Apr 2022
Match-Prompt: Improving Multi-task Generalization Ability for Neural
  Text Matching via Prompt Learning
Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learning
Shicheng Xu
Liang Pang
Huawei Shen
Xueqi Cheng
VLM
85
17
0
06 Apr 2022
Can language models learn from explanations in context?
Can language models learn from explanations in context?
Andrew Kyle Lampinen
Ishita Dasgupta
Stephanie C. Y. Chan
Kory Matthewson
Michael Henry Tessler
Antonia Creswell
James L. McClelland
Jane X. Wang
Felix Hill
LRMReLM
188
302
0
05 Apr 2022
Improved and Efficient Conversational Slot Labeling through Question
  Answering
Improved and Efficient Conversational Slot Labeling through Question Answering
Gabor Fuisz
Ivan Vulić
Samuel Gibbons
I. Casanueva
Paweł Budzianowski
91
11
0
05 Apr 2022
Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers
  and Ordinal Regression
Nowruz at SemEval-2022 Task 7: Tackling Cloze Tests with Transformers and Ordinal Regression
Mohammadmahdi Nouriborji
Omid Rohanian
David Clifton
58
1
0
01 Apr 2022
Making Pre-trained Language Models End-to-end Few-shot Learners with
  Contrastive Prompt Tuning
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning
Ziyun Xu
Chengyu Wang
Minghui Qiu
Fuli Luo
Runxin Xu
Songfang Huang
Jun Huang
VLM
103
34
0
01 Apr 2022
Exploring Visual Prompts for Adapting Large-Scale Models
Exploring Visual Prompts for Adapting Large-Scale Models
Hyojin Bahng
Ali Jahanian
S. Sankaranarayanan
Phillip Isola
VLMVPVLMLRM
91
273
0
31 Mar 2022
SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken
  Language Model for Speech Processing Tasks
SpeechPrompt: An Exploration of Prompt Tuning on Generative Spoken Language Model for Speech Processing Tasks
Kai-Wei Chang
Wei-Cheng Tseng
Shang-Wen Li
Hung-yi Lee
101
23
0
31 Mar 2022
Towards Few-shot Entity Recognition in Document Images: A Label-aware
  Sequence-to-Sequence Framework
Towards Few-shot Entity Recognition in Document Images: A Label-aware Sequence-to-Sequence Framework
Zilong Wang
Jingbo Shang
60
13
0
30 Mar 2022
Position-based Prompting for Health Outcome Generation
Position-based Prompting for Health Outcome Generation
Micheal Abaho
Danushka Bollegala
P. Williamson
S. Dodd
61
10
0
30 Mar 2022
Enhanced compound-protein binding affinity prediction by representing
  protein multimodal information via a coevolutionary strategy
Enhanced compound-protein binding affinity prediction by representing protein multimodal information via a coevolutionary strategy
Binjie Guo
Hanyu Zheng
Haohan Jiang
Xiaodan Li
Nai-Yang Guan
Yanming Zuo
Yicheng Zhang
Hengfu Yang
Xuhua Wang
54
4
0
30 Mar 2022
Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting
Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting
Gabriel Orlanski
LRM
67
2
0
29 Mar 2022
Bridge-Prompt: Towards Ordinal Action Understanding in Instructional
  Videos
Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos
Muheng Li
Lei Chen
Yueqi Duan
Zhilan Hu
Jianjiang Feng
Jie Zhou
Jiwen Lu
79
76
0
26 Mar 2022
Recommendation as Language Processing (RLP): A Unified Pretrain,
  Personalized Prompt & Predict Paradigm (P5)
Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)
Shijie Geng
Shuchang Liu
Zuohui Fu
Yingqiang Ge
Yongfeng Zhang
VLMAI4TS
180
494
0
24 Mar 2022
Can Unsupervised Knowledge Transfer from Social Discussions Help
  Argument Mining?
Can Unsupervised Knowledge Transfer from Social Discussions Help Argument Mining?
Subhabrata Dutta
Jeevesh Juneja
Dipankar Das
Tanmoy Chakraborty
73
17
0
24 Mar 2022
A Survey on Cross-Lingual Summarization
A Survey on Cross-Lingual Summarization
Jiaan Wang
Fandong Meng
Duo Zheng
Yunlong Liang
Zhixu Li
Jianfeng Qu
Jie Zhou
AILaw
89
62
0
23 Mar 2022
Prompt-based System for Personality and Interpersonal Reactivity
  Prediction
Prompt-based System for Personality and Interpersonal Reactivity Prediction
Bin Li
Yixuan Weng
65
7
0
23 Mar 2022
Can Prompt Probe Pretrained Language Models? Understanding the Invisible
  Risks from a Causal View
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View
Boxi Cao
Hongyu Lin
Xianpei Han
Fangchao Liu
Le Sun
ELMAAML
57
43
0
23 Mar 2022
Visual Prompt Tuning
Visual Prompt Tuning
Menglin Jia
Luming Tang
Bor-Chun Chen
Claire Cardie
Serge Belongie
Bharath Hariharan
Ser-Nam Lim
VLMVPVLM
235
1,655
0
23 Mar 2022
A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models
  with Adversarial Learning
A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning
Hugo Elias Berg
Elizaveta Semenova
Yash Bhalgat
Wonsuk Yang
Hannah Rose Kirk
Aleksandar Shtedritski
Max Bain
VLM
102
101
0
22 Mar 2022
How well does CLIP understand texture?
How well does CLIP understand texture?
Chenyun Wu
Subhransu Maji
69
7
0
22 Mar 2022
A Prompting-based Approach for Adversarial Example Generation and
  Robustness Enhancement
A Prompting-based Approach for Adversarial Example Generation and Robustness Enhancement
Yuting Yang
Pei Huang
Juan Cao
Jintao Li
Yun Lin
Jin Song Dong
Feifei Ma
Jian Zhang
AAMLSILM
98
13
0
21 Mar 2022
On Robust Prefix-Tuning for Text Classification
On Robust Prefix-Tuning for Text Classification
Zonghan Yang
Yang Liu
VLM
68
21
0
19 Mar 2022
Previous
123...3334353637
Next