ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.07139
  4. Cited By
Pre-Trained Models: Past, Present and Future

Pre-Trained Models: Past, Present and Future

14 June 2021
Xu Han
Zhengyan Zhang
Ning Ding
Yuxian Gu
Xiao Liu
Yuqi Huo
J. Qiu
Yuan Yao
Ao Zhang
Liang Zhang
Wentao Han
Minlie Huang
Qin Jin
Yanyan Lan
Yang Liu
Zhiyuan Liu
Zhiwu Lu
Xipeng Qiu
Ruihua Song
Jie Tang
Ji-Rong Wen
Jinhui Yuan
Wayne Xin Zhao
Jun Zhu
    AIFin
    MQ
    AI4MH
ArXivPDFHTML

Papers citing "Pre-Trained Models: Past, Present and Future"

50 / 293 papers shown
Title
Pre-trained Adversarial Perturbations
Pre-trained Adversarial Perturbations
Y. Ban
Yinpeng Dong
AAML
62
22
0
07 Oct 2022
OCD: Learning to Overfit with Conditional Diffusion Models
OCD: Learning to Overfit with Conditional Diffusion Models
Shahar Lutati
Lior Wolf
DiffM
22
8
0
02 Oct 2022
COMPILING: A Benchmark Dataset for Chinese Complexity Controllable
  Definition Generation
COMPILING: A Benchmark Dataset for Chinese Complexity Controllable Definition Generation
Jiaxin Yuan
Cunliang Kong
Chenhui Xie
Liner Yang
Erhong Yang
27
4
0
29 Sep 2022
Federated Learning from Pre-Trained Models: A Contrastive Learning
  Approach
Federated Learning from Pre-Trained Models: A Contrastive Learning Approach
Yue Tan
Guodong Long
Jie Ma
Lu Liu
Tianyi Zhou
Jing Jiang
FedML
40
169
0
21 Sep 2022
Pre-Training a Graph Recurrent Network for Language Representation
Pre-Training a Graph Recurrent Network for Language Representation
Yile Wang
Linyi Yang
Zhiyang Teng
M. Zhou
Yue Zhang
GNN
38
1
0
08 Sep 2022
PromptAttack: Prompt-based Attack for Language Models via Gradient
  Search
PromptAttack: Prompt-based Attack for Language Models via Gradient Search
Yundi Shi
Piji Li
Changchun Yin
Zhaoyang Han
Zhe Liu
Zhe Liu
AAML
SILM
32
19
0
05 Sep 2022
Super-model ecosystem: A domain-adaptation perspective
Super-model ecosystem: A domain-adaptation perspective
Fengxiang He
Dacheng Tao
DiffM
35
1
0
30 Aug 2022
Prompt Tuning with Soft Context Sharing for Vision-Language Models
Prompt Tuning with Soft Context Sharing for Vision-Language Models
Kun Ding
Ying Wang
Pengzhang Liu
Qiang Yu
Hao Zhang
Shiming Xiang
Chunhong Pan
VPVLM
VLM
29
14
0
29 Aug 2022
Improving Task Generalization via Unified Schema Prompt
Improving Task Generalization via Unified Schema Prompt
Wanjun Zhong
Yifan Gao
Ning Ding
Zhiyuan Liu
Ming Zhou
Jiahai Wang
Jian Yin
Nan Duan
30
8
0
05 Aug 2022
From Multi-label Learning to Cross-Domain Transfer: A Model-Agnostic
  Approach
From Multi-label Learning to Cross-Domain Transfer: A Model-Agnostic Approach
Jesse Read
OOD
36
3
0
24 Jul 2022
PanGu-Coder: Program Synthesis with Function-Level Language Modeling
PanGu-Coder: Program Synthesis with Function-Level Language Modeling
Fenia Christopoulou
Gerasimos Lampouras
Milan Gritta
Guchun Zhang
Yinpeng Guo
...
Guangtai Liang
Jia Wei
Xin Jiang
Qianxiang Wang
Qun Liu
ELM
SyDa
ALM
45
74
0
22 Jul 2022
Unsupervised pre-training of graph transformers on patient population
  graphs
Unsupervised pre-training of graph transformers on patient population graphs
Chantal Pellegrini
Nassir Navab
Anees Kazi
MedIm
AI4CE
46
11
0
21 Jul 2022
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated
  Neural Text Retrievers
Parameter-Efficient Prompt Tuning Makes Generalized and Calibrated Neural Text Retrievers
Weng Lam Tam
Xiao Liu
Kaixuan Ji
Lilong Xue
Xing Zhang
Yuxiao Dong
Jiahua Liu
Maodi Hu
Jie Tang
VPVLM
24
27
0
14 Jul 2022
BERTIN: Efficient Pre-Training of a Spanish Language Model using
  Perplexity Sampling
BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Sampling
Javier de la Rosa
E. G. Ponferrada
Paulo Villegas
Pablo González de Prado Salas
Manu Romero
María Grandury
35
95
0
14 Jul 2022
Developing an AI-enabled IIoT platform -- Lessons learned from early use
  case validation
Developing an AI-enabled IIoT platform -- Lessons learned from early use case validation
Holger Eichelberger
Gregory Palmer
Svenja Reimer
Tat Trong Vu
H. Do
Sofiane Laridi
Alexander Weber
Claudia Niederée
Thomas Hildebrandt
13
2
0
10 Jul 2022
Argumentative Text Generation in Economic Domain
Argumentative Text Generation in Economic Domain
Irina Fishcheva
D. Osadchiy
Klavdiya Olegovna Bochenina
Evgeny Kotelnikov
17
1
0
18 Jun 2022
A Unified Evaluation of Textual Backdoor Learning: Frameworks and
  Benchmarks
A Unified Evaluation of Textual Backdoor Learning: Frameworks and Benchmarks
Ganqu Cui
Lifan Yuan
Bingxiang He
Yangyi Chen
Zhiyuan Liu
Maosong Sun
AAML
ELM
SILM
26
68
0
17 Jun 2022
Sparse Structure Search for Parameter-Efficient Tuning
Sparse Structure Search for Parameter-Efficient Tuning
Shengding Hu
Zhen Zhang
Ning Ding
Yadao Wang
Yasheng Wang
Zhiyuan Liu
Maosong Sun
37
16
0
15 Jun 2022
Many-Class Text Classification with Matching
Many-Class Text Classification with Matching
Yi-Fan Song
Yuxian Gu
Minlie Huang
VLM
22
1
0
23 May 2022
Prompt Tuning for Discriminative Pre-trained Language Models
Prompt Tuning for Discriminative Pre-trained Language Models
Yuan Yao
Bowen Dong
Ao Zhang
Zhengyan Zhang
Ruobing Xie
Zhiyuan Liu
Leyu Lin
Maosong Sun
Jianyong Wang
VLM
24
34
0
23 May 2022
Towards Unified Prompt Tuning for Few-shot Text Classification
Towards Unified Prompt Tuning for Few-shot Text Classification
Jingang Wang
Chengyu Wang
Fuli Luo
Chuanqi Tan
Minghui Qiu
Fei Yang
Qiuhui Shi
Songfang Huang
Ming Gao
VLM
35
28
0
11 May 2022
Joint learning of object graph and relation graph for visual question
  answering
Joint learning of object graph and relation graph for visual question answering
Hao Li
Xu Li
Belhal Karimi
Jie Chen
Mingming Sun
GNN
43
22
0
09 May 2022
You Are What You Write: Preserving Privacy in the Era of Large Language
  Models
You Are What You Write: Preserving Privacy in the Era of Large Language Models
Richard Plant
V. Giuffrida
Dimitra Gkatzia
PILM
35
19
0
20 Apr 2022
Prototypical Verbalizer for Prompt-based Few-shot Tuning
Prototypical Verbalizer for Prompt-based Few-shot Tuning
Ganqu Cui
Shengding Hu
Ning Ding
Longtao Huang
Zhiyuan Liu
VLM
20
96
0
18 Mar 2022
EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with
  Large-Scale Pre-Training
EVA2.0: Investigating Open-Domain Chinese Dialogue Systems with Large-Scale Pre-Training
Yuxian Gu
Jiaxin Wen
Hao Sun
Yi Song
Pei Ke
...
Zheng Zhang
Jianzhu Yao
Lei Liu
Xiaoyan Zhu
Minlie Huang
21
55
0
17 Mar 2022
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for
  Pre-trained Language Models
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models
Ning Ding
Yujia Qin
Guang Yang
Fu Wei
Zonghan Yang
...
Jianfei Chen
Yang Liu
Jie Tang
Juan Li
Maosong Sun
32
196
0
14 Mar 2022
Towards Visual-Prompt Temporal Answering Grounding in Medical
  Instructional Video
Towards Visual-Prompt Temporal Answering Grounding in Medical Instructional Video
Bin Li
Yixuan Weng
Bin Sun
Shutao Li
35
24
0
13 Mar 2022
ELLE: Efficient Lifelong Pre-training for Emerging Data
ELLE: Efficient Lifelong Pre-training for Emerging Data
Yujia Qin
Jiajie Zhang
Yankai Lin
Zhiyuan Liu
Peng Li
Maosong Sun
Jie Zhou
30
67
0
12 Mar 2022
InstructionNER: A Multi-Task Instruction-Based Generative Framework for
  Few-shot NER
InstructionNER: A Multi-Task Instruction-Based Generative Framework for Few-shot NER
Liwen Wang
Rumei Li
Yang Yan
Yuanmeng Yan
Sirui Wang
Wei Wu
Weiran Xu
24
51
0
08 Mar 2022
Deep Lexical Hypothesis: Identifying personality structure in natural
  language
Deep Lexical Hypothesis: Identifying personality structure in natural language
A. Cutler
D. Condon
25
30
0
04 Mar 2022
SelfKG: Self-Supervised Entity Alignment in Knowledge Graphs
SelfKG: Self-Supervised Entity Alignment in Knowledge Graphs
Xiao Liu
Haoyun Hong
Xinghao Wang
Zeyi Chen
Evgeny Kharlamov
Yuxiao Dong
Jie Tang
SSL
32
72
0
02 Mar 2022
A Systematic Evaluation of Large Language Models of Code
A Systematic Evaluation of Large Language Models of Code
Frank F. Xu
Uri Alon
Graham Neubig
Vincent J. Hellendoorn
ELM
ALM
204
631
0
26 Feb 2022
Prompt-Learning for Short Text Classification
Prompt-Learning for Short Text Classification
Yi Zhu
Xinke Zhou
Jipeng Qiang
Yun Li
Yunhao Yuan
Xindong Wu
VLM
18
34
0
23 Feb 2022
VLP: A Survey on Vision-Language Pre-training
VLP: A Survey on Vision-Language Pre-training
Feilong Chen
Duzhen Zhang
Minglun Han
Xiuyi Chen
Jing Shi
Shuang Xu
Bo Xu
VLM
82
213
0
18 Feb 2022
Learning Contextually Fused Audio-visual Representations for
  Audio-visual Speech Recognition
Learning Contextually Fused Audio-visual Representations for Audio-visual Speech Recognition
Zitian Zhang
Jie Zhang
Jian-Shu Zhang
Ming Wu
Xin Fang
Lirong Dai
SSL
41
10
0
15 Feb 2022
A Survey on Model Compression and Acceleration for Pretrained Language
  Models
A Survey on Model Compression and Acceleration for Pretrained Language Models
Canwen Xu
Julian McAuley
23
58
0
15 Feb 2022
Threats to Pre-trained Language Models: Survey and Taxonomy
Threats to Pre-trained Language Models: Survey and Taxonomy
Shangwei Guo
Chunlong Xie
Jiwei Li
Lingjuan Lyu
Tianwei Zhang
PILM
27
30
0
14 Feb 2022
What Does it Mean for a Language Model to Preserve Privacy?
What Does it Mean for a Language Model to Preserve Privacy?
Hannah Brown
Katherine Lee
Fatemehsadat Mireshghallah
Reza Shokri
Florian Tramèr
PILM
48
232
0
11 Feb 2022
Deadwooding: Robust Global Pruning for Deep Neural Networks
Deadwooding: Robust Global Pruning for Deep Neural Networks
Sawinder Kaur
Ferdinando Fioretto
Asif Salekin
19
4
0
10 Feb 2022
Commonsense Knowledge Reasoning and Generation with Pre-trained Language
  Models: A Survey
Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey
Prajjwal Bhargava
Vincent Ng
ReLM
LRM
44
62
0
28 Jan 2022
Learning to Compose Diversified Prompts for Image Emotion Classification
Learning to Compose Diversified Prompts for Image Emotion Classification
Sinuo Deng
Lifang Wu
Ge Shi
Lehao Xing
Meng Jian
Ye Xiang
CLIP
VLM
24
26
0
26 Jan 2022
OntoProtein: Protein Pretraining With Gene Ontology Embedding
OntoProtein: Protein Pretraining With Gene Ontology Embedding
Ningyu Zhang
Zhen Bi
Xiaozhuan Liang
Shuyang Cheng
Haosen Hong
Shumin Deng
J. Lian
Qiang Zhang
Huajun Chen
99
90
0
23 Jan 2022
Kformer: Knowledge Injection in Transformer Feed-Forward Layers
Kformer: Knowledge Injection in Transformer Feed-Forward Layers
Yunzhi Yao
Shaohan Huang
Li Dong
Furu Wei
Huajun Chen
Ningyu Zhang
KELM
MedIm
31
42
0
15 Jan 2022
Pretrained Language Models for Text Generation: A Survey
Pretrained Language Models for Text Generation: A Survey
Junyi Li
Tianyi Tang
Wayne Xin Zhao
J. Nie
Ji-Rong Wen
AI4CE
36
127
0
14 Jan 2022
Assemble Foundation Models for Automatic Code Summarization
Assemble Foundation Models for Automatic Code Summarization
Jian Gu
P. Salza
H. Gall
36
34
0
13 Jan 2022
An Ensemble of Pre-trained Transformer Models For Imbalanced Multiclass
  Malware Classification
An Ensemble of Pre-trained Transformer Models For Imbalanced Multiclass Malware Classification
Ferhat Demirkiran
Aykut Çayır
U. Ünal
Hasan Dag
38
42
0
25 Dec 2021
Uni-Perceiver: Pre-training Unified Architecture for Generic Perception
  for Zero-shot and Few-shot Tasks
Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks
Xizhou Zhu
Jinguo Zhu
Hao Li
Xiaoshi Wu
Xiaogang Wang
Hongsheng Li
Xiaohua Wang
Jifeng Dai
56
129
0
02 Dec 2021
DeepGate: Learning Neural Representations of Logic Gates
DeepGate: Learning Neural Representations of Logic Gates
Min Li
Sadaf Khan
Zhengyuan Shi
Naixing Wang
Yu Huang
Qiang Xu
GNN
NAI
AI4CE
26
41
0
26 Nov 2021
Green CWS: Extreme Distillation and Efficient Decode Method Towards
  Industrial Application
Green CWS: Extreme Distillation and Efficient Decode Method Towards Industrial Application
Yulan Hu
Yong Liu
9
0
0
17 Nov 2021
On Transferability of Prompt Tuning for Natural Language Processing
On Transferability of Prompt Tuning for Natural Language Processing
Yusheng Su
Xiaozhi Wang
Yujia Qin
Chi-Min Chan
Yankai Lin
...
Peng Li
Juanzi Li
Lei Hou
Maosong Sun
Jie Zhou
AAML
VLM
26
98
0
12 Nov 2021
Previous
123456
Next