ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.07139
  4. Cited By
Pre-Trained Models: Past, Present and Future

Pre-Trained Models: Past, Present and Future

14 June 2021
Xu Han
Zhengyan Zhang
Ning Ding
Yuxian Gu
Xiao Liu
Yuqi Huo
J. Qiu
Yuan Yao
Ao Zhang
Liang Zhang
Wentao Han
Minlie Huang
Qin Jin
Yanyan Lan
Yang Liu
Zhiyuan Liu
Zhiwu Lu
Xipeng Qiu
Ruihua Song
Jie Tang
Ji-Rong Wen
Jinhui Yuan
Wayne Xin Zhao
Jun Zhu
    AIFin
    MQ
    AI4MH
ArXivPDFHTML

Papers citing "Pre-Trained Models: Past, Present and Future"

50 / 293 papers shown
Title
Generative Pre-trained Transformer: A Comprehensive Review on Enabling
  Technologies, Potential Applications, Emerging Challenges, and Future
  Directions
Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions
Gokul Yenduri
M. Ramalingam
G. C. Selvi
Y. Supriya
Gautam Srivastava
...
Rutvij H. Jhaveri
B. Prabadevi
Weizheng Wang
Athanasios V. Vasilakos
Thippa Reddy Gadekallu
AI4CE
LM&MA
22
167
0
11 May 2023
Recommendation as Instruction Following: A Large Language Model
  Empowered Recommendation Approach
Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach
Junjie Zhang
Ruobing Xie
Yupeng Hou
Wayne Xin Zhao
Leyu Lin
Ji-Rong Wen
37
201
0
11 May 2023
When ChatGPT for Computer Vision Will Come? From 2D to 3D
When ChatGPT for Computer Vision Will Come? From 2D to 3D
Chenghao Li
Chaoning Zhang
37
2
0
10 May 2023
Low-Resource Multi-Granularity Academic Function Recognition Based on
  Multiple Prompt Knowledge
Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge
Jiawei Liu
Ziteng Xiong
Yi-ping Jiang
Yongqiang Ma
Wei Lu
Yong Huang
Qikai Cheng
25
1
0
05 May 2023
AdapterGNN: Parameter-Efficient Fine-Tuning Improves Generalization in
  GNNs
AdapterGNN: Parameter-Efficient Fine-Tuning Improves Generalization in GNNs
Shengrui Li
Xueting Han
Jing Bai
AI4CE
18
10
0
19 Apr 2023
Tool Learning with Foundation Models
Tool Learning with Foundation Models
Yujia Qin
Shengding Hu
Yankai Lin
Weize Chen
Ning Ding
...
Cheng Yang
Tongshuang Wu
Heng Ji
Zhiyuan Liu
Maosong Sun
42
200
0
17 Apr 2023
On Efficient Training of Large-Scale Deep Learning Models: A Literature
  Review
On Efficient Training of Large-Scale Deep Learning Models: A Literature Review
Li Shen
Yan Sun
Zhiyuan Yu
Liang Ding
Xinmei Tian
Dacheng Tao
VLM
30
41
0
07 Apr 2023
A review of ensemble learning and data augmentation models for class
  imbalanced problems: combination, implementation and evaluation
A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluation
A. Khan
Omkar Chaudhari
Rohitash Chandra
36
166
0
06 Apr 2023
Analysis of Failures and Risks in Deep Learning Model Converters: A Case
  Study in the ONNX Ecosystem
Analysis of Failures and Risks in Deep Learning Model Converters: A Case Study in the ONNX Ecosystem
Purvish Jajal
Wenxin Jiang
Arav Tewari
Erik Kocinare
Joseph Woo
Anusha Sarraf
Yung-Hsiang Lu
George K. Thiruvathukal
James C. Davis
35
0
0
30 Mar 2023
AI-Generated Content (AIGC): A Survey
AI-Generated Content (AIGC): A Survey
Jiayang Wu
Wensheng Gan
Zefeng Chen
Shicheng Wan
Hong Lin
3DV
31
123
0
26 Mar 2023
Rethinking the backbone architecture for tiny object detection
Rethinking the backbone architecture for tiny object detection
Jinlai Ning
Haoyan Guan
Michael W. Spratling
ObjD
36
8
0
20 Mar 2023
LLMSecEval: A Dataset of Natural Language Prompts for Security
  Evaluations
LLMSecEval: A Dataset of Natural Language Prompts for Security Evaluations
Catherine Tony
Markus Mutas
Nicolás E. Díaz Ferreyra
Riccardo Scandariato
ELM
15
44
0
16 Mar 2023
Revisiting Class-Incremental Learning with Pre-Trained Models:
  Generalizability and Adaptivity are All You Need
Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need
Da-Wei Zhou
Han-Jia Ye
De-Chuan Zhan
Ziwei Liu
CLL
33
100
0
13 Mar 2023
An Overview on Language Models: Recent Developments and Outlook
An Overview on Language Models: Recent Developments and Outlook
Chengwei Wei
Yun Cheng Wang
Bin Wang
C.-C. Jay Kuo
30
42
0
10 Mar 2023
An Empirical Study of Pre-Trained Model Reuse in the Hugging Face Deep
  Learning Model Registry
An Empirical Study of Pre-Trained Model Reuse in the Hugging Face Deep Learning Model Registry
Wenxin Jiang
Nicholas Synovic
Matt Hyatt
Taylor R. Schorlemmer
R. Sethi
Yung-Hsiang Lu
George K. Thiruvathukal
James C. Davis
33
64
0
05 Mar 2023
Discrepancies among Pre-trained Deep Neural Networks: A New Threat to
  Model Zoo Reliability
Discrepancies among Pre-trained Deep Neural Networks: A New Threat to Model Zoo Reliability
Diego Montes
Pongpatapee Peerapatanapokin
Jeff Schultz
Chengjun Guo
Wenxin Jiang
James C. Davis
29
14
0
05 Mar 2023
Understanding Natural Language Understanding Systems. A Critical
  Analysis
Understanding Natural Language Understanding Systems. A Critical Analysis
Alessandro Lenci
ELM
34
12
0
01 Mar 2023
Novel Machine Learning Approach for Predicting Poverty using Temperature
  and Remote Sensing Data in Ethiopia
Novel Machine Learning Approach for Predicting Poverty using Temperature and Remote Sensing Data in Ethiopia
O. Shah
K. Tallam
14
3
0
28 Feb 2023
DeepSeq: Deep Sequential Circuit Learning
DeepSeq: Deep Sequential Circuit Learning
Sadaf Khan
Zhengyuan Shi
Min Li
Qiang Xu
GNN
31
8
0
27 Feb 2023
On the contribution of pre-trained models to accuracy and utility in
  modeling distributed energy resources
On the contribution of pre-trained models to accuracy and utility in modeling distributed energy resources
H. Kazmi
Pierre Pinson
16
0
0
22 Feb 2023
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey
Tianlin Li
Guangyao Chen
Guangwu Qian
Pengcheng Gao
Xiaoyong Wei
Yaowei Wang
Yonghong Tian
Wen Gao
AI4CE
VLM
42
204
0
20 Feb 2023
Auditing large language models: a three-layered approach
Auditing large language models: a three-layered approach
Jakob Mokander
Jonas Schuett
Hannah Rose Kirk
Luciano Floridi
AILaw
MLAU
48
196
0
16 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and
  Application
A Comprehensive Survey of Continual Learning: Theory, Method and Application
Liyuan Wang
Xingxing Zhang
Hang Su
Jun Zhu
KELM
CLL
46
606
0
31 Jan 2023
On Robustness of Prompt-based Semantic Parsing with Large Pre-trained
  Language Model: An Empirical Study on Codex
On Robustness of Prompt-based Semantic Parsing with Large Pre-trained Language Model: An Empirical Study on Codex
Terry Yue Zhuo
Zhuang Li
Yujin Huang
Fatemeh Shiri
Weiqing Wang
Gholamreza Haffari
Yuan-Fang Li
AAML
34
54
0
30 Jan 2023
BDMMT: Backdoor Sample Detection for Language Models through Model
  Mutation Testing
BDMMT: Backdoor Sample Detection for Language Models through Model Mutation Testing
Jiali Wei
Ming Fan
Wenjing Jiao
Wuxia Jin
Ting Liu
AAML
29
11
0
25 Jan 2023
Editing Language Model-based Knowledge Graph Embeddings
Editing Language Model-based Knowledge Graph Embeddings
Shuyang Cheng
Ningyu Zhang
Bo Tian
Zhiyu Li
Wei Guo
Huajun Chen
KELM
51
23
0
25 Jan 2023
TrojanPuzzle: Covertly Poisoning Code-Suggestion Models
TrojanPuzzle: Covertly Poisoning Code-Suggestion Models
H. Aghakhani
Wei Dai
Andre Manoel
Xavier Fernandes
Anant Kharkar
Christopher Kruegel
Giovanni Vigna
David E. Evans
B. Zorn
Robert Sim
SILM
29
33
0
06 Jan 2023
Reasoning with Language Model Prompting: A Survey
Reasoning with Language Model Prompting: A Survey
Shuofei Qiao
Yixin Ou
Ningyu Zhang
Xiang Chen
Yunzhi Yao
Shumin Deng
Chuanqi Tan
Fei Huang
Huajun Chen
ReLM
ELM
LRM
71
311
0
19 Dec 2022
POIBERT: A Transformer-based Model for the Tour Recommendation Problem
POIBERT: A Transformer-based Model for the Tour Recommendation Problem
N. Ho
Kwan Hui Lim
20
14
0
16 Dec 2022
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study
  in Summarization
Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization
Yiwei Qin
Graham Neubig
Pengfei Liu
23
3
0
12 Dec 2022
Implementing Deep Learning-Based Approaches for Article Summarization in
  Indian Languages
Implementing Deep Learning-Based Approaches for Article Summarization in Indian Languages
Rahul Tangsali
Aabha Pingle
Aditya Vyawahare
Isha Joshi
Raviraj Joshi
43
7
0
12 Dec 2022
Towards human-compatible autonomous car: A study of non-verbal Turing
  test in automated driving with affective transition modelling
Towards human-compatible autonomous car: A study of non-verbal Turing test in automated driving with affective transition modelling
Zhaoning Li
Qiaoli Jiang
Zhengming Wu
Anqi Liu
Haiyan Wu
Miner Huang
Kai Huang
Y. Ku
14
2
0
06 Dec 2022
Protein Language Models and Structure Prediction: Connection and
  Progression
Protein Language Models and Structure Prediction: Connection and Progression
Bozhen Hu
Jun Xia
Jiangbin Zheng
Cheng Tan
Yufei Huang
Yongjie Xu
Stan Z. Li
27
40
0
30 Nov 2022
A Survey of Text Representation Methods and Their Genealogy
A Survey of Text Representation Methods and Their Genealogy
Philipp Siebers
Christian Janiesch
Patrick Zschech
AI4TS
22
9
0
26 Nov 2022
The European AI Liability Directives -- Critique of a Half-Hearted
  Approach and Lessons for the Future
The European AI Liability Directives -- Critique of a Half-Hearted Approach and Lessons for the Future
P. Hacker
AILaw
26
60
0
25 Nov 2022
On the Compositional Generalization Gap of In-Context Learning
On the Compositional Generalization Gap of In-Context Learning
Arian Hosseini
Ankit Vani
Dzmitry Bahdanau
Alessandro Sordoni
Rameswar Panda
24
24
0
15 Nov 2022
FedTune: A Deep Dive into Efficient Federated Fine-Tuning with
  Pre-trained Transformers
FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers
Jinyu Chen
Wenchao Xu
Song Guo
Junxiao Wang
Jie Zhang
Yining Qi
FedML
28
32
0
15 Nov 2022
Finding Skill Neurons in Pre-trained Transformer-based Language Models
Finding Skill Neurons in Pre-trained Transformer-based Language Models
Xiaozhi Wang
Kaiyue Wen
Zhengyan Zhang
Lei Hou
Zhiyuan Liu
Juanzi Li
MILM
MoE
27
50
0
14 Nov 2022
Improving ECG-based COVID-19 diagnosis and mortality predictions using
  pre-pandemic medical records at population-scale
Improving ECG-based COVID-19 diagnosis and mortality predictions using pre-pandemic medical records at population-scale
Weijie Sun
Sunil Vasu Kalmady
N. Sepehrvand
L. Chu
Zihan Wang
Amir Salimi
Abram Hindle
Russ Greiner
Padma Kaul
10
5
0
14 Nov 2022
FPT: Improving Prompt Tuning Efficiency via Progressive Training
FPT: Improving Prompt Tuning Efficiency via Progressive Training
Yufei Huang
Yujia Qin
Huadong Wang
Yichun Yin
Maosong Sun
Zhiyuan Liu
Qun Liu
VLM
LRM
35
6
0
13 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models
A Survey of Knowledge Enhanced Pre-trained Language Models
Linmei Hu
Zeyi Liu
Ziwang Zhao
Lei Hou
Liqiang Nie
Juanzi Li
KELM
VLM
24
123
0
11 Nov 2022
Few-shot Classification with Hypersphere Modeling of Prototypes
Few-shot Classification with Hypersphere Modeling of Prototypes
Ning Ding
Yulin Chen
Ganqu Cui
Xiaobin Wang
Haitao Zheng
Zhiyuan Liu
Pengjun Xie
31
8
0
10 Nov 2022
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models
Hao Peng
Xiaozhi Wang
Shengding Hu
Hailong Jin
Lei Hou
Juanzi Li
Zhiyuan Liu
Qun Liu
18
22
0
08 Nov 2022
A Comparison of SVM against Pre-trained Language Models (PLMs) for Text
  Classification Tasks
A Comparison of SVM against Pre-trained Language Models (PLMs) for Text Classification Tasks
Yasmen Wahba
N. Madhavji
John Steinbacher
VLM
14
20
0
04 Nov 2022
Exploring Mode Connectivity for Pre-trained Language Models
Exploring Mode Connectivity for Pre-trained Language Models
Yujia Qin
Cheng Qian
Jing Yi
Weize Chen
Yankai Lin
Xu Han
Zhiyuan Liu
Maosong Sun
Jie Zhou
29
20
0
25 Oct 2022
Different Tunes Played with Equal Skill: Exploring a Unified
  Optimization Subspace for Delta Tuning
Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Delta Tuning
Jing Yi
Weize Chen
Yujia Qin
Yankai Lin
Ning Ding
Xu Han
Zhiyuan Liu
Maosong Sun
Jie Zhou
20
2
0
24 Oct 2022
Why Should Adversarial Perturbations be Imperceptible? Rethink the
  Research Paradigm in Adversarial NLP
Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLP
Yangyi Chen
Hongcheng Gao
Ganqu Cui
Fanchao Qi
Longtao Huang
Zhiyuan Liu
Maosong Sun
SILM
25
45
0
19 Oct 2022
Language Model Decomposition: Quantifying the Dependency and Correlation
  of Language Models
Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models
Hao Zhang
17
0
0
19 Oct 2022
Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task
  Generalization
Learning Instructions with Unlabeled Data for Zero-Shot Cross-Task Generalization
Yuxian Gu
Pei Ke
Xiaoyan Zhu
Minlie Huang
ALM
39
17
0
17 Oct 2022
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities
Brian Bartoldson
B. Kailkhura
Davis W. Blalock
31
47
0
13 Oct 2022
Previous
123456
Next