ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.07139
  4. Cited By
Pre-Trained Models: Past, Present and Future

Pre-Trained Models: Past, Present and Future

14 June 2021
Xu Han
Zhengyan Zhang
Ning Ding
Yuxian Gu
Xiao Liu
Yuqi Huo
J. Qiu
Yuan Yao
Ao Zhang
Liang Zhang
Wentao Han
Minlie Huang
Qin Jin
Yanyan Lan
Yang Liu
Zhiyuan Liu
Zhiwu Lu
Xipeng Qiu
Ruihua Song
Jie Tang
Ji-Rong Wen
Jinhui Yuan
Wayne Xin Zhao
Jun Zhu
    AIFin
    MQ
    AI4MH
ArXivPDFHTML

Papers citing "Pre-Trained Models: Past, Present and Future"

50 / 293 papers shown
Title
Pre-Evolved Model for Complex Multi-objective Optimization Problems
Pre-Evolved Model for Complex Multi-objective Optimization Problems
Haokai Hong
Min Jiang
27
3
0
11 Dec 2023
Manipulating the Label Space for In-Context Classification
Manipulating the Label Space for In-Context Classification
Haokun Chen
Xu Yang
Yuhang Huang
Zihan Wu
Jing Wang
Xin Geng
VLM
25
2
0
01 Dec 2023
SoUnD Framework: Analyzing (So)cial Representation in (Un)structured
  (D)ata
SoUnD Framework: Analyzing (So)cial Representation in (Un)structured (D)ata
Mark Díaz
Sunipa Dev
Emily Reif
Remi Denton
Vinodkumar Prabhakaran
33
3
0
28 Nov 2023
xTrimoGene: An Efficient and Scalable Representation Learner for
  Single-Cell RNA-Seq Data
xTrimoGene: An Efficient and Scalable Representation Learner for Single-Cell RNA-Seq Data
Jing Gong
Minsheng Hao
Xingyi Cheng
Xin Zeng
Chiming Liu
Jianzhu Ma
Xuegong Zhang
Taifeng Wang
Leo T. Song
31
18
0
26 Nov 2023
Sparse Low-rank Adaptation of Pre-trained Language Models
Sparse Low-rank Adaptation of Pre-trained Language Models
Ning Ding
Xingtai Lv
Qiaosen Wang
Yulin Chen
Bowen Zhou
Zhiyuan Liu
Maosong Sun
27
55
0
20 Nov 2023
An Extensive Study on Adversarial Attack against Pre-trained Models of
  Code
An Extensive Study on Adversarial Attack against Pre-trained Models of Code
Xiaohu Du
Ming Wen
Zichao Wei
Shangwen Wang
Hai Jin
AAML
38
15
0
13 Nov 2023
TCM-GPT: Efficient Pre-training of Large Language Models for Domain
  Adaptation in Traditional Chinese Medicine
TCM-GPT: Efficient Pre-training of Large Language Models for Domain Adaptation in Traditional Chinese Medicine
Guoxing Yang
Jianyu Shi
Zan Wang
Xiaohong Liu
Guangyu Wang
21
16
0
03 Nov 2023
BTRec: BERT-Based Trajectory Recommendation for Personalized Tours
BTRec: BERT-Based Trajectory Recommendation for Personalized Tours
N. Ho
Roy Ka-Wei Lee
Kwan Hui Lim
15
3
0
30 Oct 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained
  Language Models
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models
Paul Youssef
Osman Alperen Koracs
Meijie Li
Jorg Schlotterer
Christin Seifert
KELM
24
16
0
25 Oct 2023
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression
  Modules
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules
Chaojun Xiao
Yuqi Luo
Wenbin Zhang
Pengle Zhang
Xu Han
...
Zhengyan Zhang
Ruobing Xie
Zhiyuan Liu
Maosong Sun
Jie Zhou
30
0
0
24 Oct 2023
Instruction Tuning with Human Curriculum
Instruction Tuning with Human Curriculum
Bruce W. Lee
Hyunsoo Cho
Kang Min Yoo
45
3
0
14 Oct 2023
A Survey of GPT-3 Family Large Language Models Including ChatGPT and
  GPT-4
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Katikapalli Subramanyam Kalyan
LM&MA
AI4CE
LRM
AILaw
ELM
43
224
0
04 Oct 2023
Empowering Private Tutoring by Chaining Large Language Models
Empowering Private Tutoring by Chaining Large Language Models
Yulin Chen
Ning Ding
Hai-Tao Zheng
Zhiyuan Liu
Maosong Sun
Bowen Zhou
AI4Ed
KELM
ELM
16
11
0
15 Sep 2023
Cognitive Mirage: A Review of Hallucinations in Large Language Models
Cognitive Mirage: A Review of Hallucinations in Large Language Models
Hongbin Ye
Tong Liu
Aijia Zhang
Wei Hua
Weiqiang Jia
HILM
48
77
0
13 Sep 2023
PILOT: A Pre-Trained Model-Based Continual Learning Toolbox
PILOT: A Pre-Trained Model-Based Continual Learning Toolbox
Hai-Long Sun
Da-Wei Zhou
Han-Jia Ye
De-Chuan Zhan
CLL
110
27
0
13 Sep 2023
Few-Shot Learning of Force-Based Motions From Demonstration Through
  Pre-training of Haptic Representation
Few-Shot Learning of Force-Based Motions From Demonstration Through Pre-training of Haptic Representation
Marina Y. Aoyama
João Moura
Namiko Saito
S. Vijayakumar
24
5
0
08 Sep 2023
Evaluating ChatGPT as a Recommender System: A Rigorous Approach
Evaluating ChatGPT as a Recommender System: A Rigorous Approach
Dario Di Palma
Giovanni Maria Biancofiore
Vito Walter Anelli
Fedelucio Narducci
Tommaso Di Noia
E. Sciascio
ALM
46
27
0
07 Sep 2023
Data-Juicer: A One-Stop Data Processing System for Large Language Models
Data-Juicer: A One-Stop Data Processing System for Large Language Models
Daoyuan Chen
Yilun Huang
Zhijian Ma
Hesen Chen
Xuchen Pan
...
Zhaoyang Liu
Jinyang Gao
Yaliang Li
Bolin Ding
Jingren Zhou
SyDa
VLM
31
30
0
05 Sep 2023
A Comparative Analysis of Pretrained Language Models for Text-to-Speech
A Comparative Analysis of Pretrained Language Models for Text-to-Speech
M. G. Moya
Panagiota Karanasou
S. Karlapati
Bastian Schnell
Nicole Peinelt
Alexis Moinet
Thomas Drugman
39
3
0
04 Sep 2023
Towards Instance-adaptive Inference for Federated Learning
Towards Instance-adaptive Inference for Federated Learning
Chunhui Feng
Kai Yu
Nian Liu
Xinxing Xu
Salman Khan
W. Zuo
FedML
39
11
0
11 Aug 2023
Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language
  Model through Expert Feedback and Real-world Multi-turn Dialogue
Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialogue
Songhua Yang
Hanjia Zhao
Senbin Zhu
Guangyu Zhou
Hongfei Xu
Yuxiang Jia
Hongying Zan
AI4MH
LM&MA
13
110
0
07 Aug 2023
Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning
  Attacks
Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attacks
Domenico Cotroneo
Cristina Improta
Pietro Liguori
R. Natella
SILM
33
22
0
04 Aug 2023
Making Pre-trained Language Models both Task-solvers and
  Self-calibrators
Making Pre-trained Language Models both Task-solvers and Self-calibrators
Yangyi Chen
Xingyao Wang
Heng Ji
20
0
0
21 Jul 2023
Pre-train, Adapt and Detect: Multi-Task Adapter Tuning for Camouflaged
  Object Detection
Pre-train, Adapt and Detect: Multi-Task Adapter Tuning for Camouflaged Object Detection
Yinghui Xing
Dexuan Kong
Shizhou Zhang
Geng Chen
Lingyan Ran
Peng Wang
Yanning Zhang
45
4
0
20 Jul 2023
Exploring the Landscape of Natural Language Processing Research
Exploring the Landscape of Natural Language Processing Research
Tim Schopf
Karim Arabi
Florian Matthes
21
13
0
20 Jul 2023
Can Instruction Fine-Tuned Language Models Identify Social Bias through
  Prompting?
Can Instruction Fine-Tuned Language Models Identify Social Bias through Prompting?
O. Dige
Jacob-Junqi Tian
David B. Emerson
Faiza Khan Khattak
ALM
20
5
0
19 Jul 2023
Won't Get Fooled Again: Answering Questions with False Premises
Won't Get Fooled Again: Answering Questions with False Premises
Shengding Hu
Yi-Xiao Luo
Huadong Wang
Xingyi Cheng
Zhiyuan Liu
Maosong Sun
34
22
0
05 Jul 2023
Towards Open Federated Learning Platforms: Survey and Vision from
  Technical and Legal Perspectives
Towards Open Federated Learning Platforms: Survey and Vision from Technical and Legal Perspectives
Moming Duan
Qinbin Li
Linshan Jiang
Bingsheng He
FedML
34
4
0
05 Jul 2023
Natural Language Generation and Understanding of Big Code for
  AI-Assisted Programming: A Review
Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review
M. Wong
Shangxin Guo
Ching Nam Hang
Siu-Wai Ho
C. Tan
42
78
0
04 Jul 2023
S2SNet: A Pretrained Neural Network for Superconductivity Discovery
S2SNet: A Pretrained Neural Network for Superconductivity Discovery
Ke Liu
Kaifan Yang
Jiahong Zhang
Renjun Xu
14
6
0
28 Jun 2023
Effective Transfer of Pretrained Large Visual Model for Fabric Defect
  Segmentation via Specifc Knowledge Injection
Effective Transfer of Pretrained Large Visual Model for Fabric Defect Segmentation via Specifc Knowledge Injection
Zhewei Chen
W. Wong
Zuofeng Zhong
Jinpiao Liao
Ying Qu
27
3
0
28 Jun 2023
Artificial intelligence is algorithmic mimicry: why artificial "agents"
  are not (and won't be) proper agents
Artificial intelligence is algorithmic mimicry: why artificial "agents" are not (and won't be) proper agents
Johannes Jaeger
AI4CE
19
7
0
27 Jun 2023
Towards Regulatable AI Systems: Technical Gaps and Policy Opportunities
Towards Regulatable AI Systems: Technical Gaps and Policy Opportunities
Xudong Shen
H. Brown
Jiashu Tao
Martin Strobel
Yao Tong
Akshay Narayan
Harold Soh
Finale Doshi-Velez
32
3
0
22 Jun 2023
Interactive Molecular Discovery with Natural Language
Interactive Molecular Discovery with Natural Language
Zheni Zeng
Bangchen Yin
Shipeng Wang
Jia-Rou Liu
Cheng Yang
Haishen Yao
Xingzhi Sun
Maosong Sun
Guotong Xie
Zhiyuan Liu
AI4CE
32
12
0
21 Jun 2023
Gender Bias in Transformer Models: A comprehensive survey
Gender Bias in Transformer Models: A comprehensive survey
Praneeth Nemani
Yericherla Deepak Joel
Pallavi Vijay
Farhana Ferdousi Liza
24
3
0
18 Jun 2023
MiniLLM: Knowledge Distillation of Large Language Models
MiniLLM: Knowledge Distillation of Large Language Models
Yuxian Gu
Li Dong
Furu Wei
Minlie Huang
ALM
39
77
0
14 Jun 2023
COVER: A Heuristic Greedy Adversarial Attack on Prompt-based Learning in
  Language Models
COVER: A Heuristic Greedy Adversarial Attack on Prompt-based Learning in Language Models
Zihao Tan
Qingliang Chen
Wenbin Zhu
Yongjian Huang
AAML
SILM
28
3
0
09 Jun 2023
Privacy Aware Question-Answering System for Online Mental Health Risk
  Assessment
Privacy Aware Question-Answering System for Online Mental Health Risk Assessment
P. Chhikara
Ujjwal Pasupulety
J. Marshall
Dhiraj Chaurasia
Shwetanjali Kumari
AI4MH
8
3
0
09 Jun 2023
Soft-prompt Tuning for Large Language Models to Evaluate Bias
Soft-prompt Tuning for Large Language Models to Evaluate Bias
Jacob-Junqi Tian
David B. Emerson
Sevil Zanjani Miyandoab
D. Pandya
Laleh Seyyed-Kalantari
Faiza Khan Khattak
VLM
29
10
0
07 Jun 2023
SourceP: Detecting Ponzi Schemes on Ethereum with Source Code
SourceP: Detecting Ponzi Schemes on Ethereum with Source Code
Pengcheng Lu
Liang Cai
Keting Yin
AI4TS
17
4
0
02 Jun 2023
Exploring Lottery Prompts for Pre-trained Language Models
Exploring Lottery Prompts for Pre-trained Language Models
Yulin Chen
Ning Ding
Xiaobin Wang
Shengding Hu
Haitao Zheng
Zhiyuan Liu
Pengjun Xie
VLM
LRM
24
7
0
31 May 2023
Learning without Forgetting for Vision-Language Models
Learning without Forgetting for Vision-Language Models
Da-Wei Zhou
Yuanhan Zhang
Jingyi Ning
Jingyi Ning
De-Chuan Zhan
De-Chuan Zhan
Ziwei Liu
VLM
CLL
74
37
0
30 May 2023
The Utility of Large Language Models and Generative AI for Education
  Research
The Utility of Large Language Models and Generative AI for Education Research
Andrew Katz
Umair Shakir
B. Chambers
AI4CE
27
6
0
29 May 2023
Plug-and-Play Document Modules for Pre-trained Models
Plug-and-Play Document Modules for Pre-trained Models
Chaojun Xiao
Zhengyan Zhang
Xu Han
Chi-Min Chan
Yankai Lin
Zhiyuan Liu
Xiangyang Li
Zhonghua Li
Bo Zhao
Maosong Sun
KELM
34
5
0
28 May 2023
Enhancing Translation for Indigenous Languages: Experiments with
  Multilingual Models
Enhancing Translation for Indigenous Languages: Experiments with Multilingual Models
A. Tonja
H. Nigatu
Olga Kolesnikova
Grigori Sidorov
Alexander Gelbukh
Jugal Kalita
35
4
0
27 May 2023
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification
Hierarchical Verbalizer for Few-Shot Hierarchical Text Classification
Kexi Ji
Yixin Lian
Jingsheng Gao
Baoyuan Wang
VLM
27
21
0
26 May 2023
Linguistic Properties of Truthful Response
Linguistic Properties of Truthful Response
Bruce W. Lee
Benedict Florance Arockiaraj
H. Jin
HILM
17
2
0
25 May 2023
Enhancing Chat Language Models by Scaling High-quality Instructional
  Conversations
Enhancing Chat Language Models by Scaling High-quality Instructional Conversations
Ning Ding
Yulin Chen
Bokai Xu
Yujia Qin
Zhi Zheng
Shengding Hu
Zhiyuan Liu
Maosong Sun
Bowen Zhou
ALM
45
491
0
23 May 2023
UOR: Universal Backdoor Attacks on Pre-trained Language Models
UOR: Universal Backdoor Attacks on Pre-trained Language Models
Wei Du
Peixuan Li
Bo-wen Li
Haodong Zhao
Gongshen Liu
AAML
39
7
0
16 May 2023
Pre-Training to Learn in Context
Pre-Training to Learn in Context
Yuxian Gu
Li Dong
Furu Wei
Minlie Huang
CLIP
LRM
ReLM
116
37
0
16 May 2023
Previous
123456
Next