ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2106.07139
  4. Cited By
Pre-Trained Models: Past, Present and Future

Pre-Trained Models: Past, Present and Future

14 June 2021
Xu Han
Zhengyan Zhang
Ning Ding
Yuxian Gu
Xiao Liu
Yuqi Huo
J. Qiu
Yuan Yao
Ao Zhang
Liang Zhang
Wentao Han
Minlie Huang
Qin Jin
Yanyan Lan
Yang Liu
Zhiyuan Liu
Zhiwu Lu
Xipeng Qiu
Ruihua Song
Jie Tang
Ji-Rong Wen
Jinhui Yuan
Wayne Xin Zhao
Jun Zhu
    AIFin
    MQ
    AI4MH
ArXivPDFHTML

Papers citing "Pre-Trained Models: Past, Present and Future"

50 / 293 papers shown
Title
Review-Instruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language Models
Review-Instruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language Models
Jian Wu
Cong Wang
TianHuang Su
Jun Yang
Haozhi Lin
...
Steve Yang
BinQing Pan
Zehan Li
Ni Yang
ZhenYu Yang
ALM
14
0
0
16 May 2025
Boosting Statistic Learning with Synthetic Data from Pretrained Large Models
Boosting Statistic Learning with Synthetic Data from Pretrained Large Models
Jialong Jiang
Wenkang Hu
Jian Huang
Yuling Jiao
Xu Liu
DiffM
50
0
0
08 May 2025
Ultra-FineWeb: Efficient Data Filtering and Verification for High-Quality LLM Training Data
Ultra-FineWeb: Efficient Data Filtering and Verification for High-Quality LLM Training Data
Yishuo Wang
Z. Fu
Jie Cai
Peijun Tang
Hongya Lyu
...
Jie Zhou
Guoyang Zeng
Chaojun Xiao
Xu Han
Zhiyuan Liu
49
0
0
08 May 2025
Multi-modal cascade feature transfer for polymer property prediction
Multi-modal cascade feature transfer for polymer property prediction
Kiichi Obuchi
Yuta Yahagi
Kiyohiko Toyama
Shukichi Tanaka
Kota Matsui
47
0
0
06 May 2025
MateICL: Mitigating Attention Dispersion in Large-Scale In-Context Learning
MateICL: Mitigating Attention Dispersion in Large-Scale In-Context Learning
Murtadha Ahmed
Wenbo
Liu yunfeng
41
0
0
02 May 2025
Pre-Training Estimators for Structural Models: Application to Consumer Search
Pre-Training Estimators for Structural Models: Application to Consumer Search
Yanhao 'Max' Wei
Zhenling Jiang
31
0
0
01 May 2025
PIV-FlowDiffuser:Transfer-learning-based denoising diffusion models for PIV
PIV-FlowDiffuser:Transfer-learning-based denoising diffusion models for PIV
Qianyu Zhu
Junjie Wang
Jeremiah Hu
Jia Ai
Yong Lee
DiffM
39
0
0
21 Apr 2025
Scalability and Maintainability Challenges and Solutions in Machine Learning: Systematic Literature Review
Scalability and Maintainability Challenges and Solutions in Machine Learning: Systematic Literature Review
Karthik Shivashankar
Ghadi S. Al Hajj
Antonio Martini
20
0
0
15 Apr 2025
Hyperlocal disaster damage assessment using bi-temporal street-view imagery and pre-trained vision models
Hyperlocal disaster damage assessment using bi-temporal street-view imagery and pre-trained vision models
Yifan Yang
Lei Zou
Bing Zhou
Daoyang Li
Binbin Lin
J. Abedin
Mingzheng Yang
27
0
0
12 Apr 2025
How Social is It? A Benchmark for LLMs' Capabilities in Multi-user Multi-turn Social Agent Tasks
How Social is It? A Benchmark for LLMs' Capabilities in Multi-user Multi-turn Social Agent Tasks
Yusen Wu
Junwu Xiong
Xiaotie Deng
LLMAG
38
0
0
04 Apr 2025
Towards Graph Foundation Models: A Transferability Perspective
Yixuan Wang
Wenqi Fan
Suhang Wang
Yao Ma
43
1
0
13 Mar 2025
AugFL: Augmenting Federated Learning with Pretrained Models
Sheng Yue
Zerui Qin
Yongheng Deng
Ju Ren
Yaoxue Zhang
Junshan Zhang
FedML
85
0
0
04 Mar 2025
A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions
Elisa Negrini
Yuxuan Liu
Liu Yang
Stanley Osher
Hayden Schaeffer
AI4CE
93
0
0
09 Feb 2025
Can Large Language Models Understand Intermediate Representations?
Can Large Language Models Understand Intermediate Representations?
Hailong Jiang
Jianfeng Zhu
Yao Wan
B. Fang
Hongyu Zhang
Ruoming Jin
Qiang Guan
55
1
0
07 Feb 2025
When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translation
When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translation
Anna Min
Chenxu Hu
Yi Ren
Hang Zhao
69
0
0
01 Feb 2025
Longitudinal Abuse and Sentiment Analysis of Hollywood Movie Dialogues using LLMs
Longitudinal Abuse and Sentiment Analysis of Hollywood Movie Dialogues using LLMs
Rohitash Chandra
Guoxiang Ren
G. Houseman
46
0
0
20 Jan 2025
IIMedGPT: Promoting Large Language Model Capabilities of Medical Tasks by Efficient Human Preference Alignment
IIMedGPT: Promoting Large Language Model Capabilities of Medical Tasks by Efficient Human Preference Alignment
Yiming Zhang
Zheng Chang
Wentao Cai
MengXing Ren
Kang Yuan
Yining Sun
Zenghui Ding
LM&MA
36
3
0
06 Jan 2025
Explorations in Self-Supervised Learning: Dataset Composition Testing
  for Object Classification
Explorations in Self-Supervised Learning: Dataset Composition Testing for Object Classification
Raynor Kirkson E. Chavez
Kyle Gabriel M. Reynoso
81
0
0
01 Dec 2024
Probe-Me-Not: Protecting Pre-trained Encoders from Malicious Probing
Probe-Me-Not: Protecting Pre-trained Encoders from Malicious Probing
Ruyi Ding
Tong Zhou
Lili Su
A. A. Ding
Xiaolin Xu
Yunsi Fei
AAML
66
1
0
19 Nov 2024
An exploration of the effect of quantisation on energy consumption and
  inference time of StarCoder2
An exploration of the effect of quantisation on energy consumption and inference time of StarCoder2
Pepijn de Reus
Ana Oprescu
Jelle Zuidema
MQ
85
1
0
15 Nov 2024
A Practical Guide to Fine-tuning Language Models with Limited Data
A Practical Guide to Fine-tuning Language Models with Limited Data
Márton Szép
Daniel Rueckert
Rüdiger von Eisenhart-Rothe
Florian Hinterwimmer
SyDa
ALM
49
2
0
14 Nov 2024
Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation
Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation
Xiwen Wei
Guihong Li
R. Marculescu
42
2
0
08 Nov 2024
Automating Exploratory Proteomics Research via Language Models
Automating Exploratory Proteomics Research via Language Models
Ning Ding
Shang Qu
Linhai Xie
Yifei Li
Ziqiang Liu
...
Youbang Sun
Yang Li
Dong Li
Fuchu He
Bowen Zhou
34
2
0
06 Nov 2024
Scalable Efficient Training of Large Language Models with
  Low-dimensional Projected Attention
Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention
Xingtai Lv
Ning Ding
Kaiyan Zhang
Ermo Hua
Ganqu Cui
Bowen Zhou
37
1
0
04 Nov 2024
Masked Autoencoders are Parameter-Efficient Federated Continual Learners
Masked Autoencoders are Parameter-Efficient Federated Continual Learners
Yuchen He
Xiangfeng Wang
CLL
FedML
35
0
0
04 Nov 2024
FPPL: An Efficient and Non-IID Robust Federated Continual Learning
  Framework
FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework
Yuchen He
Chuyun Shen
Xiangfeng Wang
Bo Jin
FedML
32
1
0
04 Nov 2024
Machine Learning Innovations in CPR: A Comprehensive Survey on Enhanced
  Resuscitation Techniques
Machine Learning Innovations in CPR: A Comprehensive Survey on Enhanced Resuscitation Techniques
Saidul Islam
Gaith Rjoub
Hanae Elmekki
Jamal Bentahar
Witold Pedrycz
R. Cohen
31
0
0
03 Nov 2024
DeepSeq2: Enhanced Sequential Circuit Learning with Disentangled
  Representations
DeepSeq2: Enhanced Sequential Circuit Learning with Disentangled Representations
Sadaf Khan
Zhengyuan Shi
Ziyang Zheng
Min Li
Qiang Xu
58
1
0
01 Nov 2024
FedBaF: Federated Learning Aggregation Biased by a Foundation Model
FedBaF: Federated Learning Aggregation Biased by a Foundation Model
Jong-Ik Park
Srinivasa Pranav
J. M. F. Moura
Carlee Joe-Wong
AI4CE
71
2
0
24 Oct 2024
MiniPLM: Knowledge Distillation for Pre-Training Language Models
MiniPLM: Knowledge Distillation for Pre-Training Language Models
Yuxian Gu
Hao Zhou
Fandong Meng
Jie Zhou
Minlie Huang
67
5
0
22 Oct 2024
Distance between Relevant Information Pieces Causes Bias in Long-Context
  LLMs
Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs
Runchu Tian
Yanghao Li
Yuepeng Fu
Siyang Deng
Qinyu Luo
...
Zhong Zhang
Yesai Wu
Yankai Lin
Huadong Wang
Xiaojiang Liu
38
0
0
18 Oct 2024
SensorLLM: Aligning Large Language Models with Motion Sensors for Human Activity Recognition
SensorLLM: Aligning Large Language Models with Motion Sensors for Human Activity Recognition
Zechen Li
Shohreh Deldari
Linyao Chen
Hao Xue
Flora D. Salim
42
6
0
14 Oct 2024
ELICIT: LLM Augmentation via External In-Context Capability
ELICIT: LLM Augmentation via External In-Context Capability
Futing Wang
Jianhao Yan
Yue Zhang
Tao Lin
44
0
0
12 Oct 2024
Do Current Language Models Support Code Intelligence for R Programming Language?
Do Current Language Models Support Code Intelligence for R Programming Language?
ZiXiao Zhao
Fatemeh H. Fard
ELM
42
0
0
10 Oct 2024
Data Selection via Optimal Control for Language Models
Data Selection via Optimal Control for Language Models
Yuxian Gu
Li Dong
Hongning Wang
Y. Hao
Qingxiu Dong
Furu Wei
Minlie Huang
AI4CE
55
4
0
09 Oct 2024
Where are we in audio deepfake detection? A systematic analysis over generative and detection models
Where are we in audio deepfake detection? A systematic analysis over generative and detection models
Xiang Li
Pin-Yu Chen
Wenqi Wei
36
3
0
06 Oct 2024
Learning from Offline Foundation Features with Tensor Augmentations
Learning from Offline Foundation Features with Tensor Augmentations
Emir Konuk
Christos Matsoukas
Moein Sorkhei
Phitchapha Lertsiravaramet
Kevin Smith
OffRL
26
1
0
03 Oct 2024
MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining
Yunze Liu
Li Yi
Mamba
45
2
0
01 Oct 2024
Dual Consolidation for Pre-Trained Model-Based Domain-Incremental Learning
Dual Consolidation for Pre-Trained Model-Based Domain-Incremental Learning
Da-Wei Zhou
Zi-Wen Cai
Han-Jia Ye
Lijun Zhang
De-Chuan Zhan
CLL
AI4CE
76
2
0
01 Oct 2024
A Survey of Foundation Models for Music Understanding
A Survey of Foundation Models for Music Understanding
Wenjun Li
Ying Cai
Ziyang Wu
Wenyi Zhang
Yifan Chen
...
Junwei Han
Bao Ge
Tianming Liu
Lin Gan
Tuo Zhang
50
2
0
15 Sep 2024
Adaptive Adapter Routing for Long-Tailed Class-Incremental Learning
Adaptive Adapter Routing for Long-Tailed Class-Incremental Learning
Zhi-Hong Qi
Da-Wei Zhou
Yiran Yao
Han-Jia Ye
De-Chuan Zhan
CLL
48
5
0
11 Sep 2024
A study on Deep Convolutional Neural Networks, Transfer Learning and
  Ensemble Model for Breast Cancer Detection
A study on Deep Convolutional Neural Networks, Transfer Learning and Ensemble Model for Breast Cancer Detection
Md. Taimur Ahad
Sumaya Mustofa
Faruk Ahmed
Yousuf Rayhan Emon
Aunirudra Dey Anu
16
0
0
10 Sep 2024
OneEdit: A Neural-Symbolic Collaboratively Knowledge Editing System
OneEdit: A Neural-Symbolic Collaboratively Knowledge Editing System
Ningyu Zhang
Zekun Xi
Yujie Luo
Peng Wang
Bozhong Tian
...
Lei Liang
Qing Cui
Xiaowei Zhu
Jun Zhou
Huajun Chen
KELM
44
6
0
09 Sep 2024
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models
Thanh-Dung Le
Vu Nguyen Ha
T. Nguyen
G. Eappen
P. Thiruvasagam
...
J. L. González-Rios
Luis M. Garces-Socarras
Symeon Chatzinotas
Juan Carlos Merlano-Duncan
Symeon Chatzinotas
36
4
0
05 Sep 2024
Abstracted Gaussian Prototypes for One-Shot Concept Learning
Abstracted Gaussian Prototypes for One-Shot Concept Learning
Chelsea Zou
Kenneth J. Kurtz
VLM
29
0
0
30 Aug 2024
Watermarking Techniques for Large Language Models: A Survey
Watermarking Techniques for Large Language Models: A Survey
Yuqing Liang
Jiancheng Xiao
Wensheng Gan
Philip S. Yu
OffRL
29
3
0
26 Aug 2024
Improving the Classification Effect of Clinical Images of Diseases for
  Multi-Source Privacy Protection
Improving the Classification Effect of Clinical Images of Diseases for Multi-Source Privacy Protection
Tian Bowen
Xu Zhengyang
Yin Zhihao
Wang Jingying
Yue Yutao
FedML
39
0
0
23 Aug 2024
KIND: Knowledge Integration and Diversion in Diffusion Models
KIND: Knowledge Integration and Diversion in Diffusion Models
Yucheng Xie
Fu Feng
Jing Wang
Xin Geng
Yong Rui
VLM
36
3
0
14 Aug 2024
A Model Generalization Study in Localizing Indoor Cows with COw
  LOcalization (COLO) dataset
A Model Generalization Study in Localizing Indoor Cows with COw LOcalization (COLO) dataset
Mautushi Das
Gonzalo Ferreira
James Chen
31
0
0
29 Jul 2024
Stochastic Parrots or ICU Experts? Large Language Models in Critical
  Care Medicine: A Scoping Review
Stochastic Parrots or ICU Experts? Large Language Models in Critical Care Medicine: A Scoping Review
Tongyue Shi
Jun Ma
Zihan Yu
Haowei Xu
Minqi Xiong
Meirong Xiao
Yilin Li
Huiying Zhao
Guilan Kong
46
1
0
27 Jul 2024
123456
Next