ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1904.05878
  4. Cited By
Knowledge Flow: Improve Upon Your Teachers

Knowledge Flow: Improve Upon Your Teachers

11 April 2019
Iou-Jen Liu
Jian-wei Peng
Alex Schwing
ArXiv (abs)PDFHTML

Papers citing "Knowledge Flow: Improve Upon Your Teachers"

43 / 43 papers shown
Title
A Model Zoo on Phase Transitions in Neural Networks
A Model Zoo on Phase Transitions in Neural Networks
Konstantin Schurholt
Léo Meynent
Yefan Zhou
Haiquan Lu
Yaoqing Yang
Damian Borth
119
1
0
25 Apr 2025
A Model Zoo of Vision Transformers
A Model Zoo of Vision Transformers
Damian Falk
Léo Meynent
Florence Pfammatter
Konstantin Schurholt
Damian Borth
264
1
0
14 Apr 2025
Topology-Preserving Adversarial Training
Topology-Preserving Adversarial Training
Xiaoyue Mi
Fan Tang
Yepeng Weng
Danding Wang
Juan Cao
Sheng Tang
Peng Li
Yang Liu
102
1
0
29 Nov 2023
Efficient Stitchable Task Adaptation
Efficient Stitchable Task Adaptation
Haoyu He
Zizheng Pan
Jing Liu
Jianfei Cai
Bohan Zhuang
126
3
0
29 Nov 2023
Fantastic Gains and Where to Find Them: On the Existence and Prospect of
  General Knowledge Transfer between Any Pretrained Model
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model
Karsten Roth
Lukas Thede
Almut Sophia Koepke
Oriol Vinyals
Olivier J. Hénaff
Zeynep Akata
AAML
119
13
0
26 Oct 2023
Distilling Efficient Vision Transformers from CNNs for Semantic
  Segmentation
Distilling Efficient Vision Transformers from CNNs for Semantic Segmentation
Xueye Zheng
Yunhao Luo
Pengyuan Zhou
Lin Wang
79
15
0
11 Oct 2023
RRR-Net: Reusing, Reducing, and Recycling a Deep Backbone Network
RRR-Net: Reusing, Reducing, and Recycling a Deep Backbone Network
Haozhe Sun
Isabelle M Guyon
F. Mohr
Hedi Tabia
CVBM
76
2
0
02 Oct 2023
Deep Model Fusion: A Survey
Deep Model Fusion: A Survey
Weishi Li
Yong Peng
Miao Zhang
Liang Ding
Han Hu
Li Shen
FedMLMoMe
117
62
0
27 Sep 2023
T-UDA: Temporal Unsupervised Domain Adaptation in Sequential Point
  Clouds
T-UDA: Temporal Unsupervised Domain Adaptation in Sequential Point Clouds
Awet Haileslassie Gebrehiwot
David Hurych
Karel Zimmermann
Patrick Pérez
Tomáš Svoboda
3DPC
89
3
0
15 Sep 2023
Model-Based Reinforcement Learning with Multi-Task Offline Pretraining
Model-Based Reinforcement Learning with Multi-Task Offline Pretraining
Minting Pan
Yitao Zheng
Yunbo Wang
Xiaokang Yang
OffRL
74
0
0
06 Jun 2023
Smaller3d: Smaller Models for 3D Semantic Segmentation Using Minkowski
  Engine and Knowledge Distillation Methods
Smaller3d: Smaller Models for 3D Semantic Segmentation Using Minkowski Engine and Knowledge Distillation Methods
Alen Adamyan
Erik Harutyunyan
3DPC
54
2
0
04 May 2023
Sparsified Model Zoo Twins: Investigating Populations of Sparsified
  Neural Network Models
Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models
D. Honegger
Konstantin Schurholt
Damian Borth
81
4
0
26 Apr 2023
AltCLIP: Altering the Language Encoder in CLIP for Extended Language
  Capabilities
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities
Zhongzhi Chen
Guangyi Liu
Bo Zhang
Fulong Ye
Qinghong Yang
Ledell Yu Wu
VLM
102
90
0
12 Nov 2022
ZooD: Exploiting Model Zoo for Out-of-Distribution Generalization
ZooD: Exploiting Model Zoo for Out-of-Distribution Generalization
Qishi Dong
Muhammad Awais
Fengwei Zhou
Chuanlong Xie
Tianyang Hu
Yongxin Yang
Sung-Ho Bae
Zhenguo Li
OODDVLM
115
14
0
17 Oct 2022
Federated Learning with Privacy-Preserving Ensemble Attention
  Distillation
Federated Learning with Privacy-Preserving Ensemble Attention Distillation
Xuan Gong
Liangchen Song
Rishi Vedula
Abhishek Sharma
Meng Zheng
...
Arun Innanje
Terrence Chen
Junsong Yuan
David Doermann
Ziyan Wu
FedML
87
28
0
16 Oct 2022
Model Zoos: A Dataset of Diverse Populations of Neural Network Models
Model Zoos: A Dataset of Diverse Populations of Neural Network Models
Konstantin Schurholt
Diyar Taskiran
Boris Knyazev
Xavier Giró-i-Nieto
Damian Borth
133
30
0
29 Sep 2022
Hyper-Representations as Generative Models: Sampling Unseen Neural
  Network Weights
Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights
Konstantin Schurholt
Boris Knyazev
Xavier Giró-i-Nieto
Damian Borth
135
42
0
29 Sep 2022
Dense Depth Distillation with Out-of-Distribution Simulated Images
Dense Depth Distillation with Out-of-Distribution Simulated Images
Junjie Hu
Chenyou Fan
Mete Ozay
Hualie Jiang
Tin Lun Lam
78
5
0
26 Aug 2022
Teachers in concordance for pseudo-labeling of 3D sequential data
Teachers in concordance for pseudo-labeling of 3D sequential data
Awet Haileslassie Gebrehiwot
Patrik Vacek
David Hurych
Karel Zimmermann
P. Pérez
Tomáš Svoboda
3DPC
75
6
0
13 Jul 2022
Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models
Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models
Yang Shu
Zhangjie Cao
Ziyang Zhang
Jianmin Wang
Mingsheng Long
70
4
0
08 Jun 2022
Multi-Source Transfer Learning for Deep Model-Based Reinforcement
  Learning
Multi-Source Transfer Learning for Deep Model-Based Reinforcement Learning
Remo Sasso
M. Sabatelli
M. Wiering
104
9
0
28 May 2022
Learning to Advise and Learning from Advice in Cooperative Multi-Agent
  Reinforcement Learning
Learning to Advise and Learning from Advice in Cooperative Multi-Agent Reinforcement Learning
Yue Jin
Shuangqing Wei
Jian Yuan
Xudong Zhang
45
0
0
23 May 2022
Transferability Metrics for Selecting Source Model Ensembles
Transferability Metrics for Selecting Source Model Ensembles
A. Agostinelli
J. Uijlings
Thomas Mensink
V. Ferrari
77
25
0
25 Nov 2021
A Survey on Green Deep Learning
A Survey on Green Deep Learning
Jingjing Xu
Wangchunshu Zhou
Zhiyi Fu
Hao Zhou
Lei Li
VLM
203
84
0
08 Nov 2021
Parameter Prediction for Unseen Deep Architectures
Parameter Prediction for Unseen Deep Architectures
Boris Knyazev
M. Drozdzal
Graham W. Taylor
Adriana Romero Soriano
OOD
119
83
0
25 Oct 2021
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for
  Efficient Distillation
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation
Sumanth Chennupati
Mohammad Mahdi Kamani
Zhongwei Cheng
Lin Chen
76
4
0
19 Oct 2021
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP
  Tasks
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
Rishabh Bhardwaj
Tushar Vaidya
Soujanya Poria
OTFedML
131
8
0
06 Oct 2021
Semantic Tracklets: An Object-Centric Representation for Visual
  Multi-Agent Reinforcement Learning
Semantic Tracklets: An Object-Centric Representation for Visual Multi-Agent Reinforcement Learning
Iou-Jen Liu
Zhongzheng Ren
Raymond A. Yeh
Alex Schwing
74
15
0
06 Aug 2021
Cooperative Exploration for Multi-Agent Deep Reinforcement Learning
Cooperative Exploration for Multi-Agent Deep Reinforcement Learning
Iou-Jen Liu
Unnat Jain
Raymond A. Yeh
Alex Schwing
107
104
0
23 Jul 2021
Representation Consolidation for Training Expert Students
Representation Consolidation for Training Expert Students
Zhizhong Li
Avinash Ravichandran
Charless C. Fowlkes
M. Polito
Rahul Bhotika
Stefano Soatto
57
6
0
16 Jul 2021
Zoo-Tuning: Adaptive Transfer from a Zoo of Models
Zoo-Tuning: Adaptive Transfer from a Zoo of Models
Yang Shu
Zhi Kou
Zhangjie Cao
Jianmin Wang
Mingsheng Long
74
44
0
29 Jun 2021
Boosting Light-Weight Depth Estimation Via Knowledge Distillation
Boosting Light-Weight Depth Estimation Via Knowledge Distillation
Junjie Hu
Chenyou Fan
Hualie Jiang
Xiyue Guo
Yuan Gao
Xiangyong Lu
Tin Lun Lam
64
27
0
13 May 2021
Complementary Relation Contrastive Distillation
Complementary Relation Contrastive Distillation
Jinguo Zhu
Shixiang Tang
Dapeng Chen
Shijie Yu
Yakun Liu
A. Yang
M. Rong
Xiaohua Wang
77
80
0
29 Mar 2021
Compacting Deep Neural Networks for Internet of Things: Methods and
  Applications
Compacting Deep Neural Networks for Internet of Things: Methods and Applications
Ke Zhang
Hanbo Ying
Hongning Dai
Lin Li
Yuangyuang Peng
Keyi Guo
Hongfang Yu
84
39
0
20 Mar 2021
High-Throughput Synchronous Deep RL
High-Throughput Synchronous Deep RL
Iou-Jen Liu
Raymond A. Yeh
Alex Schwing
OffRL
69
12
0
17 Dec 2020
Unsupervised Transfer Learning for Spatiotemporal Predictive Networks
Unsupervised Transfer Learning for Spatiotemporal Predictive Networks
Zhiyu Yao
Yunbo Wang
Mingsheng Long
Jianmin Wang
AI4TS
51
18
0
24 Sep 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning
Ensemble Distillation for Robust Model Fusion in Federated Learning
Tao R. Lin
Lingjing Kong
Sebastian U. Stich
Martin Jaggi
FedML
141
1,060
0
12 Jun 2020
Mutual Information Based Knowledge Transfer Under State-Action Dimension
  Mismatch
Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch
Michael Wan
Tanmay Gangwani
Jian-wei Peng
61
19
0
12 Jun 2020
Knowledge Distillation: A Survey
Knowledge Distillation: A Survey
Jianping Gou
B. Yu
Stephen J. Maybank
Dacheng Tao
VLM
291
3,026
0
09 Jun 2020
ResKD: Residual-Guided Knowledge Distillation
ResKD: Residual-Guided Knowledge Distillation
Xuewei Li
Songyuan Li
Bourahla Omar
Leilei Gan
Xi Li
64
48
0
08 Jun 2020
Distilling Knowledge from Graph Convolutional Networks
Distilling Knowledge from Graph Convolutional Networks
Yiding Yang
Jiayan Qiu
Xiuming Zhang
Dacheng Tao
Xinchao Wang
239
233
0
23 Mar 2020
Learning Action-Transferable Policy with Action Embedding
Learning Action-Transferable Policy with Action Embedding
Yu Chen
Yingfeng Chen
Zhipeng Hu
Tianpei Yang
Changjie Fan
Yang Yu
Jianye Hao
74
0
0
05 Sep 2019
Customizing Student Networks From Heterogeneous Teachers via Adaptive
  Knowledge Amalgamation
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation
Chengchao Shen
Mengqi Xue
Xinchao Wang
Mingli Song
Li Sun
Xiuming Zhang
MoMe
63
59
0
20 Aug 2019
1