Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
1904.05878
Cited By
Knowledge Flow: Improve Upon Your Teachers
11 April 2019
Iou-Jen Liu
Jian-wei Peng
Alex Schwing
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Knowledge Flow: Improve Upon Your Teachers"
43 / 43 papers shown
Title
A Model Zoo on Phase Transitions in Neural Networks
Konstantin Schurholt
Léo Meynent
Yefan Zhou
Haiquan Lu
Yaoqing Yang
Damian Borth
119
1
0
25 Apr 2025
A Model Zoo of Vision Transformers
Damian Falk
Léo Meynent
Florence Pfammatter
Konstantin Schurholt
Damian Borth
264
1
0
14 Apr 2025
Topology-Preserving Adversarial Training
Xiaoyue Mi
Fan Tang
Yepeng Weng
Danding Wang
Juan Cao
Sheng Tang
Peng Li
Yang Liu
102
1
0
29 Nov 2023
Efficient Stitchable Task Adaptation
Haoyu He
Zizheng Pan
Jing Liu
Jianfei Cai
Bohan Zhuang
126
3
0
29 Nov 2023
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model
Karsten Roth
Lukas Thede
Almut Sophia Koepke
Oriol Vinyals
Olivier J. Hénaff
Zeynep Akata
AAML
119
13
0
26 Oct 2023
Distilling Efficient Vision Transformers from CNNs for Semantic Segmentation
Xueye Zheng
Yunhao Luo
Pengyuan Zhou
Lin Wang
79
15
0
11 Oct 2023
RRR-Net: Reusing, Reducing, and Recycling a Deep Backbone Network
Haozhe Sun
Isabelle M Guyon
F. Mohr
Hedi Tabia
CVBM
76
2
0
02 Oct 2023
Deep Model Fusion: A Survey
Weishi Li
Yong Peng
Miao Zhang
Liang Ding
Han Hu
Li Shen
FedML
MoMe
117
62
0
27 Sep 2023
T-UDA: Temporal Unsupervised Domain Adaptation in Sequential Point Clouds
Awet Haileslassie Gebrehiwot
David Hurych
Karel Zimmermann
Patrick Pérez
Tomáš Svoboda
3DPC
89
3
0
15 Sep 2023
Model-Based Reinforcement Learning with Multi-Task Offline Pretraining
Minting Pan
Yitao Zheng
Yunbo Wang
Xiaokang Yang
OffRL
74
0
0
06 Jun 2023
Smaller3d: Smaller Models for 3D Semantic Segmentation Using Minkowski Engine and Knowledge Distillation Methods
Alen Adamyan
Erik Harutyunyan
3DPC
54
2
0
04 May 2023
Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models
D. Honegger
Konstantin Schurholt
Damian Borth
81
4
0
26 Apr 2023
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities
Zhongzhi Chen
Guangyi Liu
Bo Zhang
Fulong Ye
Qinghong Yang
Ledell Yu Wu
VLM
102
90
0
12 Nov 2022
ZooD: Exploiting Model Zoo for Out-of-Distribution Generalization
Qishi Dong
Muhammad Awais
Fengwei Zhou
Chuanlong Xie
Tianyang Hu
Yongxin Yang
Sung-Ho Bae
Zhenguo Li
OODD
VLM
115
14
0
17 Oct 2022
Federated Learning with Privacy-Preserving Ensemble Attention Distillation
Xuan Gong
Liangchen Song
Rishi Vedula
Abhishek Sharma
Meng Zheng
...
Arun Innanje
Terrence Chen
Junsong Yuan
David Doermann
Ziyan Wu
FedML
87
28
0
16 Oct 2022
Model Zoos: A Dataset of Diverse Populations of Neural Network Models
Konstantin Schurholt
Diyar Taskiran
Boris Knyazev
Xavier Giró-i-Nieto
Damian Borth
133
30
0
29 Sep 2022
Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights
Konstantin Schurholt
Boris Knyazev
Xavier Giró-i-Nieto
Damian Borth
135
42
0
29 Sep 2022
Dense Depth Distillation with Out-of-Distribution Simulated Images
Junjie Hu
Chenyou Fan
Mete Ozay
Hualie Jiang
Tin Lun Lam
78
5
0
26 Aug 2022
Teachers in concordance for pseudo-labeling of 3D sequential data
Awet Haileslassie Gebrehiwot
Patrik Vacek
David Hurych
Karel Zimmermann
P. Pérez
Tomáš Svoboda
3DPC
75
6
0
13 Jul 2022
Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models
Yang Shu
Zhangjie Cao
Ziyang Zhang
Jianmin Wang
Mingsheng Long
70
4
0
08 Jun 2022
Multi-Source Transfer Learning for Deep Model-Based Reinforcement Learning
Remo Sasso
M. Sabatelli
M. Wiering
104
9
0
28 May 2022
Learning to Advise and Learning from Advice in Cooperative Multi-Agent Reinforcement Learning
Yue Jin
Shuangqing Wei
Jian Yuan
Xudong Zhang
45
0
0
23 May 2022
Transferability Metrics for Selecting Source Model Ensembles
A. Agostinelli
J. Uijlings
Thomas Mensink
V. Ferrari
77
25
0
25 Nov 2021
A Survey on Green Deep Learning
Jingjing Xu
Wangchunshu Zhou
Zhiyi Fu
Hao Zhou
Lei Li
VLM
203
84
0
08 Nov 2021
Parameter Prediction for Unseen Deep Architectures
Boris Knyazev
M. Drozdzal
Graham W. Taylor
Adriana Romero Soriano
OOD
119
83
0
25 Oct 2021
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation
Sumanth Chennupati
Mohammad Mahdi Kamani
Zhongwei Cheng
Lin Chen
76
4
0
19 Oct 2021
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
Rishabh Bhardwaj
Tushar Vaidya
Soujanya Poria
OT
FedML
131
8
0
06 Oct 2021
Semantic Tracklets: An Object-Centric Representation for Visual Multi-Agent Reinforcement Learning
Iou-Jen Liu
Zhongzheng Ren
Raymond A. Yeh
Alex Schwing
74
15
0
06 Aug 2021
Cooperative Exploration for Multi-Agent Deep Reinforcement Learning
Iou-Jen Liu
Unnat Jain
Raymond A. Yeh
Alex Schwing
107
104
0
23 Jul 2021
Representation Consolidation for Training Expert Students
Zhizhong Li
Avinash Ravichandran
Charless C. Fowlkes
M. Polito
Rahul Bhotika
Stefano Soatto
57
6
0
16 Jul 2021
Zoo-Tuning: Adaptive Transfer from a Zoo of Models
Yang Shu
Zhi Kou
Zhangjie Cao
Jianmin Wang
Mingsheng Long
74
44
0
29 Jun 2021
Boosting Light-Weight Depth Estimation Via Knowledge Distillation
Junjie Hu
Chenyou Fan
Hualie Jiang
Xiyue Guo
Yuan Gao
Xiangyong Lu
Tin Lun Lam
64
27
0
13 May 2021
Complementary Relation Contrastive Distillation
Jinguo Zhu
Shixiang Tang
Dapeng Chen
Shijie Yu
Yakun Liu
A. Yang
M. Rong
Xiaohua Wang
77
80
0
29 Mar 2021
Compacting Deep Neural Networks for Internet of Things: Methods and Applications
Ke Zhang
Hanbo Ying
Hongning Dai
Lin Li
Yuangyuang Peng
Keyi Guo
Hongfang Yu
84
39
0
20 Mar 2021
High-Throughput Synchronous Deep RL
Iou-Jen Liu
Raymond A. Yeh
Alex Schwing
OffRL
69
12
0
17 Dec 2020
Unsupervised Transfer Learning for Spatiotemporal Predictive Networks
Zhiyu Yao
Yunbo Wang
Mingsheng Long
Jianmin Wang
AI4TS
51
18
0
24 Sep 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning
Tao R. Lin
Lingjing Kong
Sebastian U. Stich
Martin Jaggi
FedML
141
1,062
0
12 Jun 2020
Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch
Michael Wan
Tanmay Gangwani
Jian-wei Peng
61
19
0
12 Jun 2020
Knowledge Distillation: A Survey
Jianping Gou
B. Yu
Stephen J. Maybank
Dacheng Tao
VLM
291
3,026
0
09 Jun 2020
ResKD: Residual-Guided Knowledge Distillation
Xuewei Li
Songyuan Li
Bourahla Omar
Leilei Gan
Xi Li
64
48
0
08 Jun 2020
Distilling Knowledge from Graph Convolutional Networks
Yiding Yang
Jiayan Qiu
Xiuming Zhang
Dacheng Tao
Xinchao Wang
239
233
0
23 Mar 2020
Learning Action-Transferable Policy with Action Embedding
Yu Chen
Yingfeng Chen
Zhipeng Hu
Tianpei Yang
Changjie Fan
Yang Yu
Jianye Hao
74
0
0
05 Sep 2019
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation
Chengchao Shen
Mengqi Xue
Xinchao Wang
Mingli Song
Li Sun
Xiuming Zhang
MoMe
65
59
0
20 Aug 2019
1