Knowledge Flow: Improve Upon Your Teachers

11 April 2019

Papers citing "Knowledge Flow: Improve Upon Your Teachers"

43 / 43 papers shown

Title
A Model Zoo on Phase Transitions in Neural Networks Konstantin Schurholt Léo Meynent Yefan Zhou Haiquan Lu Yaoqing Yang Damian Borth 119 1 0 25 Apr 2025
A Model Zoo of Vision Transformers Damian Falk Léo Meynent Florence Pfammatter Konstantin Schurholt Damian Borth 264 1 0 14 Apr 2025
Topology-Preserving Adversarial Training Xiaoyue Mi Fan Tang Yepeng Weng Danding Wang Juan Cao Sheng Tang Peng Li Yang Liu 102 1 0 29 Nov 2023
Efficient Stitchable Task Adaptation Haoyu He Zizheng Pan Jing Liu Jianfei Cai Bohan Zhuang 126 3 0 29 Nov 2023
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model Karsten Roth Lukas Thede Almut Sophia Koepke Oriol Vinyals Olivier J. Hénaff Zeynep Akata AAML 119 13 0 26 Oct 2023
Distilling Efficient Vision Transformers from CNNs for Semantic Segmentation Xueye Zheng Yunhao Luo Pengyuan Zhou Lin Wang 79 15 0 11 Oct 2023
RRR-Net: Reusing, Reducing, and Recycling a Deep Backbone Network Haozhe Sun Isabelle M Guyon F. Mohr Hedi Tabia CVBM 76 2 0 02 Oct 2023
Deep Model Fusion: A Survey Weishi Li Yong Peng Miao Zhang Liang Ding Han Hu Li Shen FedML MoMe 117 62 0 27 Sep 2023
T-UDA: Temporal Unsupervised Domain Adaptation in Sequential Point Clouds Awet Haileslassie Gebrehiwot David Hurych Karel Zimmermann Patrick Pérez Tomáš Svoboda 3DPC 89 3 0 15 Sep 2023
Model-Based Reinforcement Learning with Multi-Task Offline Pretraining Minting Pan Yitao Zheng Yunbo Wang Xiaokang Yang OffRL 74 0 0 06 Jun 2023
Smaller3d: Smaller Models for 3D Semantic Segmentation Using Minkowski Engine and Knowledge Distillation Methods Alen Adamyan Erik Harutyunyan 3DPC 54 2 0 04 May 2023
Sparsified Model Zoo Twins: Investigating Populations of Sparsified Neural Network Models D. Honegger Konstantin Schurholt Damian Borth 81 4 0 26 Apr 2023
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities Zhongzhi Chen Guangyi Liu Bo Zhang Fulong Ye Qinghong Yang Ledell Yu Wu VLM 102 90 0 12 Nov 2022
ZooD: Exploiting Model Zoo for Out-of-Distribution Generalization Qishi Dong Muhammad Awais Fengwei Zhou Chuanlong Xie Tianyang Hu Yongxin Yang Sung-Ho Bae Zhenguo Li OODD VLM 115 14 0 17 Oct 2022
Federated Learning with Privacy-Preserving Ensemble Attention Distillation Xuan Gong Liangchen Song Rishi Vedula Abhishek Sharma Meng Zheng ... Arun Innanje Terrence Chen Junsong Yuan David Doermann Ziyan Wu FedML 87 28 0 16 Oct 2022
Model Zoos: A Dataset of Diverse Populations of Neural Network Models Konstantin Schurholt Diyar Taskiran Boris Knyazev Xavier Giró-i-Nieto Damian Borth 130 30 0 29 Sep 2022
Hyper-Representations as Generative Models: Sampling Unseen Neural Network Weights Konstantin Schurholt Boris Knyazev Xavier Giró-i-Nieto Damian Borth 135 42 0 29 Sep 2022
Dense Depth Distillation with Out-of-Distribution Simulated Images Junjie Hu Chenyou Fan Mete Ozay Hualie Jiang Tin Lun Lam 76 5 0 26 Aug 2022
Teachers in concordance for pseudo-labeling of 3D sequential data Awet Haileslassie Gebrehiwot Patrik Vacek David Hurych Karel Zimmermann P. Pérez Tomáš Svoboda 3DPC 75 6 0 13 Jul 2022
Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models Yang Shu Zhangjie Cao Ziyang Zhang Jianmin Wang Mingsheng Long 70 4 0 08 Jun 2022
Multi-Source Transfer Learning for Deep Model-Based Reinforcement Learning Remo Sasso M. Sabatelli M. Wiering 104 9 0 28 May 2022
Learning to Advise and Learning from Advice in Cooperative Multi-Agent Reinforcement Learning Yue Jin Shuangqing Wei Jian Yuan Xudong Zhang 42 0 0 23 May 2022
Transferability Metrics for Selecting Source Model Ensembles A. Agostinelli J. Uijlings Thomas Mensink V. Ferrari 77 25 0 25 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 203 84 0 08 Nov 2021
Parameter Prediction for Unseen Deep Architectures Boris Knyazev M. Drozdzal Graham W. Taylor Adriana Romero Soriano OOD 119 83 0 25 Oct 2021
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation Sumanth Chennupati Mohammad Mahdi Kamani Zhongwei Cheng Lin Chen 76 4 0 19 Oct 2021
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks Rishabh Bhardwaj Tushar Vaidya Soujanya Poria OT FedML 131 7 0 06 Oct 2021
Semantic Tracklets: An Object-Centric Representation for Visual Multi-Agent Reinforcement Learning Iou-Jen Liu Zhongzheng Ren Raymond A. Yeh Alex Schwing 74 15 0 06 Aug 2021
Cooperative Exploration for Multi-Agent Deep Reinforcement Learning Iou-Jen Liu Unnat Jain Raymond A. Yeh Alex Schwing 101 104 0 23 Jul 2021
Representation Consolidation for Training Expert Students Zhizhong Li Avinash Ravichandran Charless C. Fowlkes M. Polito Rahul Bhotika Stefano Soatto 57 6 0 16 Jul 2021
Zoo-Tuning: Adaptive Transfer from a Zoo of Models Yang Shu Zhi Kou Zhangjie Cao Jianmin Wang Mingsheng Long 74 44 0 29 Jun 2021
Boosting Light-Weight Depth Estimation Via Knowledge Distillation Junjie Hu Chenyou Fan Hualie Jiang Xiyue Guo Yuan Gao Xiangyong Lu Tin Lun Lam 64 27 0 13 May 2021
Complementary Relation Contrastive Distillation Jinguo Zhu Shixiang Tang Dapeng Chen Shijie Yu Yakun Liu A. Yang M. Rong Xiaohua Wang 77 80 0 29 Mar 2021
Compacting Deep Neural Networks for Internet of Things: Methods and Applications Ke Zhang Hanbo Ying Hongning Dai Lin Li Yuangyuang Peng Keyi Guo Hongfang Yu 84 39 0 20 Mar 2021
High-Throughput Synchronous Deep RL Iou-Jen Liu Raymond A. Yeh Alex Schwing OffRL 69 12 0 17 Dec 2020
Unsupervised Transfer Learning for Spatiotemporal Predictive Networks Zhiyu Yao Yunbo Wang Mingsheng Long Jianmin Wang AI4TS 51 18 0 24 Sep 2020
Ensemble Distillation for Robust Model Fusion in Federated Learning Tao R. Lin Lingjing Kong Sebastian U. Stich Martin Jaggi FedML 141 1,060 0 12 Jun 2020
Mutual Information Based Knowledge Transfer Under State-Action Dimension Mismatch Michael Wan Tanmay Gangwani Jian-wei Peng 61 19 0 12 Jun 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 285 3,016 0 09 Jun 2020
ResKD: Residual-Guided Knowledge Distillation Xuewei Li Songyuan Li Bourahla Omar Leilei Gan Xi Li 64 48 0 08 Jun 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Xiuming Zhang Dacheng Tao Xinchao Wang 239 233 0 23 Mar 2020
Learning Action-Transferable Policy with Action Embedding Yu Chen Yingfeng Chen Zhipeng Hu Tianpei Yang Changjie Fan Yang Yu Jianye Hao 74 0 0 05 Sep 2019
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation Chengchao Shen Mengqi Xue Xinchao Wang Mingli Song Li Sun Xiuming Zhang MoMe 61 58 0 20 Aug 2019