$Up to 100$\times$ Faster Data-free Knowledge Distillation$

Up to 100 $\times$ Faster Data-free Knowledge Distillation

12 December 2021

Papers citing "Up to 100$\times$ Faster Data-free Knowledge Distillation"

21 / 21 papers shown

Title
Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data Gongfan Fang Yifan Bao Mingli Song Xinchao Wang Don Xie Chengchao Shen Xiuming Zhang 59 44 0 27 Oct 2021
Data-Free Knowledge Distillation for Heterogeneous Federated Learning Zhuangdi Zhu Junyuan Hong Jiayu Zhou FedML 48 645 0 20 May 2021
Contrastive Model Inversion for Data-Free Knowledge Distillation Gongfan Fang Mingli Song Xinchao Wang Chen Shen Xingen Wang Xiuming Zhang 35 80 0 18 May 2021
Graph-Free Knowledge Distillation for Graph Neural Networks Xiang Deng Zhongfei Zhang 41 66 0 16 May 2021
Large-Scale Generative Data-Free Distillation Liangchen Luo Mark Sandler Zi Lin A. Zhmoginov Andrew G. Howard 31 43 0 10 Dec 2020
Adversarial Self-Supervised Data-Free Distillation for Text Classification Xinyin Ma Yongliang Shen Gongfan Fang Chen Chen Chenghao Jia Weiming Lu 112 24 0 10 Oct 2020
Data-Free Network Quantization With Adversarial Knowledge Distillation Yoojin Choi Jihwan P. Choi Mostafa El-Khamy Jungwon Lee MQ 37 120 0 08 May 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 298 1,950 0 11 Apr 2020
Distilling Knowledge from Graph Convolutional Networks Yiding Yang Jiayan Qiu Xiuming Zhang Dacheng Tao Xinchao Wang 200 229 0 23 Mar 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 217 1,196 0 24 Dec 2019
Data-Free Adversarial Distillation Gongfan Fang Mingli Song Chengchao Shen Xinchao Wang Da Chen Xiuming Zhang 46 146 0 23 Dec 2019
Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion Hongxu Yin Pavlo Molchanov Zhizhong Li J. Álvarez Arun Mallya Derek Hoiem N. Jha Jan Kautz 53 558 0 18 Dec 2019
Zero-shot Knowledge Transfer via Adversarial Belief Matching P. Micaelli Amos Storkey 37 228 0 23 May 2019
Student Becoming the Master: Knowledge Amalgamation for Joint Scene Parsing, Depth Estimation, and More Jingwen Ye Yixin Ji Xinchao Wang Kairi Ou Dapeng Tao Xiuming Zhang MoMe 87 75 0 23 Apr 2019
Data-Free Learning of Student Networks Hanting Chen Yunhe Wang Chang Xu Zhaohui Yang Chuanjian Liu Boxin Shi Chunjing Xu Chao Xu Qi Tian FedML 42 367 0 02 Apr 2019
Amalgamating Knowledge towards Comprehensive Classification Chengchao Shen L. Câlmâc Mingli Song Li Sun Xiuming Zhang MoMe 47 89 0 07 Nov 2018
On First-Order Meta-Learning Algorithms Alex Nichol Joshua Achiam John Schulman 201 2,226 0 08 Mar 2018
Data-Free Knowledge Distillation for Deep Neural Networks Raphael Gontijo-Lopes Stefano Fenu Thad Starner 44 271 0 19 Oct 2017
Rethinking Atrous Convolution for Semantic Image Segmentation Liang-Chieh Chen George Papandreou Florian Schroff Hartwig Adam SSeg 168 8,425 0 17 Jun 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 759 11,793 0 09 Mar 2017
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 241 19,523 0 09 Mar 2015

Up to 100×\times× Faster Data-free Knowledge Distillation

Papers citing "Up to 100$\times$ Faster Data-free Knowledge Distillation"

Up to 100 $\times$ Faster Data-free Knowledge Distillation