Knowledge Transfer via Dense Cross-Layer Mutual-Distillation

18 August 2020

Papers citing "Knowledge Transfer via Dense Cross-Layer Mutual-Distillation"

47 / 47 papers shown

Title
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 96 1,037 0 23 Oct 2019
Knowledge Distillation from Internal Representations Gustavo Aguilar Yuan Ling Yu Zhang Benjamin Yao Xing Fan Edward Guo 54 179 0 08 Oct 2019
UM-Adapt: Unsupervised Multi-Task Adaptation Using Adversarial Cross-Task Distillation Jogendra Nath Kundu Nishank Lakkakula R. Venkatesh Babu 38 59 0 11 Aug 2019
Lifelong GAN: Continual Learning for Conditional Image Generation Mengyao Zhai Lei Chen Frederick Tung Jiawei He Megha Nawhal Greg Mori CLL 60 184 0 23 Jul 2019
Deeply-supervised Knowledge Synergy Dawei Sun Anbang Yao Aojun Zhou Hao Zhao 18 63 0 03 Jun 2019
Richer and Deeper Supervision Network for Salient Object Detection Sen Jia Neil D. B. Bruce 37 17 0 08 Jan 2019
Learning Monocular Depth by Distilling Cross-domain Stereo Networks Xiaoyang Guo Hongsheng Li Shuai Yi Jimmy S. J. Ren Xiaogang Wang MDE 52 206 0 20 Aug 2018
Self-supervised Knowledge Distillation Using Singular Value Decomposition Seunghyun Lee D. Kim B. Song 25 139 0 18 Jul 2018
Modality Distillation with Multiple Stream Networks for Action Recognition Nuno C. Garcia Pietro Morerio Vittorio Murino 42 181 0 19 Jun 2018
Knowledge Distillation by On-the-Fly Native Ensemble Xu Lan Xiatian Zhu S. Gong 262 475 0 12 Jun 2018
Collaborative Learning for Deep Neural Networks Guocong Song Wei Chai FedML 30 195 0 30 May 2018
PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsing Dan Xu Wanli Ouyang Xiaogang Wang N. Sebe MoE 46 476 0 11 May 2018
ExFuse: Enhancing Feature Fusion for Semantic Segmentation Zhenli Zhang Xiangyu Zhang Chao Peng Dazhi Cheng Jian Sun 51 426 0 11 Apr 2018
Deep Co-Training for Semi-Supervised Image Recognition Siyuan Qiao Wei Shen Zhishuai Zhang Bo Wang Alan Yuille 39 446 0 15 Mar 2018
Paraphrasing Complex Network: Network Compression via Factor Transfer Jangho Kim Seonguk Park Nojun Kwak 47 545 0 14 Feb 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks Mark Sandler Andrew G. Howard Menglong Zhu A. Zhmoginov Liang-Chieh Chen 129 19,124 0 13 Jan 2018
Cascaded Pyramid Network for Multi-Person Pose Estimation Yilun Chen Zhicheng Wang Yuxiang Peng Zhiqiang Zhang Gang Yu Jian Sun 112 1,423 0 20 Nov 2017
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 233 9,687 0 25 Oct 2017
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 324 26,241 0 05 Sep 2017
Deep Mutual Learning Ying Zhang Tao Xiang Timothy M. Hospedales Huchuan Lu FedML 113 1,645 0 01 Jun 2017
Cooperative Learning with Visual Attributes Tanmay Batra Devi Parikh 49 29 0 16 May 2017
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 1.0K 20,692 0 17 Apr 2017
Efficient Processing of Deep Neural Networks: A Tutorial and Survey Vivienne Sze Yu-hsin Chen Tien-Ju Yang J. Emer AAML 3DV 94 3,002 0 27 Mar 2017
Demystifying Neural Style Transfer Yanghao Li Naiyan Wang Jiaying Liu Xiaodi Hou 56 521 0 04 Jan 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 99 2,561 0 12 Dec 2016
Pyramid Scene Parsing Network Hengshuang Zhao Jianping Shi Xiaojuan Qi Xiaogang Wang Jiaya Jia VOS SSeg 343 11,941 0 04 Dec 2016
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 426 10,281 0 16 Nov 2016
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 262 4,612 0 10 Nov 2016
Dual Learning for Machine Translation Yingce Xia Di He Tao Qin Liwei Wang Nenghai Yu Tie-Yan Liu Wei-Ying Ma AI4CE 59 848 0 01 Nov 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 616 36,599 0 25 Aug 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 241 4,357 0 29 Jun 2016
Sequence-Level Knowledge Distillation Yoon Kim Alexander M. Rush 81 1,109 0 25 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 251 7,951 0 23 May 2016
Fully Convolutional Networks for Semantic Segmentation Evan Shelhamer Jonathan Long Trevor Darrell VOS SSeg 291 37,704 0 20 May 2016
Stacked Hourglass Networks for Human Pose Estimation Alejandro Newell Kaiyu Yang Jia Deng 3DH 88 5,008 0 22 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.3K 192,638 0 10 Dec 2015
SSD: Single Shot MultiBox Detector Wen Liu Dragomir Anguelov D. Erhan Christian Szegedy Scott E. Reed Cheng-Yang Fu Alexander C. Berg ObjD BDL 140 29,646 0 08 Dec 2015
Net2Net: Accelerating Learning via Knowledge Transfer Tianqi Chen Ian Goodfellow Jonathon Shlens 90 663 0 18 Nov 2015
Holistically-Nested Edge Detection Saining Xie Zhuowen Tu 85 3,479 0 24 Apr 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 225 19,448 0 09 Mar 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 234 3,862 0 19 Dec 2014
Deeply-Supervised Nets Chen-Yu Lee Saining Xie Patrick W. Gallagher Zhengyou Zhang Zhuowen Tu 250 2,229 0 18 Sep 2014
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 297 43,511 0 17 Sep 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 891 99,991 0 04 Sep 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.1K 39,383 0 01 Sep 2014
Do Deep Nets Really Need to be Deep? Lei Jimmy Ba R. Caruana 145 2,114 0 21 Dec 2013
Rich feature hierarchies for accurate object detection and semantic segmentation Ross B. Girshick Jeff Donahue Trevor Darrell Jitendra Malik ObjD 218 26,091 0 11 Nov 2013