Dynamic Rectification Knowledge Distillation

Dynamic Rectification Knowledge Distillation

27 January 2022

Fahad Rahman Amik

Ahnaf Ismat Tasin

Nabeel Mohammed

ArXiv (abs)PDF HTML

Papers citing "Dynamic Rectification Knowledge Distillation"

17 / 17 papers shown

Title
Embedded Encoder-Decoder in Convolutional Networks Towards Explainable AI A. Tavanaei XAI 94 31 0 19 Jun 2020
Self-Distillation as Instance-Specific Label Smoothing Zhilu Zhang M. Sabuncu 69 119 0 09 Jun 2020
Self-supervised Label Augmentation via Input Transformations Hankook Lee Sung Ju Hwang Jinwoo Shin SSL 44 62 0 14 Oct 2019
Learning Lightweight Lane Detection CNNs by Self Attention Distillation Yuenan Hou Zheng Ma Chunxiao Liu Chen Change Loy 68 557 0 02 Aug 2019
Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation Linfeng Zhang Jiebo Song Anni Gao Jingwei Chen Chenglong Bao Kaisheng Ma FedML 76 863 0 17 May 2019
Snapshot Distillation: Teacher-Student Optimization in One Generation Chenglin Yang Lingxi Xie Chi Su Alan Yuille 75 193 0 01 Dec 2018
Self-Referenced Deep Learning Xu Lan Xiatian Zhu S. Gong 109 24 0 19 Nov 2018
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design Ningning Ma Xiangyu Zhang Haitao Zheng Jian Sun 181 5,000 0 30 Jul 2018
Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels Zhilu Zhang M. Sabuncu NoLa 85 2,608 0 20 May 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks Mark Sandler Andrew G. Howard Menglong Zhu A. Zhmoginov Liang-Chieh Chen 186 19,316 0 13 Jan 2018
Large-Margin Softmax Loss for Convolutional Neural Networks Weiyang Liu Yandong Wen Zhiding Yu Meng Yang CVBM 81 1,456 0 07 Dec 2016
Deep Model Compression: Distilling Knowledge from Noisy Teachers Bharat Bhusan Sau V. Balasubramanian 51 181 0 30 Oct 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,322 0 10 Dec 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 362 19,723 0 09 Mar 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 308 3,893 0 19 Dec 2014
Going Deeper with Convolutions Christian Szegedy Wei Liu Yangqing Jia P. Sermanet Scott E. Reed Dragomir Anguelov D. Erhan Vincent Vanhoucke Andrew Rabinovich 480 43,685 0 17 Sep 2014
Do Deep Nets Really Need to be Deep? Lei Jimmy Ba R. Caruana 165 2,119 0 21 Dec 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.