Respecting Transfer Gap in Knowledge Distillation

Respecting Transfer Gap in Knowledge Distillation

23 October 2022

Hanwang Zhang

Papers citing "Respecting Transfer Gap in Knowledge Distillation"

12 / 62 papers shown

Title
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 113 2,569 0 12 Dec 2016
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 495 10,305 0 16 Nov 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 729 36,708 0 25 Aug 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 282 4,391 0 29 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 324 7,971 0 23 May 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 344 10,172 0 16 Mar 2016
Recommendations as Treatments: Debiasing Learning and Evaluation Tobias Schnabel Adith Swaminathan Ashudeep Singh Navin Chandak Thorsten Joachims CML 154 683 0 17 Feb 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.1K 193,426 0 10 Dec 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 322 19,609 0 09 Mar 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 288 3,870 0 19 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.5K 100,213 0 04 Sep 2014
Sample Selection Bias Correction Theory Corinna Cortes M. Mohri Michael Riley Afshin Rostamizadeh 98 348 0 19 May 2008