Self Regulated Learning Mechanism for Data Efficient Knowledge Distillation

14 February 2021

Papers citing "Self Regulated Learning Mechanism for Data Efficient Knowledge Distillation"

18 / 18 papers shown

Title
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 42 2,907 0 09 Jun 2020
Creating Something from Nothing: Unsupervised Knowledge Distillation for Cross-Modal Hashing Hengtong Hu Lingxi Xie Richang Hong Qi Tian 12 110 0 01 Apr 2020
Zero-Shot Knowledge Distillation in Deep Networks Gaurav Kumar Nayak Konda Reddy Mopuri Vaisakh Shaj R. Venkatesh Babu Anirban Chakraborty 54 245 0 20 May 2019
Triplet Distillation for Deep Face Recognition Yushu Feng Huan Wang Daniel T. Yi Roland Hu CVBM 18 45 0 11 May 2019
Conditional Teacher-Student Learning Zhong Meng Jinyu Li Yong Zhao Jiawei Liu 32 90 0 28 Apr 2019
Data-Free Learning of Student Networks Hanting Chen Yunhe Wang Chang Xu Zhaohui Yang Chuanjian Liu Boxin Shi Chunjing Xu Chao Xu Qi Tian FedML 24 367 0 02 Apr 2019
Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons Byeongho Heo Minsik Lee Sangdoo Yun J. Choi 18 519 0 08 Nov 2018
Born Again Neural Networks Tommaso Furlanello Zachary Chase Lipton Michael Tschannen Laurent Itti Anima Anandkumar 49 1,030 0 12 May 2018
Few-shot learning of neural networks from scratch by pseudo example optimization Akisato Kimura Zoubin Ghahramani Koh Takeuchi Tomoharu Iwata N. Ueda 39 52 0 08 Feb 2018
Data-Free Knowledge Distillation for Deep Neural Networks Raphael Gontijo-Lopes Stefano Fenu Thad Starner 34 271 0 19 Oct 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 83 2,561 0 12 Dec 2016
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding Song Han Huizi Mao W. Dally 3DGS 163 8,793 0 01 Oct 2015
Learning both Weights and Connections for Efficient Neural Networks Song Han Jeff Pool J. Tran W. Dally CVBM 167 6,628 0 08 Jun 2015
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 341 61,900 0 04 Jun 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 98 19,448 0 09 Mar 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 387 149,474 0 22 Dec 2014
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 191 3,862 0 19 Dec 2014
Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation Emily L. Denton Wojciech Zaremba Joan Bruna Yann LeCun Rob Fergus FAtt 81 1,682 0 02 Apr 2014