Channel Self-Supervision for Online Knowledge Distillation

22 March 2022

Papers citing "Channel Self-Supervision for Online Knowledge Distillation"

21 / 21 papers shown

Title
Self-supervision of Feature Transformation for Further Improving Supervised Learning Zilin Ding Yuhang Yang Xuan Cheng Xiaomin Wang Ming-Yuan Liu SSL 21 2 0 09 Jun 2021
Self-supervised Feature Enhancement: Applying Internal Pretext Task to Supervised Learning Yuhang Yang Zilin Ding Xuan Cheng Xiaomin Wang Ming Liu SSL 18 1 0 09 Jun 2021
Peer Collaborative Learning for Online Knowledge Distillation Guile Wu S. Gong FedML 39 129 0 07 Jun 2020
Online Knowledge Distillation with Diverse Peers Defang Chen Jian-Ping Mei Can Wang Yan Feng Chun-Yen Chen FedML 60 301 0 01 Dec 2019
Similarity-Preserving Knowledge Distillation Frederick Tung Greg Mori 113 973 0 23 Jul 2019
Improved Knowledge Distillation via Teacher Assistant Seyed Iman Mirzadeh Mehrdad Farajtabar Ang Li Nir Levine Akihiro Matsukawa H. Ghasemzadeh 92 1,074 0 09 Feb 2019
Knowledge Distillation by On-the-Fly Native Ensemble Xu Lan Xiatian Zhu S. Gong 275 476 0 12 Jun 2018
Collaborative Learning for Deep Neural Networks Guocong Song Wei Chai FedML 38 195 0 30 May 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 231 3,283 0 21 Mar 2018
Squeeze-and-Excitation Networks Jie Hu Li Shen Samuel Albanie Gang Sun Enhua Wu 382 26,365 0 05 Sep 2017
Deep Mutual Learning Ying Zhang Tao Xiang Timothy M. Hospedales Huchuan Lu FedML 143 1,650 0 01 Jun 2017
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Zhuowen Tu Kaiming He 481 10,305 0 16 Nov 2016
Deep Pyramidal Residual Networks Dongyoon Han Jiwhan Kim Junmo Kim 93 692 0 10 Oct 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 312 7,971 0 23 May 2016
Fully Convolutional Networks for Semantic Segmentation Evan Shelhamer Jonathan Long Trevor Darrell VOS SSeg 563 37,806 0 20 May 2016
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 157 2 0 30 Mar 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 124 157 0 28 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.9K 193,426 0 10 Dec 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 310 19,609 0 09 Mar 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 276 3,870 0 19 Dec 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.4K 39,472 0 01 Sep 2014