Estimating and Maximizing Mutual Information for Knowledge Distillation

29 October 2021

Papers citing "Estimating and Maximizing Mutual Information for Knowledge Distillation"

14 / 14 papers shown

Title
Black-box Explanation of Object Detectors via Saliency Maps Vitali Petsiuk R. Jain Varun Manjunatha Vlad I. Morariu Ashutosh Mehra Vicente Ordonez Kate Saenko FAtt 58 124 0 05 Jun 2020
Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation Tianlu Wang Xi Lin Nazneen Rajani Bryan McCann Vicente Ordonez Caimng Xiong CVBM 240 57 0 03 May 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 199 12,085 0 13 Nov 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 151 1,049 0 23 Oct 2019
Similarity-Preserving Knowledge Distillation Frederick Tung Greg Mori 120 978 0 23 Jul 2019
Correlation Congruence for Knowledge Distillation Baoyun Peng Xiao Jin Jiaheng Liu Shunfeng Zhou Yichao Wu Yu Liu Dongsheng Li Zhaoning Zhang 89 512 0 03 Apr 2019
Fast Human Pose Estimation Feng Zhang Xiatian Zhu Mao Ye 3DH 63 238 0 13 Nov 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 173 3,458 0 05 May 2018
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 118 2,581 0 12 Dec 2016
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization Sebastian Nowozin Botond Cseke Ryota Tomioka GAN 151 1,656 0 02 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 340 7,985 0 23 May 2016
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 308 3,887 0 19 Dec 2014
Visualizing and Understanding Convolutional Networks Matthew D. Zeiler Rob Fergus FAtt SSL 595 15,882 0 12 Nov 2013
Tighter Variational Representations of f-Divergences via Restriction to Probability Measures Avraham Ruderman Mark D. Reid Dario Garcia-Garcia James Petterson 70 64 0 18 Jun 2012