Estimating and Maximizing Mutual Information for Knowledge Distillation

v1v2v3 (latest)

Estimating and Maximizing Mutual Information for Knowledge Distillation

29 October 2021

Vicente Ordonez

ArXiv (abs)PDF HTML

Papers citing "Estimating and Maximizing Mutual Information for Knowledge Distillation"

14 / 14 papers shown

Title
Black-box Explanation of Object Detectors via Saliency Maps Vitali Petsiuk R. Jain Varun Manjunatha Vlad I. Morariu Ashutosh Mehra Vicente Ordonez Kate Saenko FAtt 58 124 0 05 Jun 2020
Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation Tianlu Wang Xi Lin Nazneen Rajani Bryan McCann Vicente Ordonez Caimng Xiong CVBM 243 57 0 03 May 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 201 12,085 0 13 Nov 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 151 1,049 0 23 Oct 2019
Similarity-Preserving Knowledge Distillation Frederick Tung Greg Mori 120 978 0 23 Jul 2019
Correlation Congruence for Knowledge Distillation Baoyun Peng Xiao Jin Jiaheng Liu Shunfeng Zhou Yichao Wu Yu Liu Dongsheng Li Zhaoning Zhang 89 512 0 03 Apr 2019
Fast Human Pose Estimation Feng Zhang Xiatian Zhu Mao Ye 3DH 63 238 0 13 Nov 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 173 3,458 0 05 May 2018
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 118 2,581 0 12 Dec 2016
f-GAN: Training Generative Neural Samplers using Variational Divergence Minimization Sebastian Nowozin Botond Cseke Ryota Tomioka GAN 151 1,656 0 02 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 340 7,985 0 23 May 2016
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 308 3,887 0 19 Dec 2014
Visualizing and Understanding Convolutional Networks Matthew D. Zeiler Rob Fergus FAtt SSL 595 15,882 0 12 Nov 2013
Tighter Variational Representations of f-Divergences via Restriction to Probability Measures Avraham Ruderman Mark D. Reid Dario Garcia-Garcia James Petterson 70 64 0 18 Jun 2012