FitNets: Hints for Thin Deep Nets

19 December 2014

Adriana Romero

Nicolas Ballas

Samira Ebrahimi Kahou

Papers citing "FitNets: Hints for Thin Deep Nets"

50 / 726 papers shown

Title
Domain-adaptive deep network compression Marc Masana Joost van de Weijer Luis Herranz Andrew D. Bagdanov J. Álvarez 44 62 0 04 Sep 2017
Fine-Pruning: Joint Fine-Tuning and Compression of a Convolutional Network with Bayesian Optimization Frederick Tung S. Muralidharan Greg Mori 29 35 0 28 Jul 2017
Orthogonal and Idempotent Transformations for Learning Deep Neural Networks Jingdong Wang Yajie Xing Kexin Zhang Cha Zhang 190 2 0 19 Jul 2017
Interleaved Group Convolutions for Deep Neural Networks Ting Zhang Guo-Jun Qi Bin Xiao Jingdong Wang 36 81 0 10 Jul 2017
DarkRank: Accelerating Deep Metric Learning via Cross Sample Similarities Transfer Yuntao Chen Naiyan Wang Zhaoxiang Zhang FedML 57 219 0 05 Jul 2017
Data-Driven Sparse Structure Selection for Deep Neural Networks Zehao Huang Naiyan Wang 53 558 0 05 Jul 2017
DiracNets: Training Very Deep Neural Networks Without Skip-Connections Sergey Zagoruyko N. Komodakis UQCV OOD 16 117 0 01 Jun 2017
Deep Mutual Learning Ying Zhang Tao Xiang Timothy M. Hospedales Huchuan Lu FedML 39 1,639 0 01 Jun 2017
Iterative Machine Teaching Weiyang Liu Bo Dai Ahmad Humayun C. Tay Chen Yu Linda B. Smith James M. Rehg Le Song 28 141 0 30 May 2017
Feature Incay for Representation Regularization Yuhui Yuan Kuiyuan Yang Chao Zhang 35 16 0 29 May 2017
Hardware-Software Codesign of Accurate, Multiplier-free Deep Neural Networks Hokchhay Tann S. Hashemi Iris Bahar Sherief Reda MQ 29 74 0 11 May 2017
Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation G. Ning Zhi Zhang Zhiquan He GAN 29 169 0 05 May 2017
Inception Recurrent Convolutional Neural Network for Object Recognition Md. Zahangir Alom Mahmudul Hasan C. Yakopcic T. Taha 39 86 0 25 Apr 2017
Snapshot Ensembles: Train 1, get M for free Gao Huang Yixuan Li Geoff Pleiss Zhuang Liu J. Hopcroft Kilian Q. Weinberger OOD FedML UQCV 50 935 0 01 Apr 2017
More is Less: A More Complicated Network with Less Inference Complexity Xuanyi Dong Junshi Huang Yi Yang Shuicheng Yan 26 288 0 25 Mar 2017
Batch-normalized joint training for DNN-based distant speech recognition Mirco Ravanelli Philemon Brakel M. Omologo Yoshua Bengio 18 35 0 24 Mar 2017
Knowledge distillation using unlabeled mismatched images Mandar M. Kulkarni Kalpesh Patil Shirish S. Karande 48 16 0 21 Mar 2017
Second-order Convolutional Neural Networks Kaicheng Yu Mathieu Salzmann 24 51 0 20 Mar 2017
A Novel Weight-Shared Multi-Stage CNN for Scale Robustness Ryo Takahashi Takashi Matsubara K. Uehara OOD 30 21 0 12 Feb 2017
Fast and Accurate Entity Recognition with Iterated Dilated Convolutions Emma Strubell Pat Verga David Belanger Andrew McCallum 30 390 0 07 Feb 2017
Deep Learning with Low Precision by Half-wave Gaussian Quantization Zhaowei Cai Xiaodong He Jian Sun Nuno Vasconcelos MQ 50 503 0 03 Feb 2017
Universal representations:The missing link between faces, text, planktons, and cat breeds Hakan Bilen Andrea Vedaldi 38 147 0 25 Jan 2017
Stacked Generative Adversarial Networks Xun Huang Yixuan Li Omid Poursaeed J. Hopcroft Serge J. Belongie GAN 22 458 0 13 Dec 2016
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 31 2,552 0 12 Dec 2016
Large-Margin Softmax Loss for Convolutional Neural Networks Weiyang Liu Yandong Wen Zhiding Yu Meng Yang CVBM 36 1,451 0 07 Dec 2016
A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images David Vázquez Jorge Bernal F. Sánchez Gloria Fernández-Esparrach Antonio M. López Adriana Romero M. Drozdzal Aaron Courville 3DV 22 624 0 02 Dec 2016
In Teacher We Trust: Learning Compressed Models for Pedestrian Detection Jonathan Shen Noranart Vesdapunt Vishnu Boddeti Kris Kitani 19 29 0 01 Dec 2016
Training Sparse Neural Networks Suraj Srinivas Akshayvarun Subramanya R. Venkatesh Babu 27 204 0 21 Nov 2016
Learning the Number of Neurons in Deep Networks J. Álvarez Mathieu Salzmann 58 413 0 19 Nov 2016
Factorized Bilinear Models for Image Recognition Yanghao Li Naiyan Wang Jiaying Liu Xiaodi Hou 19 96 0 17 Nov 2016
Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person Attribute Classification Y. Lu Abhishek Kumar Shuangfei Zhai Yu Cheng T. Javidi Rogerio Feris 3DH 21 384 0 16 Nov 2016
Deep Model Compression: Distilling Knowledge from Noisy Teachers Bharat Bhusan Sau V. Balasubramanian 23 181 0 30 Oct 2016
Small-footprint Highway Deep Neural Networks for Speech Recognition Liang Lu Steve Renals 38 15 0 18 Oct 2016
Deep Pyramidal Residual Networks Dongyoon Han Jiwhan Kim Junmo Kim 26 689 0 10 Oct 2016
Do They All Look the Same? Deciphering Chinese, Japanese and Koreans by Fine-Grained Deep Learning Yu Wang Haofu Liao Yang Feng Xiangyang Xu Jiebo Luo CVBM 33 25 0 06 Oct 2016
Knowledge Guided Disambiguation for Large-Scale Scene Classification with Multi-Resolution CNNs Limin Wang Sheng Guo Weilin Huang Yuanjun Xiong Yu Qiao 35 142 0 04 Oct 2016
X-CNN: Cross-modal Convolutional Neural Networks for Sparse Datasets Petar Velickovic Duo Wang Nicholas D. Lane Pietro Lio 34 31 0 01 Oct 2016
HyperNetworks David R Ha Andrew M. Dai Quoc V. Le 84 1,589 0 27 Sep 2016
Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations Itay Hubara Matthieu Courbariaux Daniel Soudry Ran El-Yaniv Yoshua Bengio MQ 54 1,846 0 22 Sep 2016
FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition Hui Ding S. Kevin Zhou Rama Chellappa CVBM 39 363 0 21 Sep 2016
Densely Connected Convolutional Networks Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger PINN 3DV 327 36,420 0 25 Aug 2016
Lets keep it simple, Using simple architectures to outperform deeper and more complex architectures S. H. HasanPour Mohammad Rouhani Mohsen Fayyaz Mohammad Sabokrou 23 119 0 22 Aug 2016
The Importance of Skip Connections in Biomedical Image Segmentation M. Drozdzal Eugene Vorontsov Gabriel Chartrand Samuel Kadoury C. Pal MedIm 35 1,037 0 14 Aug 2016
Residual Networks of Residual Networks: Multilevel Residual Networks Ke Zhang Miao Sun T. Han Xingfang Yuan Liru Guo Tao Liu 20 303 0 09 Aug 2016
Knowledge Distillation for Small-footprint Highway Networks Liang Lu Michelle Guo Steve Renals 24 73 0 02 Aug 2016
Training Skinny Deep Neural Networks with Iterative Hard Thresholding Methods Xiaojie Jin Xiao-Tong Yuan Jiashi Feng Shuicheng Yan 16 78 0 19 Jul 2016
Learning without Forgetting Zhizhong Li Derek Hoiem CLL OOD SSL 101 4,319 0 29 Jun 2016
Sequence-Level Knowledge Distillation Yoon Kim Alexander M. Rush 47 1,101 0 25 Jun 2016
FractalNet: Ultra-Deep Neural Networks without Residuals Gustav Larsson Michael Maire Gregory Shakhnarovich 45 933 0 24 May 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 92 7,914 0 23 May 2016