Do Deep Nets Really Need to be Deep?

21 December 2013

Lei Jimmy Ba

Papers citing "Do Deep Nets Really Need to be Deep?"

50 / 379 papers shown

Title
Structured Knowledge Distillation for Dense Prediction Yifan Liu Chris Liu Jingdong Wang Zhenbo Luo 27 575 0 11 Mar 2019
Neural Networks Trained on Natural Scenes Exhibit Gestalt Closure Been Kim Emily Reif Martin Wattenberg Samy Bengio Michael C. Mozer 36 30 0 04 Mar 2019
SECNLP: A Survey of Embeddings in Clinical Natural Language Processing Katikapalli Subramanyam Kalyan S. Sangeetha 17 82 0 04 Mar 2019
Efficient Video Classification Using Fewer Frames S. Bhardwaj Mukundhan Srinivasan Mitesh M. Khapra 40 88 0 27 Feb 2019
Inference of a Multi-Domain Machine Learning Model to Predict Mortality in Hospital Stays for Patients with Cancer upon Febrile Neutropenia Onset Xinsong Du Jae Min M. Prosperi R. Bishnoi Dominick J. Lemas Chintan P. Shah AI4CE 14 0 0 21 Feb 2019
Understanding and Training Deep Diagonal Circulant Neural Networks Alexandre Araujo Benjamin Négrevergne Y. Chevaleyre Jamal Atif 27 4 0 29 Jan 2019
Progressive Label Distillation: Learning Input-Efficient Deep Neural Networks Z. Q. Lin A. Wong 22 1 0 26 Jan 2019
ISeeU: Visually interpretable deep learning for mortality prediction inside the ICU William Caicedo-Torres Jairo Gutiérrez 14 78 0 24 Jan 2019
Enhancing Explainability of Neural Networks through Architecture Constraints Zebin Yang Aijun Zhang Agus Sudjianto AAML 13 87 0 12 Jan 2019
DSConv: Efficient Convolution Operator Marcelo Gennari Roger Fawcett V. Prisacariu MQ 32 62 0 07 Jan 2019
Studying the Plasticity in Deep Convolutional Neural Networks using Random Pruning Deepak Mittal S. Bhardwaj Mitesh M. Khapra Balaraman Ravindran 3DPC 33 31 0 26 Dec 2018
Wireless Network Intelligence at the Edge Jihong Park S. Samarakoon M. Bennis Mérouane Debbah 21 518 0 07 Dec 2018
Accelerating Large Scale Knowledge Distillation via Dynamic Importance Sampling Minghan Li Tanli Zuo Ruicheng Li Martha White Weishi Zheng 29 3 0 03 Dec 2018
Knowledge Distillation with Feature Maps for Image Classification Wei-Chun Chen Chia-Che Chang Chien-Yu Lu Che-Rung Lee 29 35 0 03 Dec 2018
Neural Rejuvenation: Improving Deep Network Training by Enhancing Computational Resource Utilization Siyuan Qiao Zhe-nan Lin Jianming Zhang Alan Yuille 8 23 0 02 Dec 2018
Joint Neural Architecture Search and Quantization Yukang Chen Gaofeng Meng Qian Zhang Xinbang Zhang Liangchen Song Shiming Xiang Chunhong Pan MQ 30 29 0 23 Nov 2018
Self-Referenced Deep Learning Xu Lan Xiatian Zhu S. Gong 27 23 0 19 Nov 2018
Learning to Steer by Mimicking Features from Heterogeneous Auxiliary Networks Yuenan Hou Zheng Ma Slobodan Mitrovic Chen Change Loy 26 64 0 07 Nov 2018
Cogni-Net: Cognitive Feature Learning through Deep Visual Perception Pranay Mukherjee Abhirup Das A. Bhunia P. Roy 8 11 0 01 Nov 2018
Deep Transfer Reinforcement Learning for Text Summarization Yaser Keneshloo Naren Ramakrishnan Chandan K. Reddy 27 37 0 15 Oct 2018
Rethinking the Value of Network Pruning Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell 10 1,453 0 11 Oct 2018
A Closer Look at Structured Pruning for Neural Network Compression Elliot J. Crowley Jack Turner Amos Storkey Michael F. P. O'Boyle 3DPC 29 31 0 10 Oct 2018
Light-Weight RefineNet for Real-Time Semantic Segmentation Vladimir Nekrasov Chunhua Shen Ian Reid SSeg VLM 24 147 0 08 Oct 2018
Ranking Distillation: Learning Compact Ranking Models With High Performance for Recommender System Jiaxi Tang Ke Wang 27 182 0 19 Sep 2018
Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations Vladimir Nekrasov Thanuja Dharmasiri Andrew Spek Tom Drummond Chunhua Shen Ian Reid 29 148 0 13 Sep 2018
SECS: Efficient Deep Stream Processing via Class Skew Dichotomy Boyuan Feng Kun Wan Shu Yang Yufei Ding 33 4 0 07 Sep 2018
2PFPCE: Two-Phase Filter Pruning Based on Conditional Entropy Chuhan Min Aosen Wang Yiran Chen Wenyao Xu Xin Chen 30 41 0 06 Sep 2018
Emotion Recognition in Speech using Cross-Modal Transfer in the Wild Samuel Albanie Arsha Nagrani Andrea Vedaldi Andrew Zisserman CVBM 30 270 0 16 Aug 2018
Error Forward-Propagation: Reusing Feedforward Connections to Propagate Errors in Deep Learning Adam A. Kohan E. Rietman H. Siegelmann 58 24 0 09 Aug 2018
Teacher Guided Architecture Search P. Bashivan Mark Tensen J. DiCarlo 3DV 37 27 0 04 Aug 2018
SlimNets: An Exploration of Deep Model Compression and Acceleration Ini Oguntola Subby Olubeko Chris Sweeney 27 11 0 01 Aug 2018
Filter Distillation for Network Compression Xavier Suau Luca Zappella N. Apostoloff 24 38 0 20 Jul 2018
Toward Interpretable Deep Reinforcement Learning with Linear Model U-Trees Guiliang Liu Oliver Schulte Wang Zhu Qingcan Li AI4CE 17 134 0 16 Jul 2018
FATE: Fast and Accurate Timing Error Prediction Framework for Low Power DNN Accelerator Design J. Zhang S. Garg 21 21 0 02 Jul 2018
Modality Distillation with Multiple Stream Networks for Action Recognition Nuno C. Garcia Pietro Morerio Vittorio Murino 30 181 0 19 Jun 2018
Energy-Constrained Compression for Deep Neural Networks via Weighted Sparse Projection and Layer Input Masking Haichuan Yang Yuhao Zhu Ji Liu CVBM 19 36 0 12 Jun 2018
Distilling Knowledge for Search-based Structured Prediction Yijia Liu Wanxiang Che Huaipeng Zhao Bing Qin Ting Liu 27 22 0 29 May 2018
Tensorial Neural Networks: Generalization of Neural Networks and Application to Model Compression Jiahao Su Jingling Li Bobby Bhattacharjee Furong Huang 16 20 0 25 May 2018
Deploy Large-Scale Deep Neural Networks in Resource Constrained IoT Devices with Local Quantization Region Yi Yang A. Chen Xiaoming Chen Jiang Ji Zhenyang Chen Yan Dai MQ 13 11 0 24 May 2018
Deep learning generalizes because the parameter-function map is biased towards simple functions Guillermo Valle Pérez Chico Q. Camargo A. Louis MLT AI4CE 18 226 0 22 May 2018
Verifiable Reinforcement Learning via Policy Extraction Osbert Bastani Yewen Pu Armando Solar-Lezama OffRL 9 328 0 22 May 2018
Nonparametric Bayesian Deep Networks with Local Competition Konstantinos P. Panousis S. Chatzis Sergios Theodoridis BDL 27 32 0 19 May 2018
Object detection at 200 Frames Per Second Rakesh Mehta Cemalettin Öztürk ObjD 30 61 0 16 May 2018
Hu-Fu: Hardware and Software Collaborative Attack Framework against Neural Networks Wenshuo Li Jincheng Yu Xuefei Ning Pengjun Wang Qi Wei Yu Wang Huazhong Yang AAML 39 61 0 14 May 2018
Born Again Neural Networks Tommaso Furlanello Zachary Chase Lipton Michael Tschannen Laurent Itti Anima Anandkumar 36 1,024 0 12 May 2018
I Have Seen Enough: A Teacher Student Network for Video Classification Using Fewer Frames S. Bhardwaj Mitesh M. Khapra 23 3 0 12 May 2018
Boosting Self-Supervised Learning via Knowledge Transfer M. Noroozi Ananth Vinjimoor Paolo Favaro Hamed Pirsiavash SSL 224 292 0 01 May 2018
The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches Md. Zahangir Alom T. Taha C. Yakopcic Stefan Westberg P. Sidike Mst Shamima Nasrin B. Van Essen A. Awwal V. Asari VLM 29 874 0 03 Mar 2018
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis Tal Ben-Nun Torsten Hoefler GNN 33 703 0 26 Feb 2018
Wide Compression: Tensor Ring Nets Wenqi Wang Yifan Sun Brian Eriksson Wenlin Wang Vaneet Aggarwal 13 168 0 25 Feb 2018