Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 7,858 papers shown

Title
Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile Applications Yong-Deok Kim Eunhyeok Park S. Yoo Taelim Choi Lu Yang Dongjun Shin 40 891 0 20 Nov 2015
On the energy landscape of deep networks Pratik Chaudhari Stefano Soatto ODL 43 27 0 20 Nov 2015
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks Alec Radford Luke Metz Soumith Chintala GAN OOD 146 13,937 0 19 Nov 2015
All you need is a good init Dmytro Mishkin Jirí Matas ODL 32 605 0 19 Nov 2015
Learning to Generate Images with Perceptual Similarity Metrics Jake C. Snell Karl Ridgeway Renjie Liao Brett D. Roads Michael C. Mozer R. Zemel EGVM 27 177 0 19 Nov 2015
Fixed Point Quantization of Deep Convolutional Networks D. Lin S. Talathi V. Annapureddy MQ 44 811 0 19 Nov 2015
Order-Embeddings of Images and Language Ivan Vendrov Ryan Kiros Sanja Fidler R. Urtasun 37 543 0 19 Nov 2015
Online Batch Selection for Faster Training of Neural Networks I. Loshchilov Frank Hutter ODL 37 298 0 19 Nov 2015
Neural network-based clustering using pairwise constraints Yen-Chang Hsu Z. Kira 32 83 0 19 Nov 2015
Adjustable Bounded Rectifiers: Towards Deep Binary Representations Zhirong Wu Dahua Lin Xiaoou Tang MQ 19 14 0 19 Nov 2015
Reducing Overfitting in Deep Networks by Decorrelating Representations Michael Cogswell Faruk Ahmed Ross B. Girshick C. L. Zitnick Dhruv Batra 32 411 0 19 Nov 2015
Convolutional neural networks with low-rank regularization Cheng Tai Tong Xiao Yi Zhang Xiaogang Wang E. Weinan BDL 31 460 0 19 Nov 2015
Image Question Answering using Convolutional Neural Network with Dynamic Parameter Prediction Hyeonwoo Noh Paul Hongsuck Seo Bohyung Han OOD 33 327 0 18 Nov 2015
Competitive Multi-scale Convolution Zhibin Liao G. Carneiro 33 44 0 18 Nov 2015
On the interplay of network structure and gradient convergence in deep learning V. Ithapu Sathya Ravi Vikas Singh 23 3 0 17 Nov 2015
An Exploration of Softmax Alternatives Belonging to the Spherical Loss Family A. D. Brébisson Pascal Vincent 19 97 0 16 Nov 2015
Uncovering Temporal Context for Video Question and Answering Linchao Zhu Zhongwen Xu Yi Yang Alexander G. Hauptmann BDL 27 44 0 15 Nov 2015
Learning Fine-grained Features via a CNN Tree for Large-scale Classification Zhenhua Wang Xingxing Wang G. Wang 28 49 0 14 Nov 2015
Unsupervised Learning of Edges Yin Li Manohar Paluri James M. Rehg Piotr Dollár SSL 21 91 0 13 Nov 2015
Representational Distance Learning for Deep Neural Networks Patrick McClure N. Kriegeskorte 27 48 0 12 Nov 2015
Hierarchical Recurrent Neural Encoder for Video Representation with Application to Captioning Pingbo Pan Zhongwen Xu Yi Yang Fei Wu Yueting Zhuang 24 385 0 11 Nov 2015
TemplateNet for Depth-Based Object Instance Recognition Ujwal D. Bonde Vijay Badrinarayanan R. Cipolla Minh-Tri Pham 16 1 0 10 Nov 2015
Traffic Sign Classification Using Deep Inception Based Convolutional Networks Mrinal Haloi 22 42 0 10 Nov 2015
How far can we go without convolution: Improving fully-connected networks Zhouhan Lin Roland Memisevic K. Konda 35 50 0 09 Nov 2015
Symmetry-invariant optimization in deep networks Vijay Badrinarayanan Bamdev Mishra R. Cipolla ODL 19 31 0 05 Nov 2015
The Variational Fair Autoencoder Christos Louizos Kevin Swersky Yujia Li Max Welling R. Zemel DRL 51 632 0 03 Nov 2015
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Vijay Badrinarayanan Alex Kendall R. Cipolla SSeg 454 15,657 0 02 Nov 2015
FireCaffe: near-linear acceleration of deep neural network training on compute clusters F. Iandola Khalid Ashraf Matthew W. Moskewicz Kurt Keutzer 24 302 0 31 Oct 2015
How Important is Weight Symmetry in Backpropagation? Q. Liao Joel Z Leibo T. Poggio 20 167 0 17 Oct 2015
Improving Back-Propagation by Adding an Adversarial Gradient Arild Nøkland AAML 32 32 0 14 Oct 2015
Better Exploiting OS-CNNs for Better Event Recognition in Images Limin Wang Zhe Wang Sheng Guo Yu Qiao 30 24 0 14 Oct 2015
Batch Normalized Recurrent Neural Networks César Laurent Gabriel Pereyra Philemon Brakel Wenjie Qu Yoshua Bengio 38 213 0 05 Oct 2015
A Primer on Neural Network Models for Natural Language Processing Yoav Goldberg AI4CE 50 1,129 0 02 Oct 2015
Feature Evaluation of Deep Convolutional Neural Networks for Object Recognition and Detection Hirokatsu Kataoka K. Iwata Y. Satoh ObjD 33 19 0 25 Sep 2015
Model Accuracy and Runtime Tradeoff in Distributed Deep Learning:A Systematic Study Suyog Gupta Wei Zhang Fei Wang 17 170 0 14 Sep 2015
Continuous control with deep reinforcement learning Timothy Lillicrap Jonathan J. Hunt Alexander Pritzel N. Heess Tom Erez Yuval Tassa David Silver Daan Wierstra 49 13,120 0 09 Sep 2015
Hierarchical Deep Learning Architecture For 10K Objects Classification A. Katole Krishna Prasad Yellapragada A. K. Bedi S. S. Kalra M. S. Chaitanya BDL OCL 27 25 0 07 Sep 2015
CNN Based Hashing for Image Retrieval J. Guo Jianmin Li 11 17 0 04 Sep 2015
Deep Convolutional Neural Networks for Smile Recognition P. Glauner CVBM 22 38 0 26 Aug 2015
What is Holding Back Convnets for Detection? Bojan Pepik Rodrigo Benenson Tobias Ritschel Bernt Schiele ObjD 24 64 0 12 Aug 2015
Using Deep Learning for Detecting Spoofing Attacks on Speech Signals Alan Godoy F. Simões J. Stuchi M. A. Angeloni Mário Uliani Neto R. P. V. Violato AAML 18 6 0 07 Aug 2015
Compact Convolutional Neural Network Cascade for Face Detection Ilya Kalinowski V. Spitsyn CVBM 24 35 0 06 Aug 2015
An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition Baoguang Shi X. Bai Cong Yao VLM 67 2,461 0 21 Jul 2015
Convolutional networks and learning invariant to homogeneous multiplicative scalings M. Tygert Arthur Szlam Soumith Chintala MarcÁurelio Ranzato Yuandong Tian Wojciech Zaremba 24 12 0 26 Jun 2015
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks Samy Bengio Oriol Vinyals Navdeep Jaitly Noam M. Shazeer 75 2,020 0 09 Jun 2015
Path-SGD: Path-Normalized Optimization in Deep Neural Networks Behnam Neyshabur Ruslan Salakhutdinov Nathan Srebro ODL 32 305 0 08 Jun 2015
Stacked What-Where Auto-encoders Jun Zhao Michaël Mathieu Ross Goroshin Yann LeCun DiffM BDL 24 258 0 08 Jun 2015
Efficient Large Scale Video Classification Balakrishnan Varadarajan G. Toderici Sudheendra Vijayanarasimhan Apostol Natsev 37 23 0 22 May 2015
Object detection via a multi-region & semantic segmentation-aware CNN model Spyros Gidaris N. Komodakis ObjD SSeg 33 735 0 07 May 2015
Empirical Evaluation of Rectified Activations in Convolutional Network Bing Xu Naiyan Wang Tianqi Chen Mu Li 83 2,896 0 05 May 2015