Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

47 / 7,097 papers shown

Title
Scalable Gradient-Based Tuning of Continuous Regularization Hyperparameters Jelena Luketina Mathias Berglund Klaus Greff T. Raiko 27 173 0 20 Nov 2015
On the energy landscape of deep networks Pratik Chaudhari Stefano Soatto ODL 40 27 0 20 Nov 2015
All you need is a good init Dmytro Mishkin Jirí Matas ODL 27 604 0 19 Nov 2015
Learning to Generate Images with Perceptual Similarity Metrics Jake C. Snell Karl Ridgeway Renjie Liao Brett D. Roads Michael C. Mozer R. Zemel EGVM 24 176 0 19 Nov 2015
Fixed Point Quantization of Deep Convolutional Networks D. Lin S. Talathi V. Annapureddy MQ 35 809 0 19 Nov 2015
Order-Embeddings of Images and Language Ivan Vendrov Ryan Kiros Sanja Fidler R. Urtasun 37 542 0 19 Nov 2015
Online Batch Selection for Faster Training of Neural Networks I. Loshchilov Frank Hutter ODL 37 296 0 19 Nov 2015
Neural network-based clustering using pairwise constraints Yen-Chang Hsu Z. Kira 24 83 0 19 Nov 2015
Adjustable Bounded Rectifiers: Towards Deep Binary Representations Zhirong Wu Dahua Lin Xiaoou Tang MQ 16 14 0 19 Nov 2015
Reducing Overfitting in Deep Networks by Decorrelating Representations Michael Cogswell Faruk Ahmed Ross B. Girshick C. L. Zitnick Dhruv Batra 32 411 0 19 Nov 2015
Convolutional neural networks with low-rank regularization Cheng Tai Tong Xiao Yi Zhang Xiaogang Wang E. Weinan BDL 11 460 0 19 Nov 2015
Image Question Answering using Convolutional Neural Network with Dynamic Parameter Prediction Hyeonwoo Noh Paul Hongsuck Seo Bohyung Han OOD 22 327 0 18 Nov 2015
On the interplay of network structure and gradient convergence in deep learning V. Ithapu Sathya Ravi Vikas Singh 18 3 0 17 Nov 2015
An Exploration of Softmax Alternatives Belonging to the Spherical Loss Family A. D. Brébisson Pascal Vincent 11 97 0 16 Nov 2015
Learning Fine-grained Features via a CNN Tree for Large-scale Classification Zhenhua Wang Xingxing Wang G. Wang 28 49 0 14 Nov 2015
Unsupervised Learning of Edges Yin Li Manohar Paluri James M. Rehg Piotr Dollár SSL 21 91 0 13 Nov 2015
Representational Distance Learning for Deep Neural Networks Patrick McClure N. Kriegeskorte 22 48 0 12 Nov 2015
Traffic Sign Classification Using Deep Inception Based Convolutional Networks Mrinal Haloi 14 42 0 10 Nov 2015
The Variational Fair Autoencoder Christos Louizos Kevin Swersky Yujia Li Max Welling R. Zemel DRL 17 632 0 03 Nov 2015
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Vijay Badrinarayanan Alex Kendall R. Cipolla SSeg 446 15,645 0 02 Nov 2015
FireCaffe: near-linear acceleration of deep neural network training on compute clusters F. Iandola Khalid Ashraf Matthew W. Moskewicz Kurt Keutzer 19 302 0 31 Oct 2015
How Important is Weight Symmetry in Backpropagation? Q. Liao Joel Z Leibo T. Poggio 11 167 0 17 Oct 2015
Improving Back-Propagation by Adding an Adversarial Gradient Arild Nøkland AAML 24 32 0 14 Oct 2015
Batch Normalized Recurrent Neural Networks César Laurent Gabriel Pereyra Philemon Brakel Wenjie Qu Yoshua Bengio 30 213 0 05 Oct 2015
A Primer on Neural Network Models for Natural Language Processing Yoav Goldberg AI4CE 50 1,128 0 02 Oct 2015
Feature Evaluation of Deep Convolutional Neural Networks for Object Recognition and Detection Hirokatsu Kataoka K. Iwata Y. Satoh ObjD 33 19 0 25 Sep 2015
Model Accuracy and Runtime Tradeoff in Distributed Deep Learning:A Systematic Study Suyog Gupta Wei Zhang Fei Wang 11 170 0 14 Sep 2015
Hierarchical Deep Learning Architecture For 10K Objects Classification A. Katole Krishna Prasad Yellapragada A. K. Bedi S. S. Kalra M. S. Chaitanya BDL OCL 19 25 0 07 Sep 2015
Deep Convolutional Neural Networks for Smile Recognition P. Glauner CVBM 22 38 0 26 Aug 2015
What is Holding Back Convnets for Detection? Bojan Pepik Rodrigo Benenson Tobias Ritschel Bernt Schiele ObjD 24 64 0 12 Aug 2015
Using Deep Learning for Detecting Spoofing Attacks on Speech Signals Alan Godoy F. Simões J. Stuchi M. A. Angeloni Mário Uliani Neto R. P. V. Violato AAML 13 6 0 07 Aug 2015
Compact Convolutional Neural Network Cascade for Face Detection Ilya Kalinowski V. Spitsyn CVBM 24 35 0 06 Aug 2015
An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition Baoguang Shi X. Bai Cong Yao VLM 58 2,460 0 21 Jul 2015
Convolutional networks and learning invariant to homogeneous multiplicative scalings M. Tygert Arthur Szlam Soumith Chintala MarcÁurelio Ranzato Yuandong Tian Wojciech Zaremba 21 12 0 26 Jun 2015
Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks Samy Bengio Oriol Vinyals Navdeep Jaitly Noam M. Shazeer 60 2,018 0 09 Jun 2015
Path-SGD: Path-Normalized Optimization in Deep Neural Networks Behnam Neyshabur Ruslan Salakhutdinov Nathan Srebro ODL 21 305 0 08 Jun 2015
Stacked What-Where Auto-encoders J. Zhao Michaël Mathieu Ross Goroshin Yann LeCun DiffM BDL 24 258 0 08 Jun 2015
Efficient Large Scale Video Classification Balakrishnan Varadarajan G. Toderici Sudheendra Vijayanarasimhan Apostol Natsev 21 23 0 22 May 2015
Empirical Evaluation of Rectified Activations in Convolutional Network Bing Xu Naiyan Wang Tianqi Chen Mu Li 77 2,894 0 05 May 2015
Lateral Connections in Denoising Autoencoders Support Supervised Learning Antti Rasmus Harri Valpola T. Raiko 27 22 0 30 Apr 2015
Correlational Neural Networks A. Chandar Mitesh M. Khapra Hugo Larochelle Balaraman Ravindran CML 34 142 0 27 Apr 2015
Object Detection Networks on Convolutional Feature Maps Shaoqing Ren Kaiming He Ross B. Girshick Xinming Zhang Jian Sun ObjD 27 407 0 23 Apr 2015
When Face Recognition Meets with Deep Learning: an Evaluation of Convolutional Neural Networks for Face Recognition Guosheng Hu Yongxin Yang Dong Yi J. Kittler William Christmas Stan Z. Li Timothy M. Hospedales CVBM 3DV 33 316 0 09 Apr 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 29 18,455 0 06 Feb 2015
Deep Image: Scaling up Image Recognition Ren Wu Shengen Yan Yi Shan Qingqing Dang Gang Sun VLM 41 373 0 13 Jan 2015
MatConvNet - Convolutional Neural Networks for MATLAB Andrea Vedaldi Karel Lenc 183 2,946 0 15 Dec 2014
Show and Tell: A Neural Image Caption Generator Oriol Vinyals Alexander Toshev Samy Bengio D. Erhan 3DV 56 5,993 0 17 Nov 2014