Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 7,097 papers shown

Title
Rich Image Captioning in the Wild Kenneth Tran Xiaodong He Lei Zhang Jian Sun Cornelia Carapcea Chris Thrasher Chris Buehler Chris Sienkiewicz VLM 19 123 0 30 Mar 2016
Shuffle and Learn: Unsupervised Learning using Temporal Order Verification Ishan Misra C. L. Zitnick M. Hebert SSL 28 66 0 28 Mar 2016
Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation Hoo-Chang Shin Kirk Roberts Le Lu Dina Demner-Fushman Jianhua Yao Ronald M. Summers 18 347 0 28 Mar 2016
Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computing S. K. Esser P. Merolla John V. Arthur A. Cassidy R. Appuswamy ... Pallab Datta A. Amir B. Taba M. Flickner D. Modha 3DH 17 714 0 28 Mar 2016
Perceptual Losses for Real-Time Style Transfer and Super-Resolution Justin Johnson Alexandre Alahi Li Fei-Fei SupR 39 10,160 0 27 Mar 2016
Resnet in Resnet: Generalizing Residual Architectures S. Targ Diogo Almeida Kevin Lyman SSeg 14 806 0 25 Mar 2016
Learning Representations for Automatic Colorization Gustav Larsson Michael Maire Gregory Shakhnarovich VLM SSL 34 1,009 0 22 Mar 2016
Deep Learning in Bioinformatics Seonwoo Min Byunghan Lee Sungroh Yoon AI4CE 3DV 36 1,351 0 21 Mar 2016
A Fast Unified Model for Parsing and Sentence Understanding Samuel R. Bowman Jon Gauthier Abhinav Rastogi Raghav Gupta Christopher D. Manning Christopher Potts 22 313 0 19 Mar 2016
Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation Konstantinos Kamnitsas C. Ledig Virginia Newcombe Joanna P. Simpson A. D. Kane David Menon Daniel Rueckert Ben Glocker MedIm 3DV 12 3,037 0 18 Mar 2016
Transferring Learned Microcalcification Group Detection from 2D Mammography to 3D Digital Breast Tomosynthesis Using a Hierarchical Model and Scope-based Normalization Features Yin Yin S. V. Fotin Hrishikesh Haldankar J. Hoffmeister S. Periaswamy 12 4 0 18 Mar 2016
Generative Image Modeling using Style and Structure Adversarial Networks Xinyu Wang Abhinav Gupta GAN 31 617 0 17 Mar 2016
Accelerating Deep Neural Network Training with Inconsistent Stochastic Gradient Descent Linnan Wang Yi Yang Martin Renqiang Min S. Chakradhar 15 91 0 17 Mar 2016
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks Mohammad Rastegari Vicente Ordonez Joseph Redmon Ali Farhadi MQ 54 4,331 0 16 Mar 2016
Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units Wenling Shang Kihyuk Sohn Diogo Almeida Honglak Lee 22 499 0 16 Mar 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 16 10,125 0 16 Mar 2016
Combining the Best of Convolutional Layers and Recurrent Layers: A Hybrid Network for Semantic Segmentation Zhicheng Yan Huan Zhang Yangqing Jia Thomas Breuel Yizhou Yu SSeg 24 41 0 15 Mar 2016
Learning Typographic Style S. Baluja 30 15 0 13 Mar 2016
Texture Networks: Feed-forward Synthesis of Textures and Stylized Images Dmitry Ulyanov V. Lebedev Andrea Vedaldi Victor Lempitsky 3DH 14 942 0 10 Mar 2016
Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection Sergey Levine P. Pastor A. Krizhevsky Deirdre Quillen 6 2,061 0 07 Mar 2016
Normalization Propagation: A Parametric Technique for Removing Internal Covariate Shift in Deep Networks Devansh Arpit Yingbo Zhou Bhargava U. Kota V. Govindaraju 19 126 0 04 Mar 2016
Learning Physical Intuition of Block Towers by Example Adam Lerer Sam Gross Rob Fergus PINN 24 298 0 03 Mar 2016
HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition Rajeev Ranjan Vishal M. Patel Rama Chellappa CVBM 3DH 43 1,219 0 03 Mar 2016
Learning Functions: When Is Deep Better Than Shallow H. Mhaskar Q. Liao T. Poggio 30 144 0 03 Mar 2016
Molecular Graph Convolutions: Moving Beyond Fingerprints S. Kearnes Kevin McCloskey Marc Berndl Vijay S. Pande Patrick F. Riley GNN 52 1,436 0 02 Mar 2016
Cascaded Subpatch Networks for Effective CNNs Xiaoheng Jiang Yanwei Pang Manli Sun Xuelong Li 18 39 0 01 Mar 2016
Scalable and Sustainable Deep Learning via Randomized Hashing Ryan Spring Anshumali Shrivastava 23 132 0 26 Feb 2016
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks Tim Salimans Diederik P. Kingma ODL 93 1,924 0 25 Feb 2016
Learning values across many orders of magnitude H. V. Hasselt A. Guez Matteo Hessel Volodymyr Mnih David Silver 17 169 0 24 Feb 2016
Learning to Generate with Memory Chongxuan Li Jun Zhu Bo Zhang BDL 16 42 0 24 Feb 2016
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning Christian Szegedy Sergey Ioffe Vincent Vanhoucke Alexander A. Alemi 107 14,137 0 23 Feb 2016
Revise Saturated Activation Functions Bing Xu Ruitong Huang Mu Li 19 72 0 18 Feb 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 26 17,032 0 17 Feb 2016
Binarized Neural Networks Itay Hubara Daniel Soudry Ran El-Yaniv MQ 58 1,351 0 08 Feb 2016
Improved Dropout for Shallow and Deep Learning Zhe Li Boqing Gong Tianbao Yang BDL SyDa 30 79 0 06 Feb 2016
Strongly-Typed Recurrent Neural Networks David Balduzzi Muhammad Ghifary PINN 16 60 0 06 Feb 2016
A Kronecker-factored approximate Fisher matrix for convolution layers Roger C. Grosse James Martens ODL 34 258 0 03 Feb 2016
Autoencoding beyond pixels using a learned similarity metric Anders Boesen Lindbo Larsen Søren Kaae Sønderby Hugo Larochelle Ole Winther GAN 49 2,052 0 31 Dec 2015
Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimising Global Loss Functions B. V. Kumar G. Carneiro Ian Reid SSL 35 310 0 31 Dec 2015
Beyond Classification: Latent User Interests Profiling from Visual Contents Analysis Longqi Yang C. Hsieh D. Estrin 16 25 0 21 Dec 2015
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 171 191,365 0 10 Dec 2015
Speeding Up Distributed Machine Learning Using Codes Kangwook Lee Maximilian Lam Ramtin Pedarsani Dimitris Papailiopoulos Kannan Ramchandran 31 853 0 08 Dec 2015
Fine-grained Image Classification by Exploring Bipartite-Graph Labels Feng Zhou Yuanqing Lin 22 130 0 08 Dec 2015
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin Dario Amodei Rishita Anubhai Eric Battenberg Carl Case Jared Casper ... Chong-Jun Wang Bo Xiao Dani Yogatama J. Zhan Zhenyao Zhu 19 2,954 0 08 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 68 27,084 0 02 Dec 2015
Dynamic Capacity Networks Amjad Almahairi Nicolas Ballas Tim Cooijmans Yin Zheng Hugo Larochelle Aaron Courville 30 96 0 24 Nov 2015
LocNet: Improving Localization Accuracy for Object Detection Spyros Gidaris N. Komodakis ObjD 28 140 0 24 Nov 2015
Where To Look: Focus Regions for Visual Question Answering Kevin J. Shih Saurabh Singh Derek Hoiem 34 456 0 23 Nov 2015
Data-dependent Initializations of Convolutional Neural Networks Philipp Krahenbuhl Carl Doersch Jeff Donahue Trevor Darrell VLM 28 202 0 21 Nov 2015
Adding Gradient Noise Improves Learning for Very Deep Networks Arvind Neelakantan Luke Vilnis Quoc V. Le Ilya Sutskever Lukasz Kaiser Karol Kurach James Martens AI4CE ODL 27 541 0 21 Nov 2015