v1v2v3 (latest)

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Christian Szegedy

OOD

ArXiv (abs)PDF HTML

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 11,067 papers shown

Title
Deep Learning in Bioinformatics Seonwoo Min Byunghan Lee Sungroh Yoon AI4CE 3DV 112 1,363 0 21 Mar 2016
A Fast Unified Model for Parsing and Sentence Understanding Samuel R. Bowman Jon Gauthier Abhinav Rastogi Raghav Gupta Christopher D. Manning Christopher Potts 69 314 0 19 Mar 2016
Efficient Multi-Scale 3D CNN with Fully Connected CRF for Accurate Brain Lesion Segmentation Konstantinos Kamnitsas C. Ledig Virginia Newcombe Joanna P. Simpson A. D. Kane David Menon Daniel Rueckert Ben Glocker MedIm 3DV 169 3,062 0 18 Mar 2016
Transferring Learned Microcalcification Group Detection from 2D Mammography to 3D Digital Breast Tomosynthesis Using a Hierarchical Model and Scope-based Normalization Features Yin Yin S. V. Fotin Hrishikesh Haldankar J. Hoffmeister S. Periaswamy 21 4 0 18 Mar 2016
Generative Image Modeling using Style and Structure Adversarial Networks Xinyu Wang Abhinav Gupta GAN 130 618 0 17 Mar 2016
Accelerating Deep Neural Network Training with Inconsistent Stochastic Gradient Descent Linnan Wang Yi Yang Martin Renqiang Min S. Chakradhar 92 93 0 17 Mar 2016
Neural Aggregation Network for Video Face Recognition Jiaolong Yang Peiran Ren Dongqing Zhang Dong Chen Fang Wen Hongdong Li G. Hua CVBM 3DH 106 374 0 17 Mar 2016
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks Mohammad Rastegari Vicente Ordonez Joseph Redmon Ali Farhadi MQ 190 4,371 0 16 Mar 2016
Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Units Wenling Shang Kihyuk Sohn Diogo Almeida Honglak Lee 76 506 0 16 Mar 2016
Suppressing the Unusual: towards Robust CNNs using Symmetric Activation Functions Qiyang Zhao Lewis D. Griffin AAML 71 28 0 16 Mar 2016
Identity Mappings in Deep Residual Networks Kaiming He Xinming Zhang Shaoqing Ren Jian Sun 364 10,212 0 16 Mar 2016
Combining the Best of Convolutional Layers and Recurrent Layers: A Hybrid Network for Semantic Segmentation Zhicheng Yan Huatian Zhang Yangqing Jia Thomas Breuel Yizhou Yu SSeg 75 41 0 15 Mar 2016
Revisiting Batch Normalization For Practical Domain Adaptation Yanghao Li Naiyan Wang Jianping Shi Jiaying Liu Xiaodi Hou OOD 99 590 0 15 Mar 2016
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems Martín Abadi Ashish Agarwal P. Barham E. Brevdo Zhiwen Chen ... Pete Warden Martin Wattenberg Martin Wicke Yuan Yu Xiaoqiang Zheng 294 11,160 0 14 Mar 2016
Learning Typographic Style S. Baluja 73 15 0 13 Mar 2016
Texture Networks: Feed-forward Synthesis of Textures and Stylized Images Dmitry Ulyanov V. Lebedev Andrea Vedaldi Victor Lempitsky 3DH 69 948 0 10 Mar 2016
Low-rank passthrough neural networks Antonio Valerio Miceli Barone 73 14 0 10 Mar 2016
DROW: Real-Time Deep Learning based Wheelchair Detection in 2D Range Data Lucas Beyer Alexander Hermans Bastian Leibe 55 42 0 08 Mar 2016
Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection Sergey Levine P. Pastor A. Krizhevsky Deirdre Quillen 200 2,076 0 07 Mar 2016
Normalization Propagation: A Parametric Technique for Removing Internal Covariate Shift in Deep Networks Devansh Arpit Yingbo Zhou Bhargava U. Kota V. Govindaraju 107 127 0 04 Mar 2016
Learning Physical Intuition of Block Towers by Example Adam Lerer Sam Gross Rob Fergus PINN 101 300 0 03 Mar 2016
HyperFace: A Deep Multi-task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition Rajeev Ranjan Vishal M. Patel Rama Chellappa CVBM 3DH 107 1,227 0 03 Mar 2016
Learning Functions: When Is Deep Better Than Shallow H. Mhaskar Q. Liao T. Poggio 103 144 0 03 Mar 2016
Molecular Graph Convolutions: Moving Beyond Fingerprints S. Kearnes Kevin McCloskey Marc Berndl Vijay S. Pande Patrick F. Riley GNN 171 1,451 0 02 Mar 2016
Cascaded Subpatch Networks for Effective CNNs Xiaoheng Jiang Yanwei Pang Manli Sun Xuelong Li 68 39 0 01 Mar 2016
Scalable and Sustainable Deep Learning via Randomized Hashing Ryan Spring Anshumali Shrivastava 96 133 0 26 Feb 2016
Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks Tim Salimans Diederik P. Kingma ODL 207 1,947 0 25 Feb 2016
Learning values across many orders of magnitude H. V. Hasselt A. Guez Matteo Hessel Volodymyr Mnih David Silver 88 170 0 24 Feb 2016
Group Equivariant Convolutional Networks Taco S. Cohen Max Welling BDL 184 1,947 0 24 Feb 2016
Learning to Generate with Memory Chongxuan Li Jun Zhu Bo Zhang BDL 123 42 0 24 Feb 2016
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size F. Iandola Song Han Matthew W. Moskewicz Khalid Ashraf W. Dally Kurt Keutzer 180 7,510 0 24 Feb 2016
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning Christian Szegedy Sergey Ioffe Vincent Vanhoucke Alexander A. Alemi 384 14,301 0 23 Feb 2016
Revise Saturated Activation Functions Bing Xu Ruitong Huang Mu Li 77 73 0 18 Feb 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 441 17,708 0 17 Feb 2016
Auxiliary Deep Generative Models Lars Maaløe C. Sønderby Søren Kaae Sønderby Ole Winther DRL GAN 94 451 0 17 Feb 2016
PlaNet - Photo Geolocation with Convolutional Neural Networks Tobias Weyand Ilya Kostrikov James Philbin 78 421 0 17 Feb 2016
Generating images with recurrent adversarial networks Daniel Jiwoong Im C. Kim Hui Jiang Roland Memisevic GAN 113 223 0 16 Feb 2016
Binarized Neural Networks Itay Hubara Daniel Soudry Ran El-Yaniv MQ 222 1,348 0 08 Feb 2016
Ladder Variational Autoencoders C. Sønderby T. Raiko Lars Maaløe Søren Kaae Sønderby Ole Winther BDL DRL 110 915 0 06 Feb 2016
Improved Dropout for Shallow and Deep Learning Zhe Li Boqing Gong Tianbao Yang BDL SyDa 101 78 0 06 Feb 2016
Strongly-Typed Recurrent Neural Networks David Balduzzi Muhammad Ghifary PINN 92 62 0 06 Feb 2016
Recognition of Visually Perceived Compositional Human Actions by Multiple Spatio-Temporal Scales Recurrent Neural Networks Haanvid Lee Minju Jung Jun Tani 67 20 0 05 Feb 2016
A Kronecker-factored approximate Fisher matrix for convolution layers Roger C. Grosse James Martens ODL 110 265 0 03 Feb 2016
Hybrid CNN and Dictionary-Based Models for Scene Recognition and Domain Adaptation Guosen Xie Xu-Yao Zhang Shuicheng Yan Cheng-Lin Liu ObjD 81 150 0 29 Jan 2016
Autoencoding beyond pixels using a learned similarity metric Anders Boesen Lindbo Larsen Søren Kaae Sønderby Hugo Larochelle Ole Winther GAN 192 2,079 0 31 Dec 2015
Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimising Global Loss Functions B. V. Kumar G. Carneiro Ian Reid SSL 101 312 0 31 Dec 2015
Structured Pruning of Deep Convolutional Neural Networks S. Anwar Kyuyeon Hwang Wonyong Sung 143 749 0 29 Dec 2015
Visually Indicated Sounds Andrew Owens Phillip Isola Josh H. McDermott Antonio Torralba Edward H. Adelson William T. Freeman 122 386 0 28 Dec 2015
Recent Advances in Convolutional Neural Networks Jiuxiang Gu Zhenhua Wang Jason Kuen Lianyang Ma Amir Shahroudy ... Xingxing Wang Li Wang Gang Wang Jianfei Cai Tsuhan Chen 248 5,253 0 22 Dec 2015
Beyond Classification: Latent User Interests Profiling from Visual Contents Analysis Longqi Yang C. Hsieh D. Estrin 32 25 0 21 Dec 2015