v1v2v3 (latest)

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Christian Szegedy

OOD

ArXiv (abs)PDF HTML

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 11,067 papers shown

Title
Poseidon: A System Architecture for Efficient GPU-based Deep Learning on Multiple Machines Huatian Zhang Zhiting Hu Jinliang Wei P. Xie Gunhee Kim Qirong Ho Eric Xing GNN 54 48 0 19 Dec 2015
Blockout: Dynamic Model Selection for Hierarchical Deep Networks Calvin Murdock Zerui Li Howard Zhou Tom Duerig OOD BDL 77 47 0 16 Dec 2015
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,819 0 10 Dec 2015
Speeding Up Distributed Machine Learning Using Codes Kangwook Lee Maximilian Lam Ramtin Pedarsani Dimitris Papailiopoulos Kannan Ramchandran 221 860 0 08 Dec 2015
Fine-grained Image Classification by Exploring Bipartite-Graph Labels Feng Zhou Yuanqing Lin 84 131 0 08 Dec 2015
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin Dario Amodei Rishita Anubhai Eric Battenberg Carl Case Jared Casper ... Chong-Jun Wang Bo Xiao Dani Yogatama J. Zhan Zhenyao Zhu 154 2,979 0 08 Dec 2015
SSD: Single Shot MultiBox Detector Wen Liu Dragomir Anguelov D. Erhan Christian Szegedy Scott E. Reed Cheng-Yang Fu Alexander C. Berg ObjD BDL 268 29,955 0 08 Dec 2015
PatchBatch: a Batch Augmented Loss for Optical Flow David Gadot Lior Wolf 84 102 0 06 Dec 2015
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems Tianqi Chen Mu Li Yutian Li Min Lin Naiyan Wang Minjie Wang Tianjun Xiao Bing Xu Chiyuan Zhang Zheng Zhang 202 2,251 0 03 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 888 27,463 0 02 Dec 2015
Dynamic Capacity Networks Amjad Almahairi Nicolas Ballas Tim Cooijmans Yin Zheng Hugo Larochelle Aaron Courville 104 97 0 24 Nov 2015
LocNet: Improving Localization Accuracy for Object Detection Spyros Gidaris N. Komodakis ObjD 62 140 0 24 Nov 2015
Where To Look: Focus Regions for Visual Question Answering Kevin J. Shih Saurabh Singh Derek Hoiem 94 462 0 23 Nov 2015
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 321 5,543 0 23 Nov 2015
Data-dependent Initializations of Convolutional Neural Networks Philipp Krahenbuhl Carl Doersch Jeff Donahue Trevor Darrell VLM 99 203 0 21 Nov 2015
Adding Gradient Noise Improves Learning for Very Deep Networks Arvind Neelakantan Luke Vilnis Quoc V. Le Ilya Sutskever Lukasz Kaiser Karol Kurach James Martens AI4CE ODL 85 545 0 21 Nov 2015
The Unreasonable Effectiveness of Noisy Data for Fine-Grained Recognition J. Krause Benjamin Sapp Andrew Howard Howard Zhou Alexander Toshev Tom Duerig James Philbin Fei-Fei Li 71 364 0 20 Nov 2015
Data-Dependent Path Normalization in Neural Networks Behnam Neyshabur Ryota Tomioka Ruslan Salakhutdinov Nathan Srebro 108 22 0 20 Nov 2015
Scalable Gradient-Based Tuning of Continuous Regularization Hyperparameters Jelena Luketina Mathias Berglund Klaus Greff T. Raiko 93 174 0 20 Nov 2015
Compression of Deep Convolutional Neural Networks for Fast and Low Power Mobile Applications Yong-Deok Kim Eunhyeok Park S. Yoo Taelim Choi Lu Yang Dongjun Shin 124 895 0 20 Nov 2015
On the energy landscape of deep networks Pratik Chaudhari Stefano Soatto ODL 92 27 0 20 Nov 2015
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks Alec Radford Luke Metz Soumith Chintala GAN OOD 317 14,040 0 19 Nov 2015
Deconstructing the Ladder Network Architecture Mohammad Pezeshki Linxi Fan Philemon Brakel Aaron Courville Yoshua Bengio 87 98 0 19 Nov 2015
All you need is a good init Dmytro Mishkin Jirí Matas ODL 125 612 0 19 Nov 2015
Learning to Generate Images with Perceptual Similarity Metrics Jake C. Snell Karl Ridgeway Renjie Liao Brett D. Roads Michael C. Mozer R. Zemel EGVM 75 178 0 19 Nov 2015
Fixed Point Quantization of Deep Convolutional Networks D. Lin S. Talathi V. Annapureddy MQ 116 817 0 19 Nov 2015
Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks Jost Tobias Springenberg GAN 89 746 0 19 Nov 2015
Order-Embeddings of Images and Language Ivan Vendrov Ryan Kiros Sanja Fidler R. Urtasun 124 548 0 19 Nov 2015
Online Batch Selection for Faster Training of Neural Networks I. Loshchilov Frank Hutter ODL 125 302 0 19 Nov 2015
Neural network-based clustering using pairwise constraints Yen-Chang Hsu Z. Kira 86 83 0 19 Nov 2015
Robust Convolutional Neural Networks under Adversarial Noise Jonghoon Jin Aysegül Dündar Eugenio Culurciello 79 77 0 19 Nov 2015
Adjustable Bounded Rectifiers: Towards Deep Binary Representations Zhirong Wu Dahua Lin Xiaoou Tang MQ 48 14 0 19 Nov 2015
Learning Deep Structure-Preserving Image-Text Embeddings Liwei Wang Yin Li Svetlana Lazebnik 88 784 0 19 Nov 2015
Reducing Overfitting in Deep Networks by Decorrelating Representations Michael Cogswell Faruk Ahmed Ross B. Girshick C. L. Zitnick Dhruv Batra 109 416 0 19 Nov 2015
Convolutional neural networks with low-rank regularization Cheng Tai Tong Xiao Yi Zhang Xiaogang Wang E. Weinan BDL 119 462 0 19 Nov 2015
Metric Learning with Adaptive Density Discrimination Oren Rippel Manohar Paluri Piotr Dollar Lubomir D. Bourdev 87 215 0 18 Nov 2015
Image Question Answering using Convolutional Neural Network with Dynamic Parameter Prediction Hyeonwoo Noh Paul Hongsuck Seo Bohyung Han OOD 78 327 0 18 Nov 2015
Adversarial Autoencoders Alireza Makhzani Jonathon Shlens Navdeep Jaitly Ian Goodfellow Brendan J. Frey GAN 120 2,229 0 18 Nov 2015
Net2Net: Accelerating Learning via Knowledge Transfer Tianqi Chen Ian Goodfellow Jonathon Shlens 193 672 0 18 Nov 2015
Competitive Multi-scale Convolution Zhibin Liao G. Carneiro 75 45 0 18 Nov 2015
Return of Frustratingly Easy Domain Adaptation Baochen Sun Jiashi Feng Kate Saenko OOD 93 1,845 0 17 Nov 2015
On the interplay of network structure and gradient convergence in deep learning V. Ithapu Sathya Ravi Vikas Singh 54 3 0 17 Nov 2015
An Exploration of Softmax Alternatives Belonging to the Spherical Loss Family A. D. Brébisson Pascal Vincent 92 98 0 16 Nov 2015
Deep Linear Discriminant Analysis Matthias Dorfer Rainer Kelz Gerhard Widmer 91 135 0 15 Nov 2015
Uncovering Temporal Context for Video Question and Answering Linchao Zhu Zhongwen Xu Yi Yang Alexander G. Hauptmann BDL 86 45 0 15 Nov 2015
Unsupervised Learning of Edges Yin Li Manohar Paluri James M. Rehg Piotr Dollár SSL 87 91 0 13 Nov 2015
Representational Distance Learning for Deep Neural Networks Patrick McClure N. Kriegeskorte 78 48 0 12 Nov 2015
Grounding of Textual Phrases in Images by Reconstruction Anna Rohrbach Marcus Rohrbach Ronghang Hu Trevor Darrell Bernt Schiele 86 497 0 12 Nov 2015
Hierarchical Recurrent Neural Encoder for Video Representation with Application to Captioning Pingbo Pan Zhongwen Xu Yi Yang Leilei Gan Yueting Zhuang 59 385 0 11 Nov 2015
Learning with a Strong Adversary Ruitong Huang Bing Xu Dale Schuurmans Csaba Szepesvári AAML 99 358 0 10 Nov 2015