Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
1806.02375
Cited By
v1
v2
v3
v4 (latest)
Understanding Batch Normalization
1 June 2018
Johan Bjorck
Carla P. Gomes
B. Selman
Kilian Q. Weinberger
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Understanding Batch Normalization"
50 / 224 papers shown
Title
Group Whitening: Balancing Learning Efficiency and Representational Capacity
Lei Huang
Yi Zhou
Li Liu
Fan Zhu
Ling Shao
108
22
0
28 Sep 2020
Normalization Techniques in Training DNNs: Methodology, Analysis and Application
Lei Huang
Jie Qin
Yi Zhou
Fan Zhu
Li Liu
Ling Shao
AI4CE
176
275
0
27 Sep 2020
Encoding Robustness to Image Style via Adversarial Feature Perturbations
Manli Shu
Zuxuan Wu
Micah Goldblum
Tom Goldstein
AAML
OOD
75
19
0
18 Sep 2020
A Principle of Least Action for the Training of Neural Networks
Skander Karkar
Ibrahhim Ayed
Emmanuel de Bézenac
Patrick Gallinari
AI4CE
69
10
0
17 Sep 2020
Review: Deep Learning in Electron Microscopy
Jeffrey M. Ede
197
80
0
17 Sep 2020
XCM: An Explainable Convolutional Neural Network for Multivariate Time Series Classification
Kevin Fauvel
Tao R. Lin
Véronique Masson
Elisa Fromont
Alexandre Termier
BDL
AI4TS
39
102
0
10 Sep 2020
Training Deep Neural Networks Without Batch Normalization
D. Gaur
Joachim Folz
Andreas Dengel
ODL
54
10
0
18 Aug 2020
An Ensemble of Simple Convolutional Neural Network Models for MNIST Digit Recognition
Sanghyeon An
Min Jun Lee
Sanglee Park
H. Yang
Jungmin So
87
79
0
12 Aug 2020
SimPose: Effectively Learning DensePose and Surface Normals of People from Simulated Data
Tyler Lixuan Zhu
Per Karlsson
C. Bregler
3DH
108
30
0
30 Jul 2020
A New Look at Ghost Normalization
Neofytos Dimitriou
Ognjen Arandjelovic
135
8
0
16 Jul 2020
Learning Representations that Support Extrapolation
Taylor Webb
Zachary Dulberg
Steven M. Frankland
A. Petrov
R. C. O'Reilly
Jonathan Cohen
90
51
0
09 Jul 2020
Testing match-3 video games with Deep Reinforcement Learning
Nicholas Napolitano
15
3
0
30 Jun 2020
On the Generalization Benefit of Noise in Stochastic Gradient Descent
Samuel L. Smith
Erich Elsen
Soham De
MLT
62
100
0
26 Jun 2020
Diffusion-Weighted Magnetic Resonance Brain Images Generation with Generative Adversarial Networks and Variational Autoencoders: A Comparison Study
Alejandro Ungría Hirte
Moritz Platscher
T. Joyce
J. Heit
E. Tranvinh
C. Federau
MedIm
DiffM
24
6
0
24 Jun 2020
Spherical Perspective on Learning with Normalization Layers
Simon Roburin
Yann de Mont-Marin
Andrei Bursuc
Renaud Marlet
P. Pérez
Mathieu Aubry
54
6
0
23 Jun 2020
DO-Conv: Depthwise Over-parameterized Convolutional Layer
Jinming Cao
Yangyan Li
Mingchao Sun
Ying-Cong Chen
Dani Lischinski
Daniel Cohen-Or
Baoquan Chen
Changhe Tu
OOD
98
173
0
22 Jun 2020
Towards an Adversarially Robust Normalization Approach
Muhammad Awais
Fahad Shamshad
Sung-Ho Bae
AAML
OOD
114
19
0
19 Jun 2020
New Interpretations of Normalization Methods in Deep Learning
Jiacheng Sun
Xiangyong Cao
Hanwen Liang
Weiran Huang
Zewei Chen
Zhenguo Li
68
35
0
16 Jun 2020
Optimization Theory for ReLU Neural Networks Trained with Normalization Layers
Yonatan Dukler
Quanquan Gu
Guido Montúfar
83
30
0
11 Jun 2020
Finet: Using Fine-grained Batch Normalization to Train Light-weight Neural Networks
Chunjie Luo
Jianfeng Zhan
Lei Wang
Wanling Gao
137
1
0
14 May 2020
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization
Wenxuan Zhou
Bill Yuchen Lin
Xiang Ren
100
25
0
02 May 2020
SIPA: A Simple Framework for Efficient Networks
Gihun Lee
Sangmin Bae
Jaehoon Oh
Seyoung Yun
19
1
0
24 Apr 2020
Gradient Centralization: A New Optimization Technique for Deep Neural Networks
Hongwei Yong
Jianqiang Huang
Xiansheng Hua
Lei Zhang
ODL
97
188
0
03 Apr 2020
Controllable Orthogonalization in Training DNNs
Lei Huang
Li Liu
Fan Zhu
Diwen Wan
Zehuan Yuan
Bo Li
Ling Shao
87
44
0
02 Apr 2020
An Investigation into the Stochasticity of Batch Whitening
Lei Huang
Lei Zhao
Yi Zhou
Fan Zhu
Li Liu
Ling Shao
113
19
0
27 Mar 2020
What Deep CNNs Benefit from Global Covariance Pooling: An Optimization Perspective
Qilong Wang
Li Zhang
Banggu Wu
Dongwei Ren
P. Li
W. Zuo
Q. Hu
75
21
0
25 Mar 2020
Geometric Approaches to Increase the Expressivity of Deep Neural Networks for MR Reconstruction
Eunju Cha
Gyutaek Oh
J. C. Ye
108
12
0
17 Mar 2020
Extended Batch Normalization
Chunjie Luo
Jianfeng Zhan
Lei Wang
Wanling Gao
134
14
0
12 Mar 2020
Batch Normalization Provably Avoids Rank Collapse for Randomly Initialised Deep Networks
Hadi Daneshmand
Jonas Köhler
Francis R. Bach
Thomas Hofmann
Aurelien Lucchi
OOD
ODL
58
4
0
03 Mar 2020
Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs
Jonathan Frankle
D. Schwab
Ari S. Morcos
115
143
0
29 Feb 2020
On Feature Normalization and Data Augmentation
Boyi Li
Felix Wu
Ser-Nam Lim
Serge J. Belongie
Kilian Q. Weinberger
56
137
0
25 Feb 2020
Layer-wise Conditioning Analysis in Exploring the Learning Dynamics of DNNs
Lei Huang
Jie Qin
Li Liu
Fan Zhu
Ling Shao
AI4CE
86
11
0
25 Feb 2020
Batch Normalization Biases Residual Blocks Towards the Identity Function in Deep Networks
Soham De
Samuel L. Smith
ODL
106
20
0
24 Feb 2020
The Break-Even Point on Optimization Trajectories of Deep Neural Networks
Stanislaw Jastrzebski
Maciej Szymczak
Stanislav Fort
Devansh Arpit
Jacek Tabor
Kyunghyun Cho
Krzysztof J. Geras
88
164
0
21 Feb 2020
Regularizing activations in neural networks via distribution matching with the Wasserstein metric
Taejong Joo
Donggu Kang
Byunghoon Kim
76
8
0
13 Feb 2020
How Does BN Increase Collapsed Neural Network Filters?
Sheng Zhou
Xinjiang Wang
Ping Luo
Xue Jiang
Wenjie Li
Wei Zhang
45
1
0
30 Jan 2020
Evolution of Image Segmentation using Deep Convolutional Neural Network: A Survey
F. Sultana
Abu Sufian
P. Dutta
SSeg
141
258
0
13 Jan 2020
Empirical Studies on the Properties of Linear Regions in Deep Neural Networks
Xiao Zhang
Dongrui Wu
58
38
0
04 Jan 2020
Optimization for deep learning: theory and algorithms
Ruoyu Sun
ODL
137
169
0
19 Dec 2019
Mean Shift Rejection: Training Deep Neural Networks Without Minibatch Statistics or Normalization
B. Ruff
Taylor Beck
Joscha Bach
52
3
0
29 Nov 2019
Understanding and Improving Layer Normalization
Jingjing Xu
Xu Sun
Zhiyuan Zhang
Guangxiang Zhao
Junyang Lin
FAtt
122
360
0
16 Nov 2019
Machine Learning Systems for Highly-Distributed and Rapidly-Growing Data
Kevin Hsieh
SyDa
OOD
45
4
0
18 Oct 2019
Root Mean Square Layer Normalization
Biao Zhang
Rico Sennrich
121
766
0
16 Oct 2019
An Exponential Learning Rate Schedule for Deep Learning
Zhiyuan Li
Sanjeev Arora
74
219
0
16 Oct 2019
The Non-IID Data Quagmire of Decentralized Machine Learning
Kevin Hsieh
Amar Phanishayee
O. Mutlu
Phillip B. Gibbons
192
576
0
01 Oct 2019
U-Net Training with Instance-Layer Normalization
Xiao-Yun Zhou
Peichao Li
Zhao-Yang Wang
Guang-Zhong Yang
50
9
0
21 Aug 2019
Neural Architecture Search by Estimation of Network Structure Distributions
A. Muravev
Jenni Raitoharju
Moncef Gabbouj
OOD
20
1
0
19 Aug 2019
Towards Better Generalization: BP-SVRG in Training Deep Neural Networks
Hao Jin
Dachao Lin
Zhihua Zhang
ODL
42
2
0
18 Aug 2019
Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise
Senwei Liang
Zhongzhan Huang
Mingfu Liang
Haizhao Yang
102
59
0
12 Aug 2019
How Does Learning Rate Decay Help Modern Neural Networks?
Kaichao You
Mingsheng Long
Jianmin Wang
Michael I. Jordan
68
4
0
05 Aug 2019
Previous
1
2
3
4
5
Next