Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 6,919 papers shown

Title
Learning Volumetric Neural Deformable Models to Recover 3D Regional Heart Wall Motion from Multi-Planar Tagged MRI Meng Ye Bingyu Xin Bangwei Guo L. Axel Dimitris N. Metaxas 64 0 0 21 Nov 2024
Efficient Medicinal Image Transmission and Resolution Enhancement via GAN Rishabh Kumar Sharma Mukund Sharma Pushkar Sharma Jeetashree Aparjeeta MedIm 67 0 0 19 Nov 2024
Data-efficient Tactile Sensing with Electrical Impedance Tomography Huazhi Dong Ronald B. Liu Leo Micklem Peisan Sharel E F. G. Serchi Yunjie Yang 60 1 0 19 Nov 2024
Towards Accurate and Efficient Sub-8-Bit Integer Training Wenjin Guo Donglai Liu Weiying Xie Yunsong Li Xuefei Ning Zihan Meng Shulin Zeng Jie Lei Zhenman Fang Yu Wang MQ 34 1 0 17 Nov 2024
ChannelDropBack: Forward-Consistent Stochastic Regularization for Deep Networks Evgeny Hershkovitch Neiterman Gil Ben-Artzi 53 0 0 16 Nov 2024
Deep Feature Response Discriminative Calibration Wenxiang Xu Tian Qiu Linyun Zhou Zunlei Feng Xiuming Zhang Huiqiong Wang 77 0 0 16 Nov 2024
Content-Aware Preserving Image Generation Giang H. Le Anh Q. Nguyen Byeongkeun Kang Yeejin Lee DiffM 41 0 0 15 Nov 2024
Long-Tailed Object Detection Pre-training: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction Chen-Long Duan Yong Li Xiu-Shen Wei Lin Zhao 36 1 0 14 Nov 2024
D4W: Dependable Data-Driven Dynamics for Wheeled Robots Yunfeng Lin Minghuan Liu Yong Yu 46 0 0 14 Nov 2024
Compression Method for Solar Polarization Spectra Collected from Hinode SOT/SP Observations Jargalmaa Batmunkh Yusuke Iida Takayoshi Oba Haruhisa Iijima 21 1 0 14 Nov 2024
Complexity-Aware Training of Deep Neural Networks for Optimal Structure Discovery Valentin Frank Ingmar Guenter Athanasios Sideris CVBM 23 0 0 14 Nov 2024
A Composite Fault Diagnosis Model for NPPs Based on Bayesian-EfficientNet Module Siwei Li Jiangwen Chen Hua Lin Wei Wang 64 0 0 13 Nov 2024
An Interpretable X-ray Style Transfer via Trainable Local Laplacian Filter Dominik Eckert L. Ritschl Christopher Syben Christian Hümmer Julia Wicklein M. Beister Steffen Kappler Sebastian Stober MedIm 34 0 0 11 Nov 2024
Spatially Constrained Transformer with Efficient Global Relation Modelling for Spatio-Temporal Prediction Ashutosh Sao Simon Gottschalk AI4TS 39 0 0 11 Nov 2024
Slowing Down Forgetting in Continual Learning Pascal Janetzky Tobias Schlagenhauf Stefan Feuerriegel CLL 34 0 0 11 Nov 2024
Filling in Missing FX Implied Volatilities with Uncertainties: Improving VAE-Based Volatility Imputation Achintya Gopal 16 0 0 08 Nov 2024
Alternative Learning Paradigms for Image Quality Transfer A. Eldaly Matteo Figini Daniel C. Alexander OOD 40 0 0 08 Nov 2024
Poor Man's Training on MCUs: A Memory-Efficient Quantized Back-Propagation-Free Approach Yequan Zhao Hai Li Ian Young Zheng-Wei Zhang MQ 39 2 0 07 Nov 2024
Soft Hoeffding Tree: A Transparent and Differentiable Model on Data Streams Kirsten Köbschall Lisa Hartung Stefan Kramer 19 0 0 07 Nov 2024
wav2sleep: A Unified Multi-Modal Approach to Sleep Stage Classification from Physiological Signals Jonathan Carter Lionel Tarassenko MLAU 45 0 0 07 Nov 2024
Harmformer: Harmonic Networks Meet Transformers for Continuous Roto-Translation Equivariance Tomáš Karella Adam Harmanec J. Kotera Jan Blažek F. Šroubek 50 1 0 06 Nov 2024
UnityGraph: Unified Learning of Spatio-temporal features for Multi-person Motion Prediction Kehua Qu Rui Ding Jin Tang 3DH 31 0 0 06 Nov 2024
Relation Learning and Aggregate-attention for Multi-person Motion Prediction Kehua Qu Rui Ding Jin Tang 3DH 42 0 0 06 Nov 2024
Cross Feature Fusion of Fundus Image and Generated Lesion Map for Referable Diabetic Retinopathy Classification Dahyun Mok Junghyun Bum Le Duc Tai Hyunseung Choo MedIm 31 0 0 06 Nov 2024
Kernel Orthogonality does not necessarily imply a Decrease in Feature Map Redundancy in CNNs: Convolutional Similarity Minimization Zakariae Belmekki Jun Li Patrick Reuter David Antonio Gómez Jáuregui Karl Jenkins 28 0 0 05 Nov 2024
MA^2: A Self-Supervised and Motion Augmenting Autoencoder for Gait-Based Automatic Disease Detection Yiqun Liu Ke Zhang Yin Zhu MedIm 33 0 0 05 Nov 2024
Enhancing Adversarial Robustness via Uncertainty-Aware Distributional Adversarial Training Junhao Dong Xinghua Qu Zhiyuan Wang Yew-Soon Ong AAML 52 1 0 05 Nov 2024
Counterfactual Explanations via Riemannian Latent Space Traversal Paraskevas Pegios Aasa Feragen Andreas Abildtrup Hansen Georgios Arvanitidis BDL 42 1 0 04 Nov 2024
Exploring the Landscape for Generative Sequence Models for Specialized Data Synthesis Mohammad Zbeeb Mohammad Ghorayeb Mariam Salman 42 0 0 04 Nov 2024
Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360° Images Kun Huang Fang-Lue Zhang Fangfang Zhang Yu-Kun Lai Paul L. Rosin N. Dodgson 34 0 0 04 Nov 2024
Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks Jim Zhao Sidak Pal Singh Aurelien Lucchi AI4CE 48 0 0 04 Nov 2024
BiT-MamSleep: Bidirectional Temporal Mamba for EEG Sleep Staging Xinliang Zhou Yuzhe Han Zhenpeng Chen Chenyu Liu Yi Ding Ziyu Jia Yang Liu Mamba 39 1 0 03 Nov 2024
Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers Gavia Gray Aman Tiwari Shane Bergsma Joel Hestness 30 1 0 01 Nov 2024
Improving self-training under distribution shifts via anchored confidence with theoretical guarantees Taejong Joo Diego Klabjan UQCV 49 0 0 01 Nov 2024
Class Incremental Learning with Task-Specific Batch Normalization and Out-of-Distribution Detection Xuchen Xie Yiqiao Qiu Run Lin Weishi Zheng Ruixuan Wang CLL 55 0 0 01 Nov 2024
KAN-AD: Time Series Anomaly Detection with Kolmogorov-Arnold Networks Quan Zhou Changhua Pei Fei Sun Jing Han Zhengwei Gao Dan Pei Haiming Zhang Gaogang Xie Jianhui Li AI4TS 70 4 0 01 Nov 2024
Adaptive Residual Transformation for Enhanced Feature-Based OOD Detection in SAR Imagery Kyung-Hwan Lee Kyung-Tae Kim 26 0 0 01 Nov 2024
Understanding Generalizability of Diffusion Models Requires Rethinking the Hidden Gaussian Structure Xiang Li Yixiang Dai Qing Qu DiffM AI4CE 27 6 0 31 Oct 2024
TrAct: Making First-layer Pre-Activations Trainable Felix Petersen Christian Borgelt Stefano Ermon 24 0 0 31 Oct 2024
Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training Atli Kosson Bettina Messmer Martin Jaggi AI4CE 20 2 0 31 Oct 2024
Rethinking Deep Thinking: Stable Learning of Algorithms using Lipschitz Constraints Jay Bear Adam Prugel-Bennett Jonathon S. Hare 34 1 0 30 Oct 2024
(FL) $^2$ : Overcoming Few Labels in Federated Semi-Supervised Learning Seungjoo Lee Thanh-Long V. Le Jaemin Shin Sung-Ju Lee FedML 39 1 0 30 Oct 2024
NASM: Neural Anisotropic Surface Meshing Hongbo Li Haikuan Zhu Sikai Zhong Ningna Wang Cheng Lin X. Guo Shiqing Xin Wenping Wang Jing Hua Z. Zhong 43 0 0 30 Oct 2024
Power side-channel leakage localization through adversarial training of deep neural networks Jimmy Gammell A. Raghunathan Kaushik Roy AAML 24 0 0 29 Oct 2024
Where Do Large Learning Rates Lead Us? Ildus Sadrtdinov M. Kodryan Eduard Pokonechny E. Lobacheva Dmitry Vetrov AI4CE 34 0 0 29 Oct 2024
Dimensionality-induced information loss of outliers in deep neural networks Kazuki Uematsu Kosuke Haruki Taiji Suzuki Mitsuhiro Kimura Takahiro Takimoto Hideyuki Nakagawa 28 0 0 29 Oct 2024
Data Generation for Hardware-Friendly Post-Training Quantization Lior Dikstein Ariel Lapid Arnon Netzer H. Habi MQ 163 0 0 29 Oct 2024
Vertical Federated Learning with Missing Features During Training and Inference Pedro Valdeira Shiqiang Wang Yuejie Chi FedML 37 2 0 29 Oct 2024
Mitigating Gradient Overlap in Deep Residual Networks with Gradient Normalization for Improved Non-Convex Optimization Juyoung Yun 32 2 0 28 Oct 2024
Super-resolution in disordered media using neural networks Alexander Christie Matan Leibovich Miguel Moscoso A. Novikov George Papanicolaou C. Tsogka 16 0 0 28 Oct 2024