Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 6,869 papers shown

Title
Synthetic Text Generation for Training Large Language Models via Gradient Matching Dang Nguyen Zeman Li M. Bateni Vahab Mirrokni Meisam Razaviyayn Baharan Mirzasoleiman 42 0 0 24 Feb 2025
M3DA: Benchmark for Unsupervised Domain Adaptation in 3D Medical Image Segmentation B. Shirokikh Anvar Kurmukov Mariia Donskova Valentin Samokhin Mikhail Belyaev Ivan V. Oseledets OOD 39 0 0 24 Feb 2025
AdverX-Ray: Ensuring X-Ray Integrity Through Frequency-Sensitive Adversarial VAEs Francisco Caetano Christiaan G. A. Viviers Lena Filatova Peter H. N. de With Fons van der Sommen AAML MedIm 44 0 0 23 Feb 2025
Online Learning of Danger Avoidance for Complex Structures of Musculoskeletal Humanoids and Its Applications Kento Kawaharazuka Naoki Hiraoka Yuya Koga Manabu Nishiura Yusuke Omura Yuki Asano Kei Okada Koji Kawasaki Masayuki Inaba 46 1 0 22 Feb 2025
Robotic Table Tennis: A Case Study into a High Speed Learning System David B. DÁmbrosio Jonathan Abelian Saminda Abeyruwan Michael Ahn Alex Bewley ... Vikas Sindhwani Avi Singh Vincent Vanhoucke Grace Vesom Peng-Tao Xu 60 13 0 20 Feb 2025
Stacking as Accelerated Gradient Descent Naman Agarwal Pranjal Awasthi Satyen Kale Eric Zhao ODL 73 2 0 20 Feb 2025
Efficient Learning Under Density Shift in Incremental Settings Using Cramér-Rao-Based Regularization Behraj Khan Behroz Mirza Nouman Durrani T. Syed 60 0 0 18 Feb 2025
Benchmarking Predictive Coding Networks -- Made Simple Luca Pinchetti Chang Qi Oleh Lokshyn Gaspard Olivers Cornelius Emde ... Simon Frieder Bayar I. Menzat Rafal Bogacz Thomas Lukasiewicz Tommaso Salvatori 130 5 0 17 Feb 2025
Why does my medical AI look at pictures of birds? Exploring the efficacy of transfer learning across domain boundaries F. Jonske M. Kim Enrico Nasca J. Evers Johannes Haubold ... F. Nensa Michael Kamp C. Seibold Jan Egger Jens Kleesiek 79 1 0 17 Feb 2025
QMaxViT-Unet+: A Query-Based MaxViT-Unet with Edge Enhancement for Scribble-Supervised Segmentation of Medical Images Thien B. Nguyen-Tat Hoang-An Vo Phuoc-Sang Dang 75 0 0 17 Feb 2025
Learn2Mix: Training Neural Networks Using Adaptive Data Integration Shyam Venkatasubramanian Vahid Tarokh 88 0 0 17 Feb 2025
Forget the Data and Fine-Tuning! Just Fold the Network to Compress Dong Wang Haris Šikić Lothar Thiele O. Saukh 59 0 0 17 Feb 2025
Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent Hikaru Umeda Hideaki Iiduka 67 2 0 17 Feb 2025
GeneralizeFormer: Layer-Adaptive Model Generation across Test-Time Distribution Shifts Sameer Ambekar Zehao Xiao Xiantong Zhen Cees G. M. Snoek OOD 65 0 0 15 Feb 2025
Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression Megh Shukla Aziz Shameem Mathieu Salzmann Alexandre Alahi 44 1 0 14 Feb 2025
Unlocking the Potential of Classic GNNs for Graph-level Tasks: Simple Architectures Meet Excellence Yuankai Luo Lei Shi Xiao-Ming Wu AI4CE 72 0 0 13 Feb 2025
Early Stopping Against Label Noise Without Validation Data Suqin Yuan Lei Feng Tongliang Liu NoLa 104 15 0 11 Feb 2025
Epistemic Uncertainty in Conformal Scores: A Unified Approach Luben M. C. Cabezas Vagner S. Santos Thiago Rodrigo Ramos Rafael Izbicki 55 0 0 10 Feb 2025
Unleashing the Potential of Pre-Trained Diffusion Models for Generalizable Person Re-Identification Jiachen Li Xiaojin Gong DiffM 84 0 0 10 Feb 2025
Provably Near-Optimal Federated Ensemble Distillation with Negligible Overhead Won-Jun Jang Hyeon-Seo Park Si-Hyeon Lee FedML 181 0 0 10 Feb 2025
DeepMill: Neural Accessibility Learning for Subtractive Manufacturing Fanchao Zhong Yang Wang Peng Wang Lin Lu Haisen Zhao HAI 81 0 0 10 Feb 2025
A Comprehensive Survey on Image Signal Processing Approaches for Low-Illumination Image Enhancement Muhammad Turab 69 0 0 09 Feb 2025
Parameter Symmetry Breaking and Restoration Determines the Hierarchical Learning in AI Systems Liu Ziyin Yizhou Xu T. Poggio Isaac Chuang 50 4 0 07 Feb 2025
Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignment Harrish Thasarathan Julian Forsyth Thomas Fel M. Kowal Konstantinos G. Derpanis 111 7 0 06 Feb 2025
DRiVE: Dynamic Recognition in VEhicles using snnTorch Heerak Vora Param Pathak Parul Bakaraniya 36 0 0 04 Feb 2025
Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries Chris Kolb T. Weber Bernd Bischl David Rügamer 113 0 0 04 Feb 2025
BrainOOD: Out-of-distribution Generalizable Brain Network Analysis Jiaxing Xu Yongqiang Chen Xia Dong Mengcheng Lan Tiancheng Huang Qingtian Bian James Cheng Yiping Ke OOD 68 0 0 02 Feb 2025
Position: Curvature Matrices Should Be Democratized via Linear Operators Felix Dangel Runa Eschenhagen Weronika Ormaniec Andres Fernandez Lukas Tatzel Agustinus Kristiadi 58 3 0 31 Jan 2025
GDO: Gradual Domain Osmosis Zixi Wang Yubo Huang 168 0 0 31 Jan 2025
DeepExtractor: Time-domain reconstruction of signals and glitches in gravitational wave data with deep learning Tom Dooney Harsh Narola Stefano Bromuri R. L. Curier C. Broeck Sarah Caudill D. Tan 67 0 0 30 Jan 2025
Causal Discovery via Bayesian Optimization Bao Duong Sunil Gupta Thin Nguyen 44 0 0 28 Jan 2025
Information Consistent Pruning: How to Efficiently Search for Sparse Networks? Soheil Gharatappeh S. Y. Sekeh 59 0 0 28 Jan 2025
CreINNs: Credal-Set Interval Neural Networks for Uncertainty Estimation in Classification Tasks Kaizheng Wang Keivan K1 Shariatmadar Shireen Kudukkil Manchingal Fabio Cuzzolin David Moens Hans Hallez UQCV BDL 92 12 0 28 Jan 2025
iFormer: Integrating ConvNet and Transformer for Mobile Application Chuanyang Zheng ViT 72 0 0 26 Jan 2025
BILLNET: A Binarized Conv3D-LSTM Network with Logic-gated residual architecture for hardware-efficient video inference Van Thien Nguyen William Guicquero Gilles Sicard 3DV MQ 79 2 0 24 Jan 2025
Memory Storyboard: Leveraging Temporal Segmentation for Streaming Self-Supervised Learning from Egocentric Videos Yanlai Yang Mengye Ren 183 0 0 21 Jan 2025
On the Adversarial Vulnerabilities of Transfer Learning in Remote Sensing Tao Bai Xingjian Tian Yonghao Xu B. Wen AAML 43 0 0 20 Jan 2025
Neuradicon: operational representation learning of neuroimaging reports Henry Watkins Robert J. Gray Adam Julius Y. Mah W. H. Pinaya ... Jorge M. Cardoso Sebastien Ourselin Geraint Rees Rolf Jaeger P. Nachev MedIm 143 1 0 20 Jan 2025
Model Synthesis for Zero-Shot Model Attribution Tianyun Yang Juan Cao Danding Wang Chang Xu WIGM 75 4 0 20 Jan 2025
Hound: Locating Cryptographic Primitives in Desynchronized Side-Channel Traces Using Deep-Learning Davide Galli Giuseppe Chiari Davide Zoni 53 2 0 20 Jan 2025
Enhancing Sample Utilization in Noise-Robust Deep Metric Learning With Subgroup-Based Positive-Pair Selection Zhipeng Yu Qianqian Xu Yangbangyan Jiang Yingfei Sun Qingming Huang NoLa 69 0 0 19 Jan 2025
Deterministic Uncertainty Propagation for Improved Model-Based Offline Reinforcement Learning Abdullah Akgul Manuel Haußmann M. Kandemir OffRL 76 1 0 17 Jan 2025
Self-supervised Transformation Learning for Equivariant Representations Jaemyung Yu Jaehyun Choi Dong-Jae Lee H. Hong Junmo Kim 45 0 0 15 Jan 2025
A Heterogeneous Multimodal Graph Learning Framework for Recognizing User Emotions in Social Networks Sree Bhattacharyya Shuhua Yang James Z. Wang 38 0 0 13 Jan 2025
Histogram-Equalized Quantization for logic-gated Residual Neural Networks Van Thien Nguyen William Guicquero Gilles Sicard MQ 41 1 0 10 Jan 2025
Risk-averse policies for natural gas futures trading using distributional reinforcement learning Félicien Hêche Biagio Nigro Oussama Barakat Stephan Robert-Nicoud OffRL 41 0 0 08 Jan 2025
AADNet: Exploring EEG Spatiotemporal Information for Fast and Accurate Orientation and Timbre Detection of Auditory Attention Based on A Cue-Masked Paradigm Keren Shi Xu Liu Xue Yuan Haijie Shang Ruiting Dai Hanbin Wang Yunfa Fu N. Jiang Jiayuan He 31 1 0 08 Jan 2025
Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies Xubin Wang Weijia Jia 36 0 0 08 Jan 2025
IntegrityAI at GenAI Detection Task 2: Detecting Machine-Generated Academic Essays in English and Arabic Using ELECTRA and Stylometry Mohammad AL-Smadi 38 0 0 07 Jan 2025
Normalizing Batch Normalization for Long-Tailed Recognition Yuxiang Bao Guoliang Kang Linlin Yang Xiaoyue Duan Bo Zhao Baochang Zhang MQ 55 0 0 06 Jan 2025