v1v2v3 (latest)

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

11 February 2015

Sergey Ioffe

Christian Szegedy

OOD

ArXiv (abs)PDF HTML

Papers citing "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift"

50 / 11,132 papers shown

Title
Object Recognition, Dynamic Contact Simulation, Detection, and Control of the Flexible Musculoskeletal Hand Using a Recurrent Neural Network with Parametric Bias Kento Kawaharazuka Kei Tsuzuki Moritaka Onitsuka Yuki Asano K. Okada Koji Kawasaki Masayuki Inaba 49 18 0 10 Jul 2024
Simplifying Source-Free Domain Adaptation for Object Detection: Effective Self-Training Strategies and Performance Insights Yan Hao Florent Forest Olga Fink TTA ObjD 93 6 0 10 Jul 2024
Machine Unlearning for Medical Imaging Reza Nasirigerdeh Nader Razmi Julia A. Schnabel Daniel Rueckert Georgios Kaissis OOD MU 74 2 0 10 Jul 2024
MambaVision: A Hybrid Mamba-Transformer Vision Backbone Ali Hatamizadeh Jan Kautz Mamba 156 74 0 10 Jul 2024
Deep-Motion-Net: GNN-based volumetric organ shape reconstruction from single-view 2D projections Isuru Wijesinghe Michael G. Nix A. Zakeri Alireza Hokmabadi B. Al-Qaisieh Ali Gooya Zeike A. Taylor MedIm 3DV 42 0 0 09 Jul 2024
Enhancing spatial auditory attention decoding with neuroscience-inspired prototype training Zelin Qiu Jianjun Gu Dingding Yao Junfeng Li 51 2 0 09 Jul 2024
Enhanced Model Robustness to Input Corruptions by Per-corruption Adaptation of Normalization Statistics Elena Camuffo Umberto Michieli Simone Milani J. Moon Mete Ozay 109 1 0 08 Jul 2024
Stepping on the Edge: Curvature Aware Learning Rate Tuners Vincent Roulet Atish Agarwala Jean-Bastien Grill Grzegorz Swirszcz Mathieu Blondel Fabian Pedregosa 99 3 0 08 Jul 2024
Heterogeneous window transformer for image denoising Chunwei Tian Menghua Zheng Chia-Wen Lin Zhiwu Li David C. Zhang ViT 70 16 0 08 Jul 2024
Semantic Segmentation for Real-World and Synthetic Vehicle's Forward-Facing Camera Images Tuan T. Nguyen Phan Le Yasir Hassan Mina Sartipi 136 0 0 07 Jul 2024
Evolutionary Trigger Detection and Lightweight Model Repair Based Backdoor Defense Qi Zhou Zipeng Ye Yubo Tang Wenjian Luo Yuhui Shi Yan Jia AAML 104 2 0 07 Jul 2024
SCSA: Exploring the Synergistic Effects Between Spatial and Channel Attention Yunzhong Si Huiying Xu Xinzhong Zhu Wenhao Zhang Yao Dong Yuxing Chen Hongbo Li 114 36 0 06 Jul 2024
Improving ensemble extreme precipitation forecasts using generative artificial intelligence Yingkai Sha Ryan Sobash David John Gagne II 71 0 0 05 Jul 2024
Self-Supervised Representation Learning for Adversarial Attack Detection Yi Li Plamen Angelov N. Suri SSL AAML 81 4 0 05 Jul 2024
Regulating Model Reliance on Non-Robust Features by Smoothing Input Marginal Density Peiyu Yang Naveed Akhtar Mubarak Shah Ajmal Mian AAML 67 1 0 05 Jul 2024
Fine-grained Dynamic Network for Generic Event Boundary Detection Ziwei Zheng Lijun He Le Yang Fan Li 60 0 0 05 Jul 2024
Simplifying Deep Temporal Difference Learning Matteo Gallici Mattie Fellows Benjamin Ellis B. Pou Ivan Masmitja Jakob Foerster Mario Martin OffRL 165 26 0 05 Jul 2024
Attention Normalization Impacts Cardinality Generalization in Slot Attention Markus Krimmel Jan Achterhold Joerg Stueckler OCL 84 0 0 04 Jul 2024
Combining AI Control Systems and Human Decision Support via Robustness and Criticality Walt Woods Alexander Grushin Simon Khan Alvaro Velasquez 60 1 0 03 Jul 2024
Foundations and Frontiers of Graph Learning Theory Yu Huang Min Zhou Menglin Yang Zhen Wang Muhan Zhang Jie Wang Hong Xie Hao Wang Defu Lian Enhong Chen AI4CE GNN 156 2 0 03 Jul 2024
IntentionNet: Map-Lite Visual Navigation at the Kilometre Scale Wei Gao Bo Ai Joel Loo Vinay David Hsu 125 1 0 03 Jul 2024
Anti-Collapse Loss for Deep Metric Learning Based on Coding Rate Metric XiRuo Jiang Yazhou Yao Xili Dai Fumin Shen Xian-Sheng Hua Heng-Tao Shen 56 0 0 03 Jul 2024
Differential Encoding for Improved Representation Learning over Graphs Haimin Zhang Jiahao Xia Min Xu 91 0 0 03 Jul 2024
Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning Ruibo Shang Geoffrey P. Luke Matthew O'Donnell UQCV 79 0 0 02 Jul 2024
QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices Juntao Zhao Borui Wan Size Zheng Haibin Lin Yibo Zhu Chuan Wu 73 3 0 02 Jul 2024
On the Performance and Memory Footprint of Distributed Training: An Empirical Study on Transformers Zhengxian Lu Fangyu Wang Zhiwei Xu Fei Yang Tao Li 70 1 0 02 Jul 2024
A Method to Facilitate Membership Inference Attacks in Deep Learning Models Zitao Chen Karthik Pattabiraman MIACV MLAU AAML MIALM 120 0 0 02 Jul 2024
Domain Generalizable Knowledge Tracing via Concept Aggregation and Relation-Based Attention Yuquan Xie Wanqi Yang Jinyu Wei Ming Yang Yang Gao AI4Ed 105 1 0 02 Jul 2024
Normalization and effective learning rates in reinforcement learning Clare Lyle Zeyu Zheng Khimya Khetarpal James Martens H. V. Hasselt Razvan Pascanu Will Dabney 97 13 0 01 Jul 2024
Mask and Compress: Efficient Skeleton-based Action Recognition in Continual Learning Matteo Mosconi Andriy Sorokin Aniello Panariello Angelo Porrello Jacopo Bonato Marco Cotogni Luigi Sabetta Simone Calderara Rita Cucchiara CLL 72 1 0 01 Jul 2024
MARS: Multimodal Active Robotic Sensing for Articulated Characterization Hongliang Zeng Ping Zhang Chengjiong Wu Jiahua Wang Tingyu Ye Fang Li 95 1 0 01 Jul 2024
Sign Gradient Descent-based Neuronal Dynamics: ANN-to-SNN Conversion Beyond ReLU Network Hyunseok Oh Youngki Lee 112 2 0 01 Jul 2024
NourishNet: Proactive Severity State Forecasting of Food Commodity Prices for Global Warning Systems Sydney Balboni Grace Ivey Brett Storoe John Cisler Tyge Plater Caitlyn Grant Ella Bruce Benjamin Paulson 24 0 0 30 Jun 2024
RepAct: The Re-parameterizable Adaptive Activation Function Xian Wu Qingchuan Tao Shuang Wang 70 0 0 28 Jun 2024
Edge-DIRECT: A Deep Reinforcement Learning-based Method for Solving Heterogeneous Electric Vehicle Routing Problem with Time Window Constraints Arash Mozhdehi Mahdi Mohammadizadeh Xin Eric Wang 56 2 0 28 Jun 2024
FedMap: Iterative Magnitude-Based Pruning for Communication-Efficient Federated Learning Alexander Herzog Robbie Southam Ioannis Mavromatis Aftab Khan 56 0 0 27 Jun 2024
Clustering in pure-attention hardmax transformers and its role in sentiment analysis Albert Alcalde Giovanni Fantuzzi Enrique Zuazua 93 4 0 26 Jun 2024
KAGNNs: Kolmogorov-Arnold Networks meet Graph Learning Roman Bresson Giannis Nikolentzos G. Panagopoulos Michail Chatzianastasis Jun Pang Michalis Vazirgiannis 181 51 0 26 Jun 2024
DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image Qingxuan Wu Zhiyang Dou Sirui Xu Soshi Shimada Chen Wang ... Taku Komura Vladislav Golyanik Christian Theobalt Wenping Wang Lingjie Liu CVBM 3DH 163 5 0 26 Jun 2024
On the consistency of hyper-parameter selection in value-based deep reinforcement learning J. Obando-Ceron J. G. Araújo Rameswar Panda Pablo Samuel Castro 120 9 0 25 Jun 2024
Automatic speech recognition for the Nepali language using CNN, bidirectional LSTM and ResNet Manish Dhakal Arman Chhetri Aman Kumar Gupta Prabin B. Lamichhane S. Pandey S. Shakya AI4TS 63 10 0 25 Jun 2024
Stable Tool-Use with Flexible Musculoskeletal Hands by Learning the Predictive Model of Sensor State Transition Kento Kawaharazuka Kei Tsuzuki Moritaka Onitsuka Yuki Asano Kei Okada Koji Kawasaki Masayuki Inaba 73 4 0 24 Jun 2024
FASTC: A Fast Attentional Framework for Semantic Traversability Classification Using Point Cloud Yirui Chen Pengjin Wei Zhenhuan Liu Bingchao Wang Jie Yang Wei Liu 3DPC 74 1 0 24 Jun 2024
Improving robustness to corruptions with multiplicative weight perturbations Trung Trinh Markus Heinonen Luigi Acerbi Samuel Kaski 78 0 0 24 Jun 2024
SLOctolyzer: Fully automatic analysis toolkit for segmentation and feature extracting in scanning laser ophthalmoscopy images Jamie Burke Samuel Gibbon Justin Engelmann Adam Threlfall Ylenia Giarratano Charlene Hamid Stuart King Ian J. C. MacCormick Tom J. MacGillivray 31 3 0 24 Jun 2024
Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers Xiuying Wei Skander Moalla Razvan Pascanu Çağlar Gülçehre 81 2 0 24 Jun 2024
RepNeXt: A Fast Multi-Scale CNN using Structural Reparameterization Mingshu Zhao Yi Luo Yong Ouyang 124 3 0 23 Jun 2024
Jacobian Descent for Multi-Objective Optimization Pierre Quinton Valérian Rey 95 3 0 23 Jun 2024
Federated Adversarial Learning for Robust Autonomous Landing Runway Detection Yi Li Plamen Angelov Zhengxin Yu Alvaro Lopez Pellicer Neeraj Suri 60 3 0 22 Jun 2024
Enhancing Solar Driver Forecasting with Multivariate Transformers Sergio Sanchez-Hurtado Victor Rodriguez-Fernandez Julia Briden P. M. Siew Richard Linares AI4TS 23 0 0 22 Jun 2024