v1v2v3v4 (latest)

Understanding Batch Normalization

1 June 2018

Papers citing "Understanding Batch Normalization"

50 / 224 papers shown

Title
Neural Network Pruning as Spectrum Preserving Process S. Yao Dantong Yu I. Koutis CVBM 30 1 0 18 Jul 2023
X-MLP: A Patch Embedding-Free MLP Architecture for Vision Xinyue Wang Zhicheng Cai Chenglei Peng ViT 90 5 0 02 Jul 2023
Maintaining Plasticity in Deep Continual Learning Shibhansh Dohare J. F. Hernandez-Garcia Parash Rahman A. Rupam Mahmood Richard S. Sutton KELM CLL 97 29 0 23 Jun 2023
The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks Yuan Cao Difan Zou Yuan-Fang Li Quanquan Gu MLT 102 5 0 20 Jun 2023
FedWon: Triumphing Multi-domain Federated Learning Without Normalization Weiming Zhuang Lingjuan Lyu 61 10 0 09 Jun 2023
Normalization Layers Are All That Sharpness-Aware Minimization Needs Maximilian Mueller Tiffany J. Vlaar David Rolnick Matthias Hein 87 24 0 07 Jun 2023
Understanding MLP-Mixer as a Wide and Sparse MLP Tomohiro Hayase Ryo Karakida MoE 73 5 0 02 Jun 2023
On the Weight Dynamics of Deep Normalized Networks Christian H. X. Ali Mehmeti-Göpel Michael Wand 89 2 0 01 Jun 2023
Normalization Enhances Generalization in Visual Reinforcement Learning Lu Li Jiafei Lyu Guozheng Ma Zilin Wang Zhen Yang Xiu Li Zhiheng Li OOD 90 10 0 01 Jun 2023
One shot learning based drivers head movement identification using a millimetre wave radar sensor Hong Nhung Nguyen Seongwook Lee Tien-Tung Nguyen Yong-Hwa Kim 21 7 0 31 May 2023
OWAdapt: An adaptive loss function for deep learning using OWA operators Sebastián Maldonado Carla Vairetti Katherine Jara Miguel Carrasco Julio López 56 10 0 30 May 2023
On the impact of activation and normalization in obtaining isometric embeddings at initialization Amir Joudaki Hadi Daneshmand Francis R. Bach 44 10 0 28 May 2023
MAF-Net: Multiple attention-guided fusion network for fundus vascular image segmentation Yuanyuan Peng Pengpeng Luan Zixu Zhang MedIm 59 0 0 05 May 2023
A Simplified Framework for Contrastive Learning for Node Representations Ilgee Hong Huy Tran Claire Donnat SSL 87 2 0 01 May 2023
Picking Up Quantization Steps for Compressed Image Classification Li Ma Peixi Peng Guangyao Chen Yifan Zhao Siwei Dong Yonghong Tian 57 3 0 21 Apr 2023
Magnitude Invariant Parametrizations Improve Hypernetwork Learning Jose Javier Gonzalez Ortiz John Guttag Adrian Dalca 74 7 0 15 Apr 2023
Out-of-distribution Few-shot Learning For Edge Devices without Model Fine-tuning Xinyun Zhang Lanqing Hong OODD 90 0 0 13 Apr 2023
Making Batch Normalization Great in Federated Deep Learning Shitian Zhao Hong-You Chen Wei-Lun Chao FedML 144 11 0 12 Mar 2023
Compensating for Sensing Failures via Delegation in Human-AI Hybrid Systems Andrew Fuchs A. Passarella M. Conti 57 6 0 02 Mar 2023
On the Training Instability of Shuffling SGD with Batch Normalization David Wu Chulhee Yun S. Sra 83 5 0 24 Feb 2023
NU-AIR -- A Neuromorphic Urban Aerial Dataset for Detection and Localization of Pedestrians and Vehicles Craig Iaboni Thomas Kelly Pramod Abichandani 67 2 0 18 Feb 2023
The Expressive Power of Tuning Only the Normalization Layers Angeliki Giannou Shashank Rajput Dimitris Papailiopoulos 63 8 0 15 Feb 2023
Structural hierarchical learning for energy networks J. Leprince Waqas Khan H. Madsen J. Møller W. Zeiler 43 0 0 08 Feb 2023
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactions Anindita Ghosh Rishabh Dabral Vladislav Golyanik Christian Theobalt P. Slusallek DiffM 151 96 0 14 Dec 2022
Feature Weaken: Vicinal Data Augmentation for Classification Songhao Jiang Yan Chu Tian-Hui Ma Tianning Zang 58 0 0 20 Nov 2022
LightNorm: Area and Energy-Efficient Batch Normalization Hardware for On-Device DNN Training Seock-Hwan Noh Junsang Park Dahoon Park Jahyun Koo Jeik Choi Jaeha Kung 51 9 0 04 Nov 2022
Adaptive Batch Normalization for Training Data with Heterogeneous Features Wael Alsobhi Tarik K. Alafif Alaa E. Abdel-Hakim Weiwei Zong 35 4 0 03 Nov 2022
NoMorelization: Building Normalizer-Free Models from a Sample's Perspective Chang-Shu Liu Yuwen Yang Yue Ding Hongtao Lu 87 2 0 13 Oct 2022
SGD with Large Step Sizes Learns Sparse Features Maksym Andriushchenko Aditya Varre Loucas Pillaud-Vivien Nicolas Flammarion 143 60 0 11 Oct 2022
Dynamical Isometry for Residual Networks Advait Gadhikar R. Burkholz ODL AI4CE 81 2 0 05 Oct 2022
Batch Normalization Explained Randall Balestriero Richard G. Baraniuk AAML 92 17 0 29 Sep 2022
Privacy-Preserving Deep Learning Model for Covid-19 Disease Detection Vijay Srinivas Tida Sonya Hsu X. Hei MedIm 106 5 0 07 Sep 2022
PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNs Zhengyang Shen T. Hong Qi She Jinwen Ma Zhouchen Lin MedIm 45 7 0 07 Aug 2022
A Survey of Learning on Small Data: Generalization, Optimization, and Challenge Xiaofeng Cao Weixin Bu Sheng-Jun Huang Minling Zhang Ivor W. Tsang Yew-Soon Ong James T. Kwok 92 1 0 29 Jul 2022
Monitoring Vegetation From Space at Extremely Fine Resolutions via Coarsely-Supervised Smooth U-Net Joshua Fan Di Chen J. Wen Ying Sun Carla P. Gomes 65 2 0 16 Jul 2022
Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data Hongkang Li Shuai Zhang Ming Wang MLT 73 8 0 07 Jul 2022
Counterbalancing Teacher: Regularizing Batch Normalized Models for Robustness Saeid Asgari Taghanaki A. Gholami Fereshte Khani Kristy Choi Linh-Tam Tran Ran Zhang Aliasghar Khani 62 0 0 04 Jul 2022
On the Maximum Hessian Eigenvalue and Generalization Simran Kaur Jérémy E. Cohen Zachary Chase Lipton 115 43 0 21 Jun 2022
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction Kaifeng Lyu Zhiyuan Li Sanjeev Arora FAtt 121 75 0 14 Jun 2022
Rank Diminishing in Deep Neural Networks Ruili Feng Kecheng Zheng Yukun Huang Deli Zhao Michael I. Jordan Zhengjun Zha 92 33 0 13 Jun 2022
Effect of Batch Normalization on Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 66 10 0 15 May 2022
Impact of Learning Rate on Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 50 3 0 08 May 2022
Impact of L1 Batch Normalization on Analog Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 57 0 0 07 May 2022
Relation-guided acoustic scene classification aided with event embeddings Yuanbo Hou Bo Kang Wout Van Hauwermeiren Dick Botteldooren 52 16 0 01 May 2022
Spatiotemporal Estimation of TROPOMI NO2 Column with Depthwise Partial Convolutional Neural Network Yannic Lops Masoud Ghahremanloo A. Pouyaei Yunsoo Choi Jia Jung Seyedali Mousavinezhad A. K. Salman Davyda M. Hammond 52 7 0 12 Apr 2022
Testing Feedforward Neural Networks Training Programs Houssem Ben Braiek Foutse Khomh AAML 59 16 0 01 Apr 2022
Continual Normalization: Rethinking Batch Normalization for Online Continual Learning Quang Pham Chenghao Liu Guosheng Lin BDL OnRL 85 60 0 30 Mar 2022
Delving into the Estimation Shift of Batch Normalization in a Network Lei Huang Yi Zhou Tian Wang Jie Luo Xianglong Liu BDL 138 20 0 21 Mar 2022
On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis Dominik Rivoir Isabel Funke Stefanie Speidel 98 19 0 15 Mar 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 102 32 0 10 Mar 2022