Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models

10 February 2017

Sergey Ioffe

Papers citing "Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models"

50 / 91 papers shown

Title
Active Perception for Tactile Sensing: A Task-Agnostic Attention-Based Approach Tim Schneider Cristiana de Farias Roberto Calandra L. Chen Jan Peters 169 0 0 09 May 2025
EmoNeXt: an Adapted ConvNeXt for Facial Emotion Recognition Yassine El Boudouri Amine Bohi 73 15 0 14 Jan 2025
Content-decoupled Contrastive Learning-based Implicit Degradation Modeling for Blind Image Super-Resolution Jiang Yuan Ji Ma Bo Wang Weiming Hu 37 0 0 10 Aug 2024
GoalNet: Goal Areas Oriented Pedestrian Trajectory Prediction Ching-Lin Lee Zhi-Xuan Wang Kuan-Ting Lai Amar Fadillah 46 1 0 29 Feb 2024
Jacquard V2: Refining Datasets using the Human In the Loop Data Correction Method Qiuhao Li Shenghai Yuan 40 5 0 08 Feb 2024
BCN: Batch Channel Normalization for Image Classification Afifa Khaled Chao Li Jia Ning Kun He 15 6 0 01 Dec 2023
Video Super-Resolution Using a Grouped Residual in Residual Network MohammadHossein Ashoori Arash Amini SupR 29 0 0 17 Oct 2023
Handwritten Stenography Recognition and the LION Dataset R. Heil Malin Nauwerck AI4TS 13 3 0 15 Aug 2023
Uncertainty Quantification for Image-based Traffic Prediction across Cities Alexander Timans Nina Wiedemann Nishant Kumar Ye Hong Martin Raubal 18 1 0 11 Aug 2023
Concurrent ischemic lesion age estimation and segmentation of CT brain using a Transformer-based network A. Marcus P. Bentley Daniel Rueckert MedIm 21 9 0 21 Jun 2023
Ghost Noise for Regularizing Deep Neural Networks Atli Kosson Dongyang Fan Martin Jaggi 25 1 0 26 May 2023
Efficient ConvBN Blocks for Transfer Learning and Beyond Kaichao You Guo Qin Anchang Bao Mengsi Cao Ping-Chia Huang Jiulong Shan Mingsheng Long 31 1 0 19 May 2023
Dual Residual Attention Network for Image Denoising Wencong Wu Shijie Liu Yi Zhou Yungang Zhang Yu Xiang 33 59 0 07 May 2023
Unsupervised Learning on a DIET: Datum IndEx as Target Free of Self-Supervision, Reconstruction, Projector Head Randall Balestriero 38 3 0 20 Feb 2023
Semantic Image Segmentation: Two Decades of Research G. Csurka Riccardo Volpi Boris Chidlovskii 3DV 35 50 0 13 Feb 2023
LOANet: A Lightweight Network Using Object Attention for Extracting Buildings and Roads from UAV Aerial Remote Sensing Images Xiaoxiang Han Yiman Liu Gang Liu Yuanjie Lin Qiaohong Liu 27 11 0 16 Dec 2022
Batch Normalization Explained Randall Balestriero Richard G. Baraniuk AAML 36 16 0 29 Sep 2022
Batch Layer Normalization, A new normalization layer for CNNs and RNN A. Ziaee Erion cCano 19 13 0 19 Sep 2022
MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depth Chenjie Cao Xinlin Ren Yanwei Fu 31 47 0 04 Aug 2022
GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation Cristiano Saltori E. Krivosheev Stéphane Lathuilière N. Sebe Fabio Galasso G. Fiameni Elisa Ricci Fabio Poiesi 3DPC 36 29 0 20 Jul 2022
Skeletal Human Action Recognition using Hybrid Attention based Graph Convolutional Network Hao Xing Darius Burschka GNN 3DH 21 7 0 12 Jul 2022
Understanding and Improving Group Normalization Agus Gunawan Xu Yin Kang Zhang 15 3 0 05 Jul 2022
SPD domain-specific batch normalization to crack interpretable unsupervised domain adaptation in EEG Reinmar J. Kobler J. Hirayama Qibin Zhao M. Kawanabe 19 53 0 02 Jun 2022
Batch Normalization Is Blind to the First and Second Derivatives of the Loss Zhanpeng Zhou Wen Shen Huixin Chen Ling Tang Quanshi Zhang 34 2 0 30 May 2022
Effect of Batch Normalization on Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 24 10 0 15 May 2022
Impact of L1 Batch Normalization on Analog Noise Resistant Property of Deep Learning Models Omobayode Fagbohungbe Lijun Qian 35 0 0 07 May 2022
Alleviating Representational Shift for Continual Fine-tuning Shibo Jie Zhi-Hong Deng Ziheng Li CLL 37 11 0 22 Apr 2022
Differentiable Rendering for Synthetic Aperture Radar Imagery Michael Wilmanski Jonathan I. Tamir 16 5 0 04 Apr 2022
Continual Normalization: Rethinking Batch Normalization for Online Continual Learning Quang-Cuong Pham Chenghao Liu Guosheng Lin BDL OnRL 38 57 0 30 Mar 2022
On the Pitfalls of Batch Normalization for End-to-End Video Learning: A Study on Surgical Workflow Analysis Dominik Rivoir Isabel Funke Stefanie Speidel 24 17 0 15 Mar 2022
Diagnosing Batch Normalization in Class Incremental Learning Minghao Zhou Quanziang Wang Jun Shu Qian Zhao Deyu Meng CLL 48 6 0 16 Feb 2022
AtmoDist: Self-supervised Representation Learning for Atmospheric Dynamics Sebastian Hoffmann C. Lessig AI4Cl 24 8 0 02 Feb 2022
A ConvNet for the 2020s Zhuang Liu Hanzi Mao Chaozheng Wu Christoph Feichtenhofer Trevor Darrell Saining Xie ViT 42 4,983 0 10 Jan 2022
Sparse-View CT Reconstruction using Recurrent Stacked Back Projection Wenrui Li G. Buzzard Charles A. Bouman 25 3 0 09 Dec 2021
AdjointBackMapV2: Precise Reconstruction of Arbitrary CNN Unit's Activation via Adjoint Operators Qing Wan Siu Wun Cheung Yoonsuck Choe 29 0 0 04 Oct 2021
Batch Normalization Preconditioning for Neural Network Training Susanna Lange Kyle E. Helfrich Qiang Ye 27 9 0 02 Aug 2021
Stochastic Whitening Batch Normalization Shengdong Zhang E. Nezhadarya H. Fashandi Jiayi Liu Darin Graham Mohak Shah 21 10 0 03 Jun 2021
BeamLearning: an end-to-end Deep Learning approach for the angular localization of sound sources using raw multichannel acoustic pressure data Hadrien Pujol Éric Bavu Alexandre Garcia 44 22 0 27 Apr 2021
Rethinking Text Line Recognition Models Daniel Hernandez Diaz Siyang Qin R. Ingle Yasuhisa Fujii Alessandro Bissacco VLM 38 51 0 15 Apr 2021
High-Performance Large-Scale Image Recognition Without Normalization Andrew Brock Soham De Samuel L. Smith Karen Simonyan VLM 223 512 0 11 Feb 2021
Deep Learning for Scene Classification: A Survey Delu Zeng Minyu Liao M. Tavakolian Yulan Guo Bolei Zhou D. Hu M. Pietikäinen Li Liu VLM 29 27 0 26 Jan 2021
Momentum^2 Teacher: Momentum Teacher with Momentum Statistics for Self-Supervised Learning Zeming Li Songtao Liu Jian Sun 51 16 0 19 Jan 2021
Generative Adversarial U-Net for Domain-free Medical Image Augmentation Xiaocong Chen Yun Yvonna Li Lina Yao Ehsan Adeli Yu Zhang GAN OOD MedIm 54 17 0 12 Jan 2021
Group Whitening: Balancing Learning Efficiency and Representational Capacity Lei Huang Yi Zhou Li Liu Fan Zhu Ling Shao 28 21 0 28 Sep 2020
Batch Coherence-Driven Network for Part-aware Person Re-Identification Kan Wang Pengfei Wang Changxing Ding Dacheng Tao 24 22 0 21 Sep 2020
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 34 79 0 17 Sep 2020
Globally Injective ReLU Networks Michael Puthawala K. Kothari Matti Lassas Ivan Dokmanić Maarten V. de Hoop 24 26 0 15 Jun 2020
Continual Learning with Extended Kronecker-factored Approximate Curvature Janghyeon Lee H. Hong Donggyu Joo Junmo Kim CLL 20 52 0 16 Apr 2020
Online Continual Learning on Sequences G. I. Parisi Vincenzo Lomonaco CLL 19 25 0 20 Mar 2020
Towards Learning a Universal Non-Semantic Representation of Speech Joel Shor A. Jansen Ronnie Maor Oran Lang Omry Tuval Félix de Chaumont Quitry Marco Tagliasacchi Ira Shavitt Dotan Emanuel Yinnon A. Haviv SSL 44 155 0 25 Feb 2020