Training Faster by Separating Modes of Variation in Batch-normalized Models

7 June 2018

Papers citing "Training Faster by Separating Modes of Variation in Batch-normalized Models"

12 / 12 papers shown

Title
Adaptative Context Normalization: A Boost for Deep Learning in Image Processing Bilal Faye Hanane Azzag M. Lebbah D. Bouchaffra OOD 34 0 0 07 Sep 2024
Unsupervised Adaptive Normalization Bilal Faye Hanane Azzag M. Lebbah Fangchen Fang 28 0 0 07 Sep 2024
Supervised Batch Normalization Bilal Faye M. Lebbah Hanane Azzag 23 1 0 27 May 2024
Un-Mixing Test-Time Normalization Statistics: Combatting Label Temporal Correlation Devavrat Tomar Guillaume Vray Jean-Philippe Thiran Behzad Bozorgtabar 43 3 0 16 Jan 2024
Context Normalization Layer with Applications Bilal Faye M. Dilmi Hanene Azzag M. Lebbah D. Bouchaffra 23 0 0 14 Mar 2023
PSO-Convolutional Neural Networks with Heterogeneous Learning Rate N. H. Phong A. Santos B. Ribeiro 24 8 0 20 May 2022
Normalization Techniques in Training DNNs: Methodology, Analysis and Application Lei Huang Jie Qin Yi Zhou Fan Zhu Li Liu Ling Shao AI4CE 12 254 0 27 Sep 2020
Regularizing activations in neural networks via distribution matching with the Wasserstein metric Taejong Joo Donggu Kang Byunghoon Kim 35 8 0 13 Feb 2020
Attentive Normalization Xilai Li Wei Sun Tianfu Wu OOD ViT 28 31 0 04 Aug 2019
Split Batch Normalization: Improving Semi-Supervised Learning under Domain Shift Michal Zajac Konrad Zolna Stanislaw Jastrzebski 21 12 0 06 Apr 2019
Mode Normalization Lucas Deecke Iain Murray Hakan Bilen OOD 29 33 0 12 Oct 2018
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 299 2,890 0 15 Sep 2016