Decorrelated Batch Normalization

23 April 2018

Papers citing "Decorrelated Batch Normalization"

36 / 36 papers shown

Title
Neural Multivariate Regression: Qualitative Insights from the Unconstrained Feature Model George Andriopoulos Soyuj Jung Basnet Juan Guevara Li Guo Keith Ross 30 0 0 14 May 2025
Overcoming Dimensional Collapse in Self-supervised Contrastive Learning for Medical Image Segmentation Jamshid Hassanpour V. Srivastav Didier Mutter N. Padoy SSL 57 2 0 22 Feb 2024
Gramian Attention Heads are Strong yet Efficient Vision Learners Jongbin Ryu Dongyoon Han J. Lim 32 1 0 25 Oct 2023
VNE: An Effective Method for Improving Deep Representation by Manipulating Eigenvalue Distribution Jaeill Kim Suhyun Kang Duhun Hwang Jungwook Shin Wonjong Rhee DRL 13 21 0 04 Apr 2023
Domain Generalization with Correlated Style Uncertainty Zheyu Zhang Bin Wang Debesh Jha Ugur Demir Ulas Bagci OOD 38 5 0 20 Dec 2022
Orthogonal SVD Covariance Conditioning and Latent Disentanglement Yue Song N. Sebe Wei Wang 26 6 0 11 Dec 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations Grégoire Mialon Randall Balestriero Yann LeCun 32 9 0 29 Sep 2022
Interneurons accelerate learning dynamics in recurrent neural networks for statistical adaptation David Lipshutz Cengiz Pehlevan D. Chklovskii 25 11 0 21 Sep 2022
AdaWCT: Adaptive Whitening and Coloring Style Injection Antoine Dufour Yohan Poirier-Ginter Alexandre Lessard Ryan Smith Michael Lockyer Jean-François Lalonde 32 1 0 01 Aug 2022
Batch-efficient EigenDecomposition for Small and Medium Matrices Yue Song N. Sebe Wei Wang 29 2 0 09 Jul 2022
Improving Covariance Conditioning of the SVD Meta-layer by Orthogonality Yue Song N. Sebe Wei Wang 19 8 0 05 Jul 2022
What do CNNs Learn in the First Layer and Why? A Linear Systems Perspective Rhea Chowers Yair Weiss 33 2 0 06 Jun 2022
WildNet: Learning Domain Generalized Semantic Segmentation from the Wild Suhyeon Lee Hongje Seong Seongwon Lee Euntai Kim 41 92 0 04 Apr 2022
Constrained Parameter Inference as a Principle for Learning Nasir Ahmad Ellen Schrader Marcel van Gerven 18 10 0 22 Mar 2022
Fast Differentiable Matrix Square Root and Inverse Square Root Yue Song N. Sebe Wei Wang 27 15 0 29 Jan 2022
Differentiable Gaussianization Layers for Inverse Problems Regularized by Deep Generative Models Dongzhuo Li MedIm 38 2 0 07 Dec 2021
Learnable Adaptive Cosine Estimator (LACE) for Image Classification Joshua Peeples Connor H. McCurley Sarah Walker Dylan Stewart Alina Zare 24 3 0 11 Oct 2021
Global and Local Texture Randomization for Synthetic-to-Real Semantic Segmentation Duo Peng Yinjie Lei Lingqiao Liu Pingping Zhang Jun Liu 25 73 0 05 Aug 2021
Stochastic Whitening Batch Normalization Shengdong Zhang E. Nezhadarya H. Fashandi Jiayi Liu Darin Graham Mohak Shah 15 10 0 03 Jun 2021
Why Approximate Matrix Square Root Outperforms Accurate SVD in Global Covariance Pooling? Yue Song N. Sebe Wei Wang 20 25 0 06 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 133 187 0 02 May 2021
Augmenting Deep Classifiers with Polynomial Neural Networks Grigorios G. Chrysos Markos Georgopoulos Jiankang Deng Jean Kossaifi Yannis Panagakis Anima Anandkumar 19 18 0 16 Apr 2021
Improving Unsupervised Domain Adaptation by Reducing Bi-level Feature Redundancy Mengzhu Wang Xiang Zhang L. Lan Wei Wang Huibin Tan Zhigang Luo AI4CE 39 1 0 28 Dec 2020
Group Whitening: Balancing Learning Efficiency and Representational Capacity Lei Huang Yi Zhou Li Liu Fan Zhu Ling Shao 28 20 0 28 Sep 2020
Transform Quantization for CNN (Convolutional Neural Network) Compression Sean I. Young Wang Zhe David S. Taubman B. Girod MQ 29 69 0 02 Sep 2020
Whitening and second order optimization both make information in the dataset unusable during training, and can reduce or prevent generalization Neha S. Wadia Daniel Duckworth S. Schoenholz Ethan Dyer Jascha Narain Sohl-Dickstein 27 13 0 17 Aug 2020
Convex Geometry and Duality of Over-parameterized Neural Networks Tolga Ergen Mert Pilanci MLT 39 54 0 25 Feb 2020
Concept Whitening for Interpretable Image Recognition Zhi Chen Yijie Bei Cynthia Rudin FAtt 31 314 0 05 Feb 2020
Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transform Jun Li Fuxin Li S. Todorovic 24 102 0 04 Feb 2020
Attentive Normalization Xilai Li Wei Sun Tianfu Wu OOD ViT 28 31 0 04 Aug 2019
Switchable Normalization for Learning-to-Normalize Deep Representation Ping Luo Ruimao Zhang Jiamin Ren Zhanglin Peng Jingyu Li 30 73 0 22 Jul 2019
Deep Multi-View Learning via Task-Optimal CCA Heather D. Couture Roland Kwitt J. S. Marron M. Troester C. Perou Marc Niethammer 26 6 0 17 Jul 2019
Backpropagation-Friendly Eigendecomposition Wei Wang Zheng Dang Yinlin Hu Pascal Fua Mathieu Salzmann 14 49 0 21 Jun 2019
Unsupervised Domain Adaptation using Feature-Whitening and Consensus Loss Subhankar Roy Aliaksandr Siarohin E. Sangineto Samuel Rota Buló N. Sebe Elisa Ricci 39 162 0 07 Mar 2019
Accelerating Training of Deep Neural Networks with a Standardization Loss Jasmine Collins Johannes Ballé Jonathon Shlens 18 3 0 03 Mar 2019
Whitening and Coloring batch transform for GANs Aliaksandr Siarohin E. Sangineto N. Sebe 22 49 0 01 Jun 2018