Regularizing CNNs with Locally Constrained Decorrelations

7 November 2016

Papers citing "Regularizing CNNs with Locally Constrained Decorrelations"

50 / 79 papers shown

Title
Kernel Orthogonality does not necessarily imply a Decrease in Feature Map Redundancy in CNNs: Convolutional Similarity Minimization Zakariae Belmekki Jun Li Patrick Reuter David Antonio Gómez Jáuregui Karl Jenkins 26 0 0 05 Nov 2024
Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularization Junlin He Jinxiao Du Wei Ma SSL 40 0 0 01 Nov 2024
GSSF: Generalized Structural Sparse Function for Deep Cross-modal Metric Learning Haiwen Diao Ying Zhang Shang Gao Jiawen Zhu Long Chen Huchuan Lu 34 4 0 20 Oct 2024
Minimizing Chebyshev Prototype Risk Magically Mitigates the Perils of Overfitting Nathaniel R. Dean Dilip Sarkar AAML 25 0 0 10 Apr 2024
ELRT: Efficient Low-Rank Training for Compact Convolutional Neural Networks Yang Sui Miao Yin Yu Gong Jinqi Xiao Huy Phan Bo Yuan 15 5 0 18 Jan 2024
Towards Better Orthogonality Regularization with Disentangled Norm in Training Deep CNNs Changhao Wu Shenan Zhang Fangsong Long Ziliang Yin Tuo Leng 13 0 0 16 Jun 2023
Curve Your Enthusiasm: Concurvity Regularization in Differentiable Generalized Additive Models Julien N. Siems Konstantin Ditschuneit Winfried Ripken Alma Lindborg Maximilian Schambach Johannes Otterbach Martin Genzel 19 6 0 19 May 2023
Testing the Channels of Convolutional Neural Networks Kang Choi Donghyun Son Younghoon Kim Jiwon Seo 22 1 0 06 Mar 2023
A Survey of Geometric Optimization for Deep Learning: From Euclidean Space to Riemannian Manifold Yanhong Fei Xian Wei Yingjie Liu Zhengyu Li Mingsong Chen 28 6 0 16 Feb 2023
WLD-Reg: A Data-dependent Within-layer Diversity Regularizer Firas Laakom Jenni Raitoharju Alexandros Iosifidis Moncef Gabbouj AI4CE 26 7 0 03 Jan 2023
Orthogonal SVD Covariance Conditioning and Latent Disentanglement Yue Song N. Sebe Wei Wang 26 6 0 11 Dec 2022
Improving Covariance Conditioning of the SVD Meta-layer by Orthogonality Yue Song N. Sebe Wei Wang 19 8 0 05 Jul 2022
Optimization-Induced Graph Implicit Nonlinear Diffusion Qi Chen Yifei Wang Yisen Wang Jiansheng Yang Zhouchen Lin DiffM 48 32 0 29 Jun 2022
Maximum Class Separation as Inductive Bias in One Matrix Tejaswi Kasarla Gertjan J. Burghouts Max van Spengler Elise van der Pol Rita Cucchiara Pascal Mettes 26 22 0 17 Jun 2022
Feature Overcorrelation in Deep Graph Neural Networks: A New Perspective Wei Jin Xiaorui Liu Yao Ma Charu C. Aggarwal Jiliang Tang 30 42 0 15 Jun 2022
Entangled Residual Mappings Mathias Lechner Ramin Hasani Z. Babaiee Radu Grosu Daniela Rus T. Henzinger Sepp Hochreiter 8 4 0 02 Jun 2022
CHALLENGER: Training with Attribution Maps Christian Tomani Daniel Cremers 10 1 0 30 May 2022
Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport Lingkai Kong Yuqing Wang Molei Tao ODL 28 9 0 27 May 2022
Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNs Fanchen Bu D. Chang 28 6 0 12 May 2022
Diverse Imagenet Models Transfer Better Niv Nayman A. Golbert Asaf Noy Tan Ping Lihi Zelnik-Manor 27 0 0 19 Apr 2022
The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy Tianlong Chen Zhenyu (Allen) Zhang Yu Cheng Ahmed Hassan Awadallah Zhangyang Wang ViT 38 37 0 12 Mar 2022
Debiased Graph Neural Networks with Agnostic Label Selection Bias Shaohua Fan Xiao Wang Chuan Shi Kun Kuang Nian Liu Bai Wang AI4CE 42 38 0 19 Jan 2022
OOD-GNN: Out-of-Distribution Generalized Graph Neural Network Haoyang Li Xin Wang Ziwei Zhang Wenwu Zhu OODD OOD 26 97 0 07 Dec 2021
Channel redundancy and overlap in convolutional neural networks with channel-wise NNK graphs David Bonet Antonio Ortega Javier Ruiz-Hidalgo Sarath Shekkizhar GNN 33 7 0 18 Oct 2021
Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generation Yuxiang Wei Yupeng Shi Xiao-Chang Liu Zhilong Ji Yuan Gao Zhongqin Wu W. Zuo 21 55 0 17 Aug 2021
Transfer Learning Gaussian Anomaly Detection by Fine-tuning Representations Oliver Rippel Arnav Chavan Chucai Lei Dorit Merhof 44 18 0 09 Aug 2021
Better Training using Weight-Constrained Stochastic Dynamics B. Leimkuhler Tiffany J. Vlaar Timothée Pouchon Amos Storkey 23 9 0 20 Jun 2021
Optimization Induced Equilibrium Networks Xingyu Xie Qiuhao Wang Zenan Ling Xia Li Yisen Wang Guangcan Liu Zhouchen Lin 13 9 0 27 May 2021
Orthogonalizing Convolutional Layers with the Cayley Transform Asher Trockman J. Zico Kolter 23 110 0 14 Apr 2021
Orthogonal Projection Loss Kanchana Ranasinghe Muzammal Naseer Munawar Hayat Salman Khan F. Khan VLM 27 67 0 25 Mar 2021
Learning with Hyperspherical Uniformity Weiyang Liu Rongmei Lin Zhen Liu Li Xiong Bernhard Schölkopf Adrian Weller 34 35 0 02 Mar 2021
Fast and accurate optimization on the orthogonal manifold without retraction Pierre Ablin Gabriel Peyré 51 26 0 15 Feb 2021
A Deep Graph Neural Networks Architecture Design: From Global Pyramid-like Shrinkage Skeleton to Local Topology Link Rewiring Gege Zhang 21 0 0 16 Dec 2020
Role of Orthogonality Constraints in Improving Properties of Deep Networks for Image Classification Hongjun Choi Anirudh Som P. Turaga 15 8 0 22 Sep 2020
No-reference Screen Content Image Quality Assessment with Unsupervised Domain Adaptation Baoliang Chen Haoliang Li Hongfei Fan Shiqi Wang 22 32 0 19 Aug 2020
Depthwise Spatio-Temporal STFT Convolutional Neural Networks for Human Action Recognition Sudhakar Kumawat Manisha Verma Yuta Nakashima Shanmuganathan Raman 141 42 0 22 Jul 2020
Deep Feature Space: A Geometrical Perspective Ioannis Kansizoglou Loukas Bampis Antonios Gasteratos 33 40 0 30 Jun 2020
Decorrelated Clustering with Data Selection Bias Xiao Wang Shaohua Fan Kun Kuang C. Shi Jiawei Liu Bai Wang 21 15 0 29 Jun 2020
Weakly-correlated synapses promote dimension reduction in deep neural networks Jianwen Zhou Haiping Huang 11 6 0 20 Jun 2020
Constraint-Based Regularization of Neural Networks B. Leimkuhler Timothée Pouchon Tiffany J. Vlaar Amos Storkey 10 10 0 17 Jun 2020
MMA Regularization: Decorrelating Weights of Neural Networks by Maximizing the Minimal Angles Zhennan Wang Canqun Xiang Wenbin Zou Chen Xu 4 19 0 06 Jun 2020
OSLNet: Deep Small-Sample Classification with an Orthogonal Softmax Layer Xiaoxu Li Dongliang Chang Zhanyu Ma Zheng-Hua Tan Jing-Hao Xue Jie Cao Jingyi Yu Jun Guo 28 31 0 20 Apr 2020
Embedding Propagation: Smoother Manifold for Few-Shot Classification Pau Rodríguez I. Laradji Alexandre Drouin Alexandre Lacoste 4 191 0 09 Mar 2020
Neural Network Compression Framework for fast model inference Alexander Kozlov Ivan Lazarevich Vasily Shamporov N. Lyalyushkin Yury Gorbachev 28 35 0 20 Feb 2020
See More, Know More: Unsupervised Video Object Segmentation with Co-Attention Siamese Networks Xiankai Lu Wenguan Wang Chao Ma Jianbing Shen Ling Shao Fatih Porikli VOS 19 461 0 19 Jan 2020
Self-Orthogonality Module: A Network Architecture Plug-in for Learning Orthogonal Filters Ziming Zhang Wenchi Ma Yuanwei Wu Guanghui Wang 32 10 0 05 Jan 2020
Regularizing Deep Multi-Task Networks using Orthogonal Gradients Mihai Suteu Yike Guo 16 59 0 14 Dec 2019
Orthogonal Wasserstein GANs J. Müller Reinhard Klein Michael Weinmann 40 9 0 29 Nov 2019
Orthogonal Convolutional Neural Networks Jiayun Wang Yubei Chen Rudrasis Chakraborty Stella X. Yu 19 185 0 27 Nov 2019
Boosting Network Weight Separability via Feed-Backward Reconstruction Jongmin Yu M. Jeon 21 0 0 20 Oct 2019