Gradient Centralization: A New Optimization Technique for Deep Neural Networks

3 April 2020

Lei Zhang

Papers citing "Gradient Centralization: A New Optimization Technique for Deep Neural Networks"

23 / 23 papers shown

Title
Sharpness-Aware Minimization with Z-Score Gradient Filtering for Neural Networks Juyoung Yun 38 0 0 05 May 2025
FisheyeDetNet: 360° Surround view Fisheye Camera based Object Detection System for Autonomous Driving Ganesh Sistu S. Yogamani 36 0 0 20 Apr 2024
Robust Localization of Key Fob Using Channel Impulse Response of Ultra Wide Band Sensors for Keyless Entry Systems A. Kolli Filippo Casamassima Horst Possegger Horst Bischof AAML 18 1 0 16 Jan 2024
SING: A Plug-and-Play DNN Learning Technique Adrien Courtois Damien Scieur Jean-Michel Morel Pablo Arias Thomas Eboli 28 0 0 25 May 2023
FewShotTextGCN: K-hop neighborhood regularization for few-shot learning on graphs Niels van der Heijden Ekaterina Shutova H. Yannakoudakis 23 0 0 25 Jan 2023
DIGEST: Deeply supervIsed knowledGE tranSfer neTwork learning for brain tumor segmentation with incomplete multi-modal MRI scans Haoran Li Cheng Li Weijian Huang Xiawu Zheng Yantao Xi Shanshan Wang MedIm 28 2 0 15 Nov 2022
SADT: Combining Sharpness-Aware Minimization with Self-Distillation for Improved Model Generalization Masud An Nur Islam Fahim Jani Boutellier 32 0 0 01 Nov 2022
Batch Layer Normalization, A new normalization layer for CNNs and RNN A. Ziaee Erion cCano 11 12 0 19 Sep 2022
PanorAMS: Automatic Annotation for Detecting Objects in Urban Context Inske Groenen S. Rudinac M. Worring 13 4 0 30 Aug 2022
RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation Ruida Zhang Yan Di Zhiqiang Lou Fabian Manhardt F. Tombari Xiangyang Ji 3DPC 14 47 0 30 Jul 2022
CATRE: Iterative Point Clouds Alignment for Category-level Object Pose Refinement Xingyu Liu Gu Wang Yi Li Xiangyang Ji 3DPC 21 28 0 17 Jul 2022
AdaInject: Injection Based Adaptive Gradient Descent Optimizers for Convolutional Neural Networks S. Dubey S. H. Shabbeer Basha S. Singh B. B. Chaudhuri ODL 40 9 0 26 Sep 2021
Activated Gradients for Deep Neural Networks Mei Liu Liangming Chen Xiaohao Du Long Jin Mingsheng Shang ODL AI4CE 21 135 0 09 Jul 2021
A Light-weight Deep Human Activity Recognition Algorithm Using Multi-knowledge Distillation Runze Chen Haiyong Luo Fang Zhao Xuechun Meng Zhiqing Xie Yida Zhu VLM HAI 24 2 0 06 Jul 2021
Ranger21: a synergistic deep learning optimizer Less Wright Nestor Demeure ODL AI4CE 22 85 0 25 Jun 2021
SGTBN: Generating Dense Depth Maps from Single-Line LiDAR Hengjie Lu Shugong Xu Shan Cao 3DV 22 9 0 24 Jun 2021
PingAn-VCGroup's Solution for ICDAR 2021 Competition on Scientific Literature Parsing Task B: Table Recognition to HTML Jiaquan Ye Xianbiao Qi Yelin He Yihao Chen Dengyi Gu Peng Gao Rong Xiao LMTD 26 48 0 05 May 2021
Urban Sound Classification : striving towards a fair comparison Augustin Arnault Baptiste Hanssens Nicolas Riche 16 8 0 22 Oct 2020
Weight and Gradient Centralization in Deep Neural Networks Wolfgang Fuhl Enkelejda Kasneci ODL 13 18 0 02 Oct 2020
End-to-End Differentiable Learning to HDR Image Synthesis for Multi-exposure Images J. H. Kim Siyeong Lee Suk-ju Kang 8 36 0 29 Jun 2020
Iterative Averaging in the Quest for Best Test Error Diego Granziol Xingchen Wan Samuel Albanie Stephen J. Roberts 10 3 0 02 Mar 2020
Learning Rate Dropout Huangxing Lin Weihong Zeng Xinghao Ding Yue Huang Yihong Zhuang John Paisley ODL 16 9 0 30 Nov 2019
Aggregated Residual Transformations for Deep Neural Networks Saining Xie Ross B. Girshick Piotr Dollár Z. Tu Kaiming He 297 10,220 0 16 Nov 2016