Improving training of deep neural networks via Singular Value Bounding

18 November 2016

Papers citing "Improving training of deep neural networks via Singular Value Bounding"

19 / 19 papers shown

Title
Group Orthogonalization Regularization For Vision Models Adaptation and Robustness Yoav Kurtz Noga Bar Raja Giryes 32 0 0 16 Jun 2023
Robust low-rank training via approximate orthonormal constraints Dayana Savostianova Emanuele Zangrando Gianluca Ceruti Francesco Tudisco 26 9 0 02 Jun 2023
Batch Normalization Explained Randall Balestriero Richard G. Baraniuk AAML 36 16 0 29 Sep 2022
Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNs Fanchen Bu D. Chang 28 6 0 12 May 2022
Compact Model Training by Low-Rank Projection with Energy Transfer K. Guo Zhenquan Lin Xiaofen Xing Fang Liu Xiangmin Xu 32 2 0 12 Apr 2022
Weight Evolution: Improving Deep Neural Networks Training through Evolving Inferior Weight Values Zhenquan Lin K. Guo Xiaofen Xing Xiangmin Xu ODL 24 1 0 09 Oct 2021
Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generation Yuxiang Wei Yupeng Shi Xiao-Chang Liu Zhilong Ji Yuan Gao Zhongqin Wu W. Zuo 23 55 0 17 Aug 2021
Coordinate descent on the orthogonal group for recurrent neural network training E. Massart V. Abrol 37 10 0 30 Jul 2021
A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks Asaf Noy Yi Tian Xu Y. Aflalo Lihi Zelnik-Manor R. L. Jin 39 3 0 12 Jan 2021
Deep Isometric Learning for Visual Recognition Haozhi Qi Chong You Xinyu Wang Yi Ma Jitendra Malik VLM 30 53 0 30 Jun 2020
A Perspective on Deep Learning for Molecular Modeling and Simulations Jun Zhang Yao-Kun Lei Zhen Zhang Junhan Chang Maodong Li Xu Han Lijiang Yang Yuqing Yang Y. Gao AI4CE 37 8 0 25 Apr 2020
Deep Representation Learning in Speech Processing: Challenges, Recent Advances, and Future Trends S. Latif R. Rana Sara Khalifa Raja Jurdak Junaid Qadir Björn W. Schuller AI4TS 32 81 0 02 Jan 2020
Orthogonal Wasserstein GANs J. Müller Reinhard Klein Michael Weinmann 48 9 0 29 Nov 2019
Orthogonal Deep Neural Networks Kui Jia Shuai Li Yuxin Wen Tongliang Liu Dacheng Tao 34 132 0 15 May 2019
Deep Multi-View Learning using Neuron-Wise Correlation-Maximizing Regularizers Kui Jia Jiehong Lin Mingkui Tan Dacheng Tao 3DV 25 32 0 25 Apr 2019
Spectral Normalization for Generative Adversarial Networks Takeru Miyato Toshiki Kataoka Masanori Koyama Yuichi Yoshida ODL 35 4,399 0 16 Feb 2018
DizzyRNN: Reparameterizing Recurrent Neural Networks for Norm-Preserving Backpropagation Victor D. Dorobantu Per Andre Stromhaug Jess Renteria 21 25 0 13 Dec 2016
Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflections Zakaria Mhammedi Andrew D. Hellicar Ashfaqur Rahman James Bailey 21 129 0 01 Dec 2016
Optimization on Submanifolds of Convolution Kernels in CNNs Mete Ozay Takayuki Okatani 51 46 0 22 Oct 2016