Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality
Regularization and Singular Value Sparsification

Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification

20 April 2020

Huanrui Yang

Yiran Chen

Papers citing "Learning Low-rank Deep Neural Networks via Singular Vector Orthogonality Regularization and Singular Value Sparsification"

11 / 11 papers shown

Title
Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models Xubin Wang Zhiqing Tang Jianxiong Guo Tianhui Meng Chenhao Wang Tian-sheng Wang Weijia Jia 52 1 0 08 Mar 2025
The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction Pratyusha Sharma Jordan T. Ash Dipendra Kumar Misra LRM 19 78 0 21 Dec 2023
Flat Minima in Linear Estimation and an Extended Gauss Markov Theorem Simon Segert 32 0 0 18 Nov 2023
Hypernetwork-based Meta-Learning for Low-Rank Physics-Informed Neural Networks Woojin Cho Kookjin Lee Donsub Rim Noseong Park AI4CE PINN 37 16 0 14 Oct 2023
Robust low-rank training via approximate orthonormal constraints Dayana Savostianova Emanuele Zangrando Gianluca Ceruti Francesco Tudisco 24 9 0 02 Jun 2023
Deep Learning Weight Pruning with RMT-SVD: Increasing Accuracy and Reducing Overfitting Yitzchak Shmalo Jonathan Jenkins Oleksii Krupchytskyi 27 3 0 15 Mar 2023
Stability of Accuracy for the Training of DNNs Via the Uniform Doubling Condition Yitzchak Shmalo 25 1 0 16 Oct 2022
Compression-aware Training of Neural Networks using Frank-Wolfe Max Zimmer Christoph Spiegel Sebastian Pokutta 29 9 0 24 May 2022
Compact Model Training by Low-Rank Projection with Energy Transfer K. Guo Zhenquan Lin Xiaofen Xing Fang Liu Xiangmin Xu 27 2 0 12 Apr 2022
Pruning Pretrained Encoders with a Multitask Objective Patrick Xia Richard Shin 44 0 0 10 Dec 2021
Initialization and Regularization of Factorized Neural Layers M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 65 56 0 03 May 2021