Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization

13 April 2025

Papers citing "Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization"

48 / 48 papers shown

Title
PoLAR: Polar-Decomposed Low-Rank Adapter Representation Kai Lion Liang Zhang Bingcong Li Niao He 53 0 0 03 Jun 2025
RGNMR: A Gauss-Newton method for robust matrix completion with theoretical guarantees Eilon Vaknin Laufer Boaz Nadler 63 0 0 19 May 2025
AltLoRA: Towards Better Gradient Approximation in Low-Rank Adaptation with Alternating Projections Xin Yu Yujia Wang Jinghui Chen Lingzhou Xue 93 0 0 18 May 2025
BLAST: Block-Level Adaptive Structured Matrices for Efficient Deep Neural Network Inference Changwoo Lee Soo Min Kwon Qing Qu Hun-Seok Kim 82 0 0 28 Oct 2024
On the Crucial Role of Initialization for Matrix Factorization Bingcong Li Liang Zhang Aryan Mokhtari Niao He 163 6 0 24 Oct 2024
Toward Global Convergence of Gradient EM for Over-Parameterized Gaussian Mixture Models Weihang Xu Maryam Fazel S. Du 89 2 0 29 Jun 2024
Computational and Statistical Guarantees for Tensor-on-Tensor Regression with Tensor Train Decomposition Zhen Qin Zhihui Zhu 212 5 0 10 Jun 2024
Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent Zhiyu Liu Zhi Han Yandong Tang Xi-Le Zhao Yao Wang 177 1 0 22 Jan 2024
Guaranteed Nonconvex Factorization Approach for Tensor Train Recovery Zhen Qin M. Wakin Zhihui Zhu 82 6 0 05 Jan 2024
How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization Nuoya Xiong Lijun Ding Simon S. Du 104 13 0 03 Oct 2023
Fast and Accurate Estimation of Low-Rank Matrices from Noisy Measurements via Preconditioned Non-Convex Gradient Descent Jialun Zhang Hong-Ming Chiu Richard Y. Zhang 124 6 0 26 May 2023
The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing Xingyu Xu Yandi Shen Yuejie Chi Cong Ma 122 37 0 02 Feb 2023
Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition Jianhao Ma Li-Zhen Guo Salar Fattahi 73 4 0 01 Oct 2022
A Validation Approach to Over-parameterized Matrix and Image Recovery Lijun Ding Zhen Qin Liwei Jiang Jinxin Zhou Zhihui Zhu 110 14 0 21 Sep 2022
Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completion G. Zhang Hong-Ming Chiu Richard Y. Zhang 75 10 0 24 Aug 2022
Improved Global Guarantees for the Nonconvex Burer--Monteiro Factorization via Rank Overparameterization Richard Y. Zhang 106 24 0 05 Jul 2022
Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplay Yuetian Luo Anru R. Zhang 106 20 0 17 Jun 2022
Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certification G. Zhang Salar Fattahi Richard Y. Zhang 163 24 0 07 Jun 2022
Algorithmic Regularization in Model-free Overparametrized Asymmetric Matrix Factorization Liwei Jiang Yudong Chen Lijun Ding 77 27 0 06 Mar 2022
Sharp Global Guarantees for Nonconvex Low-rank Recovery in the Noisy Overparameterized Regime Richard Y. Zhang 114 1 0 21 Apr 2021
On the computational and statistical complexity of over-parameterized matrix sensing Jiacheng Zhuo Jeongyeol Kwon Nhat Ho Constantine Caramanis 141 28 0 27 Jan 2021
Low-Rank Matrix Recovery with Scaled Subgradient Methods: Fast and Robust Convergence Without the Condition Number Tian Tong Cong Ma Yuejie Chi 105 56 0 26 Oct 2020
Accelerating Ill-Conditioned Low-Rank Matrix Estimation via Scaled Gradient Descent Tian Tong Cong Ma Yuejie Chi 104 120 0 18 May 2020
Sharp Restricted Isometry Bounds for the Inexistence of Spurious Local Minima in Nonconvex Matrix Recovery Richard Y. Zhang Somayeh Sojoudi Javad Lavaei 78 51 0 07 Jan 2019
How Much Restricted Isometry is Needed In Nonconvex Matrix Recovery? Richard Y. Zhang C. Josz Somayeh Sojoudi Javad Lavaei 66 42 0 25 May 2018
No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis Rong Ge Chi Jin Yi Zheng 151 436 0 03 Apr 2017
How to Escape Saddle Points Efficiently Chi Jin Rong Ge Praneeth Netrapalli Sham Kakade Michael I. Jordan ODL 237 838 0 02 Mar 2017
Structured signal recovery from quadratic measurements: Breaking sample complexity barriers via nonconvex optimization Mahdi Soltanolkotabi 78 102 0 20 Feb 2017
Fast Algorithms for Robust PCA via Gradient Descent Xinyang Yi Dohyung Park Yudong Chen Constantine Caramanis 109 267 0 25 May 2016
Matrix Completion has No Spurious Local Minimum Rong Ge Jason D. Lee Tengyu Ma 147 599 0 24 May 2016
Global Optimality of Local Search for Low Rank Matrix Recovery Srinadh Bhojanapalli Behnam Neyshabur Nathan Srebro ODL 135 388 0 23 May 2016
A Geometric Analysis of Phase Retrieval Ju Sun Qing Qu John N. Wright 144 526 0 22 Feb 2016
Complete Dictionary Recovery over the Sphere I: Overview and the Geometric Picture Ju Sun Qing Qu John N. Wright 132 159 0 11 Nov 2015
Dropping Convexity for Faster Semi-definite Optimization Srinadh Bhojanapalli Anastasios Kyrillidis Sujay Sanghavi 101 173 0 14 Sep 2015
Fast low-rank estimation by projected gradient descent: General statistical and algorithmic guarantees Yudong Chen Martin J. Wainwright 295 318 0 10 Sep 2015
A Convergent Gradient Descent Algorithm for Rank Minimization and Semidefinite Programming from Random Linear Measurements Qinqing Zheng John D. Lafferty 138 186 0 19 Jun 2015
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition Rong Ge Furong Huang Chi Jin Yang Yuan 149 1,059 0 06 Mar 2015
An Introduction to Matrix Concentration Inequalities J. Tropp 198 1,155 0 07 Jan 2015
Guaranteed Matrix Completion via Non-convex Factorization Ruoyu Sun Zhi-Quan Luo 128 453 0 28 Nov 2014
Non-convex Robust PCA Praneeth Netrapalli U. Niranjan Sujay Sanghavi Anima Anandkumar Prateek Jain 113 286 0 28 Oct 2014
Fast matrix completion without the condition number Moritz Hardt Mary Wootters 118 108 0 15 Jul 2014
Phase Retrieval via Wirtinger Flow: Theory and Algorithms Emmanuel Candes Xiaodong Li Mahdi Soltanolkotabi 203 1,292 0 03 Jul 2014
Low-rank Matrix Completion using Alternating Minimization Prateek Jain Praneeth Netrapalli Sujay Sanghavi 228 1,069 0 03 Dec 2012
Estimation of (near) low-rank matrices with noise and high-dimensional scaling S. Negahban Martin J. Wainwright 245 571 0 27 Dec 2009
Guaranteed Rank Minimization via Singular Value Projection Raghu Meka Prateek Jain Inderjit S. Dhillon 215 554 0 30 Sep 2009
Rank-Sparsity Incoherence for Matrix Decomposition V. Chandrasekaran Sujay Sanghavi P. Parrilo A. Willsky CML 286 1,112 0 11 Jun 2009
Matrix Completion from a Few Entries Raghunandan H. Keshavan Andrea Montanari Sewoong Oh 479 1,250 0 20 Jan 2009
Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization Benjamin Recht Maryam Fazel P. Parrilo 444 3,773 0 28 Jun 2007