Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview

25 September 2018

Papers citing "Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview"

50 / 75 papers shown

Title
ALPCAH: Subspace Learning for Sample-wise Heteroscedastic Data Javier Salazar Cavazos Jeffrey A. Fessler Laura Balzano 31 2 0 12 May 2025
Matrix Completion with Graph Information: A Provable Nonconvex Optimization Approach Yao Wang Yiyang Yang Kaidong Wang Shanxing Gao Xiuwu Liao 63 0 0 12 Feb 2025
On Speeding Up Language Model Evaluation Jin Peng Zhou Christian K. Belardi Ruihan Wu Travis Zhang Carla P. Gomes Wen Sun Kilian Q. Weinberger 58 1 0 08 Jul 2024
Computational and Statistical Guarantees for Tensor-on-Tensor Regression with Tensor Train Decomposition Zhen Qin Zhihui Zhu 74 4 0 10 Jun 2024
Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation Can Yaras Peng Wang Laura Balzano Qing Qu AI4CE 37 12 0 06 Jun 2024
$Discrete Aware Matrix Completion via Convexized $\ell_0$-Norm Approximation$ Discrete Aware Matrix Completion via Convexized $\ell_0$ -Norm Approximation Niclas Führling Kengo Ando Giuseppe Thadeu Freitas de Abreu David González González Osvaldo Gonsa 28 1 0 03 May 2024
High Probability Guarantees for Random Reshuffling Hengxu Yu Xiao Li 42 2 0 20 Nov 2023
Matrix Compression via Randomized Low Rank and Low Precision Factorization R. Saha Varun Srivastava Mert Pilanci 26 19 0 17 Oct 2023
Provably Accelerating Ill-Conditioned Low-rank Estimation via Scaled Gradient Descent, Even with Overparameterization Cong Ma Xingyu Xu Tian Tong Yuejie Chi 18 9 0 09 Oct 2023
Gradient-Based Spectral Embeddings of Random Dot Product Graphs Marcelo Fiori Bernardo Marenco Federico Larroca P. Bermolen Gonzalo Mateos BDL 27 3 0 25 Jul 2023
A Theoretically Guaranteed Quaternion Weighted Schatten p-norm Minimization Method for Color Image Restoration Qing-Hua Zhang Liangsheng He Yiliang Wang Liang-Jian Deng Xiaozhong Liu 24 1 0 24 Jul 2023
Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning Kuan-Fu Ding Jingyang Li Kim-Chuan Toh 30 8 0 26 Jun 2023
Gradient descent in matrix factorization: Understanding large initialization Hengchao Chen Xin Chen Mohamad Elmasri Qiang Sun AI4CE 31 1 0 30 May 2023
On the Stepwise Nature of Self-Supervised Learning James B. Simon Maksis Knutins Liu Ziyin Daniel Geisz Abraham J. Fetterman Joshua Albrecht SSL 37 30 0 27 Mar 2023
$Approximate message passing from random initialization with applications to $\mathbb{Z}_{2}$ synchronization$ Approximate message passing from random initialization with applications to $\mathbb{Z}_{2}$ synchronization Gen Li Wei Fan Yuting Wei 26 10 0 07 Feb 2023
The SSL Interplay: Augmentations, Inductive Bias, and Generalization Vivien A. Cabannes B. Kiani Randall Balestriero Yann LeCun A. Bietti SSL 19 31 0 06 Feb 2023
A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization Chuan He Heng Huang Zhaosong Lu 16 1 0 10 Jan 2023
Learning Transition Operators From Sparse Space-Time Samples C. Kümmerle Mauro Maggioni Sui Tang 26 1 0 01 Dec 2022
Perturbation Analysis of Neural Collapse Tom Tirer Haoxiang Huang Jonathan Niles-Weed AAML 35 23 0 29 Oct 2022
Bures-Wasserstein Barycenters and Low-Rank Matrix Recovery Tyler Maunu Thibaut Le Gouic Philippe Rigollet 20 5 0 26 Oct 2022
Are All Losses Created Equal: A Neural Collapse Perspective Jinxin Zhou Chong You Xiao Li Kangning Liu Sheng Liu Qing Qu Zhihui Zhu 36 58 0 04 Oct 2022
A Validation Approach to Over-parameterized Matrix and Image Recovery Lijun Ding Zhen Qin Liwei Jiang Jinxin Zhou Zhihui Zhu 48 13 0 21 Sep 2022
Accelerating SGD for Highly Ill-Conditioned Huge-Scale Online Matrix Completion G. Zhang Hong-Ming Chiu Richard Y. Zhang 24 10 0 24 Aug 2022
Optimal tuning-free convex relaxation for noisy matrix completion Yuepeng Yang Cong Ma 28 8 0 12 Jul 2022
Quantum Neural Network Compression Zhirui Hu Peiyan Dong Zhepeng Wang Youzuo Lin Yanzhi Wang Weiwen Jiang GNN 25 28 0 04 Jul 2022
Variational Bayesian inference for CP tensor completion with side information S. Budzinskiy N. Zamarashkin 11 1 0 24 Jun 2022
Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction Kaifeng Lyu Zhiyuan Li Sanjeev Arora FAtt 40 69 0 14 Jun 2022
Robust Matrix Completion with Heavy-tailed Noise Bingyan Wang Jianqing Fan 21 4 0 09 Jun 2022
Preconditioned Gradient Descent for Overparameterized Nonconvex Burer--Monteiro Factorization with Global Optimality Certification G. Zhang S. Fattahi Richard Y. Zhang 50 23 0 07 Jun 2022
Minimax Optimal Clustering of Bipartite Graphs with a Generalized Power Method Guillaume Braun Hemant Tyagi 25 5 0 24 May 2022
Randomly Initialized Alternating Least Squares: Fast Convergence for Matrix Sensing Kiryung Lee Dominik Stöger 31 11 0 25 Apr 2022
Signal Recovery with Non-Expansive Generative Network Priors Jorio Cocola 21 1 0 24 Apr 2022
Seeded graph matching for the correlated Gaussian Wigner model via the projected power method E. Araya Guillaume Braun Hemant Tyagi 85 4 0 08 Apr 2022
Local Stochastic Factored Gradient Descent for Distributed Quantum State Tomography J. Kim Taha Toghani César A. Uribe Anastasios Kyrillidis 32 3 0 22 Mar 2022
Algorithmic Regularization in Model-free Overparametrized Asymmetric Matrix Factorization Liwei Jiang Yudong Chen Lijun Ding 40 26 0 06 Mar 2022
On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features Jinxin Zhou Xiao Li Tian Ding Chong You Qing Qu Zhihui Zhu 27 97 0 02 Mar 2022
Robust Training under Label Noise by Over-parameterization Sheng Liu Zhihui Zhu Qing Qu Chong You NoLa OOD 27 106 0 28 Feb 2022
Multiway Spherical Clustering via Degree-Corrected Tensor Block Models Jiaxin Hu Miaoyan Wang 23 4 0 19 Jan 2022
Over-Parametrized Matrix Factorization in the Presence of Spurious Stationary Points Armin Eftekhari 24 1 0 25 Dec 2021
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications Khaled B. Letaief Yuanming Shi Jianmin Lu Jianhua Lu 37 416 0 24 Nov 2021
Subquadratic Overparameterization for Shallow Neural Networks Chaehwan Song Ali Ramezani-Kebrya Thomas Pethick Armin Eftekhari V. Cevher 27 31 0 02 Nov 2021
Nonconvex Factorization and Manifold Formulations are Almost Equivalent in Low-rank Matrix Optimization Yuetian Luo Xudong Li Anru R. Zhang 27 9 0 03 Aug 2021
GNMR: A provable one-line algorithm for low rank matrix recovery Pini Zilber B. Nadler 48 13 0 24 Jun 2021
Sharp Restricted Isometry Property Bounds for Low-rank Matrix Recovery Problems with Corrupted Measurements Ziye Ma Yingjie Bi Javad Lavaei Somayeh Sojoudi 23 14 0 18 May 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 27 194 0 06 May 2021
Initialization and Regularization of Factorized Neural Layers M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 65 56 0 03 May 2021
Efficient Sparse Coding using Hierarchical Riemannian Pursuit Ye Xue Vincent K. N. Lau Songfu Cai 28 3 0 21 Apr 2021
Sharp Global Guarantees for Nonconvex Low-rank Recovery in the Noisy Overparameterized Regime Richard Y. Zhang 44 25 0 21 Apr 2021
Group-Sparse Matrix Factorization for Transfer Learning of Word Embeddings Kan Xu Xuanyi Zhao Hamsa Bastani Osbert Bastani 33 6 0 18 Apr 2021
Noisy Gradient Descent Converges to Flat Minima for Nonconvex Matrix Factorization Tianyi Liu Yan Li S. Wei Enlu Zhou T. Zhao 21 13 0 24 Feb 2021