When Are Nonconvex Problems Not Scary?

21 October 2015

Qing Qu

Papers citing "When Are Nonconvex Problems Not Scary?"

31 / 31 papers shown

Title
On Newton's Method to Unlearn Neural Networks Nhung Bui Xinyang Lu Rachael Hwee Ling Sim See-Kiong Ng Bryan Kian Hsiang Low MU 41 2 0 20 Jun 2024
Neural Collapse in Multi-label Learning with Pick-all-label Loss Pengyu Li Xiao Li Yutong Wang Qing Qu 30 8 0 24 Oct 2023
Generalized Gradient Flows with Provable Fixed-Time Convergence and Fast Evasion of Non-Degenerate Saddle Points Mayank Baranwal Param Budhraja V. Raj A. Hota 33 2 0 07 Dec 2022
Are All Losses Created Equal: A Neural Collapse Perspective Jinxin Zhou Chong You Xiao Li Kangning Liu Sheng Liu Qing Qu Zhihui Zhu 36 58 0 04 Oct 2022
Nonconvex Matrix Factorization is Geodesically Convex: Global Landscape Analysis for Fixed-rank Matrix Optimization From a Riemannian Perspective Yuetian Luo Nicolas García Trillos 24 6 0 29 Sep 2022
Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold Can Yaras Peng Wang Zhihui Zhu Laura Balzano Qing Qu 25 41 0 19 Sep 2022
On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features Jinxin Zhou Xiao Li Tian Ding Chong You Qing Qu Zhihui Zhu 27 97 0 02 Mar 2022
Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction Dominik Stöger Mahdi Soltanolkotabi ODL 42 75 0 28 Jun 2021
A Geometric Analysis of Neural Collapse with Unconstrained Features Zhihui Zhu Tianyu Ding Jinxin Zhou Xiao Li Chong You Jeremias Sulam Qing Qu 27 194 0 06 May 2021
Likelihood landscape and maximum likelihood estimation for the discrete orbit recovery model Z. Fan Yi Sun Tianhao Wang Yihong Wu 27 18 0 31 Mar 2020
Fair Principal Component Analysis and Filter Design Gad Zalcberg A. Wiesel 16 13 0 16 Feb 2020
$Depth Descent Synchronization in $\mathrm{SO}(D)$$ Depth Descent Synchronization in $\mathrm{SO}(D)$ Tyler Maunu Gilad Lerman MDE 34 2 0 13 Feb 2020
Analysis of the Optimization Landscapes for Overcomplete Representation Learning Qing Qu Yuexiang Zhai Xiao Li Yuqian Zhang Zhihui Zhu 20 9 0 05 Dec 2019
Subgradient Descent Learns Orthogonal Dictionaries Yu Bai Qijia Jiang Ju Sun 17 51 0 25 Oct 2018
Diffusion Approximations for Online Principal Component Estimation and Global Convergence C. J. Li Mengdi Wang Han Liu Tong Zhang 34 12 0 29 Aug 2018
Convergence of Cubic Regularization for Nonconvex Optimization under KL Property Yi Zhou Zhe Wang Yingbin Liang 24 23 0 22 Aug 2018
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks Itay Safran Ohad Shamir 40 261 0 24 Dec 2017
Non-convex Optimization for Machine Learning Prateek Jain Purushottam Kar 33 478 0 21 Dec 2017
Blind Gain and Phase Calibration via Sparse Spectral Methods Yanjun Li Kiryung Lee Y. Bresler 19 27 0 30 Nov 2017
A Well-Tempered Landscape for Non-convex Robust Subspace Recovery Tyler Maunu Teng Zhang Gilad Lerman 24 63 0 13 Jun 2017
Sub-sampled Cubic Regularization for Non-convex Optimization Jonas Köhler Aurelien Lucchi 11 164 0 16 May 2017
On the Gap Between Strict-Saddles and True Convexity: An Omega(log d) Lower Bound for Eigenvector Approximation Max Simchowitz A. Alaoui Benjamin Recht 18 13 0 14 Apr 2017
No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis Rong Ge Chi Jin Yi Zheng 36 433 0 03 Apr 2017
Convergence Results for Neural Networks via Electrodynamics Rina Panigrahy Sushant Sachdeva Qiuyi Zhang MLT MDE 26 22 0 01 Feb 2017
Fast Rates for Empirical Risk Minimization of Strict Saddle Problems Alon Gonen Shai Shalev-Shwartz 35 29 0 16 Jan 2017
Fast Algorithms for Robust PCA via Gradient Descent Xinyang Yi Dohyung Park Yudong Chen C. Caramanis 21 264 0 25 May 2016
Matrix Completion has No Spurious Local Minimum Rong Ge J. Lee Tengyu Ma 13 596 0 24 May 2016
Complete Dictionary Recovery over the Sphere Ju Sun Qing Qu John N. Wright 33 202 0 26 Apr 2015
Finding a sparse vector in a subspace: Linear sparsity using alternating directions Qing Qu Ju Sun John N. Wright 14 111 0 15 Dec 2014
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 183 1,185 0 30 Nov 2014
Fast, Robust and Non-convex Subspace Recovery Gilad Lerman Tyler Maunu 34 77 0 24 Jun 2014