The Global Optimization Geometry of Shallow Linear Neural Networks

13 May 2018

Papers citing "The Global Optimization Geometry of Shallow Linear Neural Networks"

22 / 22 papers shown

Title
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks Itay Safran Ohad Shamir 112 263 0 24 Dec 2017
Convolutional Phase Retrieval via Gradient Descent Qing Qu Yuqian Zhang Yonina C. Eldar John N. Wright 70 29 0 03 Dec 2017
First-order Methods Almost Always Avoid Saddle Points Jason D. Lee Ioannis Panageas Georgios Piliouras Max Simchowitz Michael I. Jordan Benjamin Recht ODL 114 83 0 20 Oct 2017
When is a Convolutional Filter Easy To Learn? S. Du Jason D. Lee Yuandong Tian MLT 43 130 0 18 Sep 2017
Global optimality conditions for deep neural networks Chulhee Yun S. Sra Ali Jadbabaie 134 118 0 08 Jul 2017
No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis Rong Ge Chi Jin Yi Zheng 111 435 0 03 Apr 2017
How to Escape Saddle Points Efficiently Chi Jin Rong Ge Praneeth Netrapalli Sham Kakade Michael I. Jordan ODL 155 834 0 02 Mar 2017
An Analytical Formula of Population Gradient for two-layered ReLU network and its Applications in Convergence and Critical Point Analysis Yuandong Tian MLT 104 216 0 02 Mar 2017
Depth Creates No Bad Local Minima Haihao Lu Kenji Kawaguchi ODL FAtt 57 121 0 27 Feb 2017
Exponentially vanishing sub-optimal local minima in multilayer neural networks Daniel Soudry Elad Hoffer 103 97 0 19 Feb 2017
Symmetry, Saddle Points, and Global Optimization Landscape of Nonconvex Matrix Factorization Xingguo Li Junwei Lu R. Arora Jarvis Haupt Han Liu Zhaoran Wang T. Zhao 54 52 0 29 Dec 2016
Non-square matrix sensing without spurious local minima via the Burer-Monteiro approach Dohyung Park Anastasios Kyrillidis Constantine Caramanis Sujay Sanghavi 45 180 0 12 Sep 2016
No bad local minima: Data independent training error guarantees for multilayer neural networks Daniel Soudry Y. Carmon 99 235 0 26 May 2016
Matrix Completion has No Spurious Local Minimum Rong Ge Jason D. Lee Tengyu Ma 46 597 0 24 May 2016
Global Optimality of Local Search for Low Rank Matrix Recovery Srinadh Bhojanapalli Behnam Neyshabur Nathan Srebro ODL 53 388 0 23 May 2016
Deep Learning without Poor Local Minima Kenji Kawaguchi ODL 137 919 0 23 May 2016
A Geometric Analysis of Phase Retrieval Ju Sun Qing Qu John N. Wright 46 524 0 22 Feb 2016
Learning optimal nonlinearities for iterative thresholding algorithms Ulugbek S. Kamilov Hassan Mansour 31 108 0 15 Dec 2015
A Deep Learning Approach to Structured Signal Recovery Ali Mousavi Ankit B. Patel Richard G. Baraniuk 36 441 0 17 Aug 2015
Complete Dictionary Recovery over the Sphere Ju Sun Qing Qu John N. Wright 52 202 0 26 Apr 2015
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition Rong Ge Furong Huang Chi Jin Yang Yuan 112 1,056 0 06 Mar 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 156 18,534 0 06 Feb 2015