Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition

6 March 2015

Furong Huang

Papers citing "Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition"

50 / 211 papers shown

Title
On the Implicit Bias of Dropout Poorya Mianjy R. Arora René Vidal 27 66 0 26 Jun 2018
Stochastic Nested Variance Reduction for Nonconvex Optimization Dongruo Zhou Pan Xu Quanquan Gu 25 146 0 20 Jun 2018
Learning One-hidden-layer ReLU Networks via Gradient Descent Xiao Zhang Yaodong Yu Lingxiao Wang Quanquan Gu MLT 28 134 0 20 Jun 2018
Defending Against Saddle Point Attack in Byzantine-Robust Distributed Learning Dong Yin Yudong Chen Kannan Ramchandran Peter L. Bartlett FedML 32 97 0 14 Jun 2018
Deep Neural Networks with Multi-Branch Architectures Are Less Non-Convex Hongyang R. Zhang Junru Shao Ruslan Salakhutdinov 39 14 0 06 Jun 2018
An end-to-end Differentially Private Latent Dirichlet Allocation Using a Spectral Algorithm Christopher DeCarolis Mukul Ram Seyed-Alireza Esmaeili Yu-Xiang Wang Furong Huang FedML 11 12 0 25 May 2018
Faster Neural Network Training with Approximate Tensor Operations Menachem Adelman Kfir Y. Levy Ido Hakimi M. Silberstein 29 26 0 21 May 2018
Improved Learning of One-hidden-layer Convolutional Neural Networks with Overlaps S. Du Surbhi Goel MLT 30 17 0 20 May 2018
End-to-end Learning of a Convolutional Neural Network via Deep Tensor Decomposition Samet Oymak Mahdi Soltanolkotabi 21 12 0 16 May 2018
The Global Optimization Geometry of Shallow Linear Neural Networks Zhihui Zhu Daniel Soudry Yonina C. Eldar M. Wakin ODL 18 36 0 13 May 2018
On Gradient-Based Learning in Continuous Games Eric Mazumdar Lillian J. Ratliff S. Shankar Sastry 16 134 0 16 Apr 2018
Escaping Saddles with Stochastic Gradients Hadi Daneshmand Jonas Köhler Aurelien Lucchi Thomas Hofmann 24 161 0 15 Mar 2018
Fast and Sample Efficient Inductive Matrix Completion via Multi-Phase Procrustes Flow Xiao Zhang S. Du Quanquan Gu 26 24 0 03 Mar 2018
Smoothed analysis for low-rank solutions to semidefinite programs in quadratic penalty form Srinadh Bhojanapalli Nicolas Boumal Prateek Jain Praneeth Netrapalli 29 42 0 01 Mar 2018
Stochastic Variance-Reduced Cubic Regularization for Nonconvex Optimization Zhe Wang Yi Zhou Yingbin Liang Guanghui Lan 35 46 0 20 Feb 2018
Global Convergence of Policy Gradient Methods for the Linear Quadratic Regulator Maryam Fazel Rong Ge Sham Kakade M. Mesbahi 35 598 0 15 Jan 2018
Generalization Error Bounds for Noisy, Iterative Algorithms Ankit Pensia Varun Jog Po-Ling Loh 29 109 0 12 Jan 2018
Spurious Local Minima are Common in Two-Layer ReLU Neural Networks Itay Safran Ohad Shamir 40 261 0 24 Dec 2017
Non-convex Optimization for Machine Learning Prateek Jain Purushottam Kar 33 479 0 21 Dec 2017
Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent Chi Jin Praneeth Netrapalli Michael I. Jordan ODL 37 261 0 28 Nov 2017
Neon2: Finding Local Minima via First-Order Oracles Zeyuan Allen-Zhu Yuanzhi Li 21 130 0 17 Nov 2017
On Noisy Negative Curvature Descent: Competing with Gradient Descent for Faster Non-convex Optimization Mingrui Liu Tianbao Yang 33 23 0 25 Sep 2017
SpectralLeader: Online Spectral Learning for Single Topic Models Tong Yu B. Kveton Zheng Wen Hung Bui Ole J. Mengshoel BDL 19 0 0 21 Sep 2017
Natasha 2: Faster Non-Convex Optimization Than SGD Zeyuan Allen-Zhu ODL 28 245 0 29 Aug 2017
Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimization Pan Xu Jinghui Chen Difan Zou Quanquan Gu 31 200 0 20 Jul 2017
Theoretical insights into the optimization landscape of over-parameterized shallow neural networks Mahdi Soltanolkotabi Adel Javanmard J. Lee 36 415 0 16 Jul 2017
A Well-Tempered Landscape for Non-convex Robust Subspace Recovery Tyler Maunu Teng Zhang Gilad Lerman 24 63 0 13 Jun 2017
Are Saddles Good Enough for Deep Learning? Adepu Ravi Sankar V. Balasubramanian 35 5 0 07 Jun 2017
Train longer, generalize better: closing the generalization gap in large batch training of neural networks Elad Hoffer Itay Hubara Daniel Soudry ODL 41 792 0 24 May 2017
Sub-sampled Cubic Regularization for Non-convex Optimization Jonas Köhler Aurelien Lucchi 19 164 0 16 May 2017
On the Gap Between Strict-Saddles and True Convexity: An Omega(log d) Lower Bound for Eigenvector Approximation Max Simchowitz A. Alaoui Benjamin Recht 18 13 0 14 Apr 2017
No Spurious Local Minima in Nonconvex Low Rank Problems: A Unified Geometric Analysis Rong Ge Chi Jin Yi Zheng 41 433 0 03 Apr 2017
Data-Dependent Stability of Stochastic Gradient Descent Ilja Kuzborskij Christoph H. Lampert MLT 9 165 0 05 Mar 2017
How to Escape Saddle Points Efficiently Chi Jin Rong Ge Praneeth Netrapalli Sham Kakade Michael I. Jordan ODL 37 831 0 02 Mar 2017
Natasha: Faster Non-Convex Stochastic Optimization Via Strongly Non-Convex Parameter Zeyuan Allen-Zhu 20 80 0 02 Feb 2017
Convergence Results for Neural Networks via Electrodynamics Rina Panigrahy Sushant Sachdeva Qiuyi Zhang MLT MDE 29 22 0 01 Feb 2017
Fast Rates for Empirical Risk Minimization of Strict Saddle Problems Alon Gonen Shai Shalev-Shwartz 41 30 0 16 Jan 2017
Symmetry, Saddle Points, and Global Optimization Landscape of Nonconvex Matrix Factorization Xingguo Li Junwei Lu R. Arora Jarvis Haupt Han Liu Zhaoran Wang T. Zhao 43 52 0 29 Dec 2016
The Power of Normalization: Faster Evasion of Saddle Points Kfir Y. Levy 22 108 0 15 Nov 2016
Finding Approximate Local Minima Faster than Gradient Descent Naman Agarwal Zeyuan Allen-Zhu Brian Bullins Elad Hazan Tengyu Ma 38 83 0 03 Nov 2016
Homotopy Analysis for Tensor PCA Anima Anandkumar Yuan-bei Deng Rong Ge H. Mobahi 30 43 0 28 Oct 2016
Convergence rate of stochastic k-means Cheng Tang C. Monteleoni 26 26 0 16 Oct 2016
Gradient Descent Learns Linear Dynamical Systems Moritz Hardt Tengyu Ma Benjamin Recht 16 237 0 16 Sep 2016
Non-square matrix sensing without spurious local minima via the Burer-Monteiro approach Dohyung Park Anastasios Kyrillidis C. Caramanis Sujay Sanghavi 23 179 0 12 Sep 2016
Local Maxima in the Likelihood of Gaussian Mixture Models: Structural Results and Algorithmic Consequences Chi Jin Yuchen Zhang Sivaraman Balakrishnan Martin J. Wainwright Michael I. Jordan 37 131 0 04 Sep 2016
Piecewise convexity of artificial neural networks Blaine Rister Daniel L Rubin AAML ODL 28 31 0 17 Jul 2016
Online and Differentially-Private Tensor Decomposition Yining Wang Anima Anandkumar 27 38 0 20 Jun 2016
Provable Efficient Online Matrix Completion via Non-convex Stochastic Gradient Descent Chi Jin Sham Kakade Praneeth Netrapalli 19 81 0 26 May 2016
Matrix Completion has No Spurious Local Minimum Rong Ge J. Lee Tengyu Ma 25 596 0 24 May 2016
Global Optimality of Local Search for Low Rank Matrix Recovery Srinadh Bhojanapalli Behnam Neyshabur Nathan Srebro ODL 36 386 0 23 May 2016