Escaping Saddle-Points Faster under Interpolation-like Conditions

Escaping Saddle-Points Faster under Interpolation-like Conditions

28 September 2020

Krishnakumar Balasubramanian

ArXiv (abs)PDF HTML

Papers citing "Escaping Saddle-Points Faster under Interpolation-like Conditions"

15 / 15 papers shown

Title
Optimization for deep learning: theory and algorithms Ruoyu Sun ODL 124 169 0 19 Dec 2019
Fast and Furious Convergence: Stochastic Second Order Methods under Interpolation S. Meng Sharan Vaswani I. Laradji Mark Schmidt Simon Lacoste-Julien 67 33 0 11 Oct 2019
SNAP: Finding Approximate Second-Order Stationary Solutions Efficiently for Non-convex Linearly Constrained Problems Songtao Lu Meisam Razaviyayn Bo Yang Kejun Huang Mingyi Hong 95 11 0 09 Jul 2019
Sharp Analysis for Nonconvex SGD Escaping from Saddle Points Cong Fang Zhouchen Lin Tong Zhang 71 104 0 01 Feb 2019
Stochastic Recursive Variance-Reduced Cubic Regularization Methods Dongruo Zhou Quanquan Gu 60 26 0 31 Jan 2019
Elimination of All Bad Local Minima in Deep Learning Kenji Kawaguchi L. Kaelbling 75 44 0 02 Jan 2019
On Lazy Training in Differentiable Programming Lénaïc Chizat Edouard Oyallon Francis R. Bach 111 835 0 19 Dec 2018
On the Ineffectiveness of Variance Reduced Optimization for Deep Learning Aaron Defazio Léon Bottou UQCV DRL 53 113 0 11 Dec 2018
Fast and Faster Convergence of SGD for Over-Parameterized Models and an Accelerated Perceptron Sharan Vaswani Francis R. Bach Mark Schmidt 80 298 0 16 Oct 2018
Escaping Saddle Points in Constrained Optimization Aryan Mokhtari Asuman Ozdaglar Ali Jadbabaie 58 53 0 06 Sep 2018
SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator Cong Fang C. J. Li Zhouchen Lin Tong Zhang 92 579 0 04 Jul 2018
The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning Siyuan Ma Raef Bassily M. Belkin 79 288 0 18 Dec 2017
Accelerated Gradient Descent Escapes Saddle Points Faster than Gradient Descent Chi Jin Praneeth Netrapalli Michael I. Jordan ODL 72 262 0 28 Nov 2017
Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition Rong Ge Furong Huang Chi Jin Yang Yuan 140 1,058 0 06 Mar 2015
Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming Saeed Ghadimi Guanghui Lan ODL 120 1,555 0 22 Sep 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.