Sub-sampled Cubic Regularization for Non-convex Optimization

16 May 2017

Papers citing "Sub-sampled Cubic Regularization for Non-convex Optimization"

28 / 28 papers shown

Title
On the Statistical Complexity of Estimating Vendi Scores from Empirical Data Azim Ospanov Farzan Farnia 43 1 0 17 Feb 2025
SAPPHIRE: Preconditioned Stochastic Variance Reduction for Faster Large-Scale Statistical Learning Jingruo Sun Zachary Frangella Madeleine Udell 36 0 0 28 Jan 2025
Two-Timescale Gradient Descent Ascent Algorithms for Nonconvex Minimax Optimization Tianyi Lin Chi Jin Michael I. Jordan 52 7 0 28 Jan 2025
A learning-based approach to stochastic optimal control under reach-avoid constraint Tingting Ni Maryam Kamgarpour 82 0 0 21 Dec 2024
Incremental Gauss--Newton Methods with Superlinear Convergence Rates Zhiling Zhou Zhuanghua Liu Chengchang Liu Luo Luo 39 0 0 03 Jul 2024
Cubic regularized subspace Newton for non-convex optimization Jim Zhao Aurelien Lucchi N. Doikov 30 5 0 24 Jun 2024
Understanding Retrieval-Augmented Task Adaptation for Vision-Language Models Yifei Ming Yixuan Li VLM 39 7 0 02 May 2024
Time-Uniform Confidence Spheres for Means of Random Vectors Ben Chugg Hongjian Wang Aaditya Ramdas 51 5 0 14 Nov 2023
Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods El Mahdi Chayti N. Doikov Martin Jaggi ODL 27 5 0 23 Feb 2023
Faster Riemannian Newton-type Optimization by Subsampling and Cubic Regularization Yian Deng Tingting Mu 21 1 0 22 Feb 2023
Scalable Multi-Agent Reinforcement Learning with General Utilities Donghao Ying Yuhao Ding Alec Koppel Javad Lavaei 38 1 0 15 Feb 2023
Differentially Private Optimization for Smooth Nonconvex ERM Changyu Gao Stephen J. Wright 16 6 0 09 Feb 2023
Stochastic Dimension-reduced Second-order Methods for Policy Optimization Jinsong Liu Chen Xie Qinwen Deng Dongdong Ge Yi-Li Ye 32 1 0 28 Jan 2023
A Stability Analysis of Fine-Tuning a Pre-Trained Model Z. Fu Anthony Man-Cho So Nigel Collier 23 3 0 24 Jan 2023
Second-order optimization with lazy Hessians N. Doikov El Mahdi Chayti Martin Jaggi 26 16 0 01 Dec 2022
SP2: A Second Order Stochastic Polyak Method Shuang Li W. Swartworth Martin Takávc Deanna Needell Robert Mansel Gower 26 13 0 17 Jul 2022
Augmented Newton Method for Optimization: Global Linear Rate and Momentum Interpretation M. Morshed ODL 24 1 0 23 May 2022
HessianFR: An Efficient Hessian-based Follow-the-Ridge Algorithm for Minimax Optimization Yihang Gao Huafeng Liu Michael K. Ng Mingjie Zhou 25 2 0 23 May 2022
Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters Filip Hanzely 34 0 0 26 Aug 2020
Combining Stochastic Adaptive Cubic Regularization with Negative Curvature for Nonconvex Optimization Seonho Park Seung Hyun Jung P. Pardalos ODL 29 15 0 27 Jun 2019
Convergence of Cubic Regularization for Nonconvex Optimization under KL Property Yi Zhou Zhe Wang Yingbin Liang 24 23 0 22 Aug 2018
Stochastic Nested Variance Reduction for Nonconvex Optimization Dongruo Zhou Pan Xu Quanquan Gu 25 146 0 20 Jun 2018
Local Saddle Point Optimization: A Curvature Exploitation Approach Leonard Adolphs Hadi Daneshmand Aurelien Lucchi Thomas Hofmann 37 107 0 15 May 2018
Escaping Saddles with Stochastic Gradients Hadi Daneshmand Jonas Köhler Aurelien Lucchi Thomas Hofmann 24 161 0 15 Mar 2018
Stochastic Variance-Reduced Cubic Regularization for Nonconvex Optimization Zhe Wang Yi Zhou Yingbin Liang Guanghui Lan 35 46 0 20 Feb 2018
On Noisy Negative Curvature Descent: Competing with Gradient Descent for Faster Non-convex Optimization Mingrui Liu Tianbao Yang 30 23 0 25 Sep 2017
Informed Non-convex Robust Principal Component Analysis with Features Niannan Xue Jiankang Deng Yannis Panagakis S. Zafeiriou 18 7 0 14 Sep 2017
The Loss Surfaces of Multilayer Networks A. Choromańska Mikael Henaff Michaël Mathieu Gerard Ben Arous Yann LeCun ODL 183 1,185 0 30 Nov 2014