An Investigation of Newton-Sketch and Subsampled Newton Methods

17 May 2017

Papers citing "An Investigation of Newton-Sketch and Subsampled Newton Methods"

11 / 11 papers shown

Title
Efficient Curvature-Aware Hypergradient Approximation for Bilevel Optimization Youran Dong Junfeng Yang Wei-Ting Yao Jin Zhang 180 0 0 04 May 2025
Second-order Information Promotes Mini-Batch Robustness in Variance-Reduced Gradients Sachin Garg A. Berahas Michal Dereziñski 46 1 0 23 Apr 2024
Explicit Second-Order Min-Max Optimization Methods with Optimal Convergence Guarantee Tianyi Lin P. Mertikopoulos Michael I. Jordan 26 11 0 23 Oct 2022
Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches Michal Derezinski 55 5 0 06 Jun 2022
Hessian Averaging in Stochastic Newton Methods Achieves Superlinear Convergence Sen Na Michal Derezinski Michael W. Mahoney 27 16 0 20 Apr 2022
Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters Filip Hanzely 34 0 0 26 Aug 2020
Scalable Derivative-Free Optimization for Nonlinear Least-Squares Problems C. Cartis T. Ferguson Lindon Roberts 26 6 0 26 Jul 2020
SONIA: A Symmetric Blockwise Truncated Optimization Algorithm Majid Jahani M. Nazari R. Tappenden A. Berahas Martin Takávc ODL 11 10 0 06 Jun 2020
An Inertial Newton Algorithm for Deep Learning Camille Castera Jérôme Bolte Cédric Févotte Edouard Pauwels PINN ODL 22 62 0 29 May 2019
Quasi-Newton Methods for Machine Learning: Forget the Past, Just Sample A. Berahas Majid Jahani Peter Richtárik Martin Takávc 24 40 0 28 Jan 2019
GPU Accelerated Sub-Sampled Newton's Method Sudhir B. Kylasa Farbod Roosta-Khorasani Michael W. Mahoney A. Grama ODL 26 8 0 26 Feb 2018