Newton-LESS: Sparsification without Trade-offs for the Sketched Newton Update

15 July 2021

Papers citing "Newton-LESS: Sparsification without Trade-offs for the Sketched Newton Update"

6 / 6 papers shown

Title
Surrogate-based Autotuning for Randomized Sketching Algorithms in Regression Problems Younghyun Cho James Demmel Michal Derezinski Haoyun Li Hengrui Luo Michael W. Mahoney Riley Murray 29 5 0 30 Aug 2023
An Efficient Nonlinear Acceleration method that Exploits Symmetry of the Hessian Huan He Shifan Zhao Z. Tang Joyce C. Ho Y. Saad Yuanzhe Xi 16 3 0 22 Oct 2022
Sharp Analysis of Sketch-and-Project Methods via a Connection to Randomized Singular Value Decomposition Michal Derezinski E. Rebrova 27 16 0 20 Aug 2022
Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches Michal Derezinski 49 5 0 06 Jun 2022
Hessian Averaging in Stochastic Newton Methods Achieves Superlinear Convergence Sen Na Michal Derezinski Michael W. Mahoney 27 16 0 20 Apr 2022
Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time Zhao-quan Song Licheng Zhang Ruizhe Zhang 23 63 0 14 Dec 2021