Second-order optimization with lazy Hessians

1 December 2022

Papers citing "Second-order optimization with lazy Hessians"

8 / 8 papers shown

Title
SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation Dahun Shin Dongyeop Lee Jinseok Chung Namhoon Lee ODL AAML 198 0 0 25 Feb 2025
Second-Order Min-Max Optimization with Lazy Hessians Lesi Chen Chengchang Liu Jingzhao Zhang 46 1 0 12 Oct 2024
Incremental Gauss--Newton Methods with Superlinear Convergence Rates Zhiling Zhou Zhuanghua Liu Chengchang Liu Luo Luo 39 0 0 03 Jul 2024
Cubic regularized subspace Newton for non-convex optimization Jim Zhao Aurelien Lucchi N. Doikov 25 5 0 24 Jun 2024
Exact Gauss-Newton Optimization for Training Deep Neural Networks Mikalai Korbit Adeyemi Damilare Adeoye Alberto Bemporad Mario Zanon ODL 33 0 0 23 May 2024
First and zeroth-order implementations of the regularized Newton method with lazy approximated Hessians N. Doikov G. N. Grapiglia 14 4 0 05 Sep 2023
Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods El Mahdi Chayti N. Doikov Martin Jaggi ODL 27 5 0 23 Feb 2023
Distributed Newton-Type Methods with Communication Compression and Bernoulli Aggregation Rustem Islamov Xun Qian Slavomír Hanzely M. Safaryan Peter Richtárik 35 16 0 07 Jun 2022