The Geometry of Sign Gradient Descent

The Geometry of Sign Gradient Descent

19 February 2020

Fabian Pedregosa

Nicolas Le Roux

Papers citing "The Geometry of Sign Gradient Descent"

6 / 6 papers shown

Title
Faster Acceleration for Steepest Descent Site Bai Brian Bullins ODL 36 0 0 28 Sep 2024
Deconstructing What Makes a Good Optimizer for Language Models Rosie Zhao Depen Morwani David Brandfonbrener Nikhil Vyas Sham Kakade 50 17 0 10 Jul 2024
Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models Frederik Kunstner Robin Yadav Alan Milligan Mark Schmidt Alberto Bietti 39 25 0 29 Feb 2024
Nonlinear gradient mappings and stochastic optimization: A general framework with applications to heavy-tail noise D. Jakovetić Dragana Bajović Anit Kumar Sahu S. Kar Nemanja Milošević Dusan Stamenkovic 19 12 0 06 Apr 2022
Hard to Forget: Poisoning Attacks on Certified Machine Unlearning Neil G. Marchant Benjamin I. P. Rubinstein Scott Alfeld MU AAML 25 69 0 17 Sep 2021
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark W. Schmidt 139 1,201 0 16 Aug 2016