Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad

5 March 2024

Papers citing "Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad"

2 / 2 papers shown

Title
Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance Dimitris Oikonomou Nicolas Loizou 55 4 0 06 Jun 2024
A Simple Convergence Proof of Adam and Adagrad Alexandre Défossez Léon Bottou Francis R. Bach Nicolas Usunier 56 144 0 05 Mar 2020