MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence

24 May 2024

Dan Alistarh

Papers citing "MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence"

2 / 2 papers shown

Title
LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics Thomas Robert M. Safaryan Ionut-Vlad Modoranu Dan Alistarh ODL 36 2 0 21 Oct 2024
A Simple Convergence Proof of Adam and Adagrad Alexandre Défossez Léon Bottou Francis R. Bach Nicolas Usunier 56 143 0 05 Mar 2020