Improving Adaptive Moment Optimization via Preconditioner Diagonalization

11 February 2025

Papers citing "Improving Adaptive Moment Optimization via Preconditioner Diagonalization"

3 / 3 papers shown

Title
ASGO: Adaptive Structured Gradient Optimization Kang An Yuxing Liu Boyao Wang Shiqian Ma Shiqian Ma Tong Zhang Tong Zhang ODL 155 5 0 26 Mar 2025
Grams: Gradient Descent with Adaptive Momentum Scaling Yang Cao Xiaoyu Li Zhao Song ODL 213 3 0 22 Dec 2024
Cautious Optimizers: Improving Training with One Line of Code Kaizhao Liang Lizhang Chen B. Liu Qiang Liu ODL 261 9 0 25 Nov 2024