Curvature-Informed SGD via General Purpose Lie-Group Preconditioners

7 February 2024

Papers citing "Curvature-Informed SGD via General Purpose Lie-Group Preconditioners"

2 / 2 papers shown

Title
SOAP: Improving and Stabilizing Shampoo using Adam Nikhil Vyas Depen Morwani Rosie Zhao Itai Shapira David Brandfonbrener Lucas Janson Sham Kakade Sham Kakade 75 24 0 17 Sep 2024
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,890 0 15 Sep 2016