How Does Adaptive Optimization Impact Local Neural Network Geometry?

4 November 2022

Papers citing "How Does Adaptive Optimization Impact Local Neural Network Geometry?"

2 / 2 papers shown

Title
Deconstructing What Makes a Good Optimizer for Language Models Rosie Zhao Depen Morwani David Brandfonbrener Nikhil Vyas Sham Kakade 81 22 0 10 Jul 2024
AdaFisher: Adaptive Second Order Optimization via Fisher Information Damien Martins Gomes Yanlei Zhang Eugene Belilovsky Guy Wolf Mahdi S. Hosseini ODL 134 2 0 26 May 2024