AdaFisher: Adaptive Second Order Optimization via Fisher Information

26 May 2024

Papers citing "AdaFisher: Adaptive Second Order Optimization via Fisher Information"

6 / 56 papers shown

Title
Optimizing Neural Networks with Kronecker-factored Approximate Curvature James Martens Roger C. Grosse ODL 95 1,009 0 19 Mar 2015
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift Sergey Ioffe Christian Szegedy OOD 428 43,234 0 11 Feb 2015
New insights and perspectives on the natural gradient method James Martens ODL 69 620 0 03 Dec 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.5K 39,472 0 01 Sep 2014
ADADELTA: An Adaptive Learning Rate Method Matthew D. Zeiler ODL 132 6,623 0 22 Dec 2012
No More Pesky Learning Rates Tom Schaul Sixin Zhang Yann LeCun 123 477 0 06 Jun 2012