ResearchTrend.AI
Understanding Why Adam Outperforms SGD: Gradient Heterogeneity in Transformers

Understanding Why Adam Outperforms SGD: Gradient Heterogeneity in Transformers

Akiyoshi Tomihari
Issei Sato
    ODL
ArXivPDFHTML

Papers citing "Understanding Why Adam Outperforms SGD: Gradient Heterogeneity in Transformers"

2 / 52 papers shown
Title
Optimizing Neural Networks with Kronecker-factored Approximate Curvature
Optimizing Neural Networks with Kronecker-factored Approximate Curvature
James Martens
Roger C. Grosse
ODL
95
1,009
0
19 Mar 2015
Fine-Grained Visual Classification of Aircraft
Fine-Grained Visual Classification of Aircraft
Subhransu Maji
Esa Rahtu
Arno Solin
Matthew Blaschko
Andrea Vedaldi
107
2,252
0
21 Jun 2013