ResearchTrend.AI
Incorporating the Barzilai-Borwein Adaptive Step Size into Sugradient Methods for Deep Network Training

Incorporating the Barzilai-Borwein Adaptive Step Size into Sugradient Methods for Deep Network Training

A. Robles-Kelly
A. Nazari
    ODL
ArXivPDFHTML

Papers citing "Incorporating the Barzilai-Borwein Adaptive Step Size into Sugradient Methods for Deep Network Training"

5 / 5 papers shown
Title
On the Convergence of Adam and Beyond
On the Convergence of Adam and Beyond
Sashank J. Reddi
Satyen Kale
Surinder Kumar
90
2,499
0
19 Apr 2019
On the Influence of Momentum Acceleration on Online Learning
On the Influence of Momentum Acceleration on Online Learning
Kun Yuan
Bicheng Ying
Ali H. Sayed
62
58
0
14 Mar 2016
Adam: A Method for Stochastic Optimization
Adam: A Method for Stochastic Optimization
Diederik P. Kingma
Jimmy Ba
ODL
1.8K
150,039
0
22 Dec 2014
ADADELTA: An Adaptive Learning Rate Method
ADADELTA: An Adaptive Learning Rate Method
Matthew D. Zeiler
ODL
148
6,626
0
22 Dec 2012
Advances in Optimizing Recurrent Networks
Advances in Optimizing Recurrent Networks
Yoshua Bengio
Nicolas Boulanger-Lewandowski
Razvan Pascanu
ODL
100
522
0
04 Dec 2012

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.