RNN Training along Locally Optimal Trajectories via Frank-Wolfe
Algorithm

v1v2v3 (latest)

RNN Training along Locally Optimal Trajectories via Frank-Wolfe Algorithm

12 October 2020

Venkatesh Saligrama

ArXiv (abs)PDF HTML

Papers citing "RNN Training along Locally Optimal Trajectories via Frank-Wolfe Algorithm"

16 / 16 papers shown

Title
Latent ODEs for Irregularly-Sampled Time Series Yulia Rubanova Ricky T. Q. Chen David Duvenaud BDL AI4TS 84 259 0 08 Jul 2019
Why gradient clipping accelerates training: A theoretical justification for adaptivity J.N. Zhang Tianxing He S. Sra Ali Jadbabaie 78 467 0 28 May 2019
AntisymmetricRNN: A Dynamical System View on Recurrent Neural Networks B. Chang Minmin Chen E. Haber Ed H. Chi PINN GNN 110 207 0 26 Feb 2019
SGD Converges to Global Minimum in Deep Learning via Star-convex Path Yi Zhou Junjie Yang Huishuai Zhang Yingbin Liang Vahid Tarokh 63 74 0 02 Jan 2019
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 429 5,157 0 19 Jun 2018
Stabilizing Gradients for Deep Neural Networks via Efficient SVD Parameterization Jiong Zhang Qi Lei Inderjit S. Dhillon 55 112 0 25 Mar 2018
Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks Victor Campos Brendan Jou Xavier Giró-i-Nieto Jordi Torres Shih-Fu Chang 63 219 0 22 Aug 2017
Kronecker Recurrent Units C. Jose Moustapha Cissé François Fleuret ODL 89 46 0 29 May 2017
On orthogonality and learning recurrent networks with long term dependencies Eugene Vorontsov C. Trabelsi Samuel Kadoury C. Pal ODL 89 242 0 31 Jan 2017
Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflections Zakaria Mhammedi Andrew D. Hellicar Ashfaqur Rahman James Bailey 93 129 0 01 Dec 2016
Stochastic Frank-Wolfe Methods for Nonconvex Optimization Sashank J. Reddi S. Sra Barnabás Póczós Alex Smola 64 140 0 27 Jul 2016
Unitary Evolution Recurrent Neural Networks Martín Arjovsky Amar Shah Yoshua Bengio ODL 75 771 0 20 Nov 2015
Improving performance of recurrent neural network with relu nonlinearity S. Talathi Aniket A. Vartak ODL 60 88 0 12 Nov 2015
On the Properties of Neural Machine Translation: Encoder-Decoder Approaches Kyunghyun Cho B. V. Merrienboer Dzmitry Bahdanau Yoshua Bengio AI4CE AIMat 257 6,784 0 03 Sep 2014
How to Construct Deep Recurrent Neural Networks Razvan Pascanu Çağlar Gülçehre Kyunghyun Cho Yoshua Bengio 119 1,009 0 20 Dec 2013
Advances in Optimizing Recurrent Networks Yoshua Bengio Nicolas Boulanger-Lewandowski Razvan Pascanu ODL 106 523 0 04 Dec 2012