Gating creates slow modes and controls phase-space complexity in GRUs and LSTMs

31 January 2020

Papers citing "Gating creates slow modes and controls phase-space complexity in GRUs and LSTMs"

2 / 2 papers shown

Title
Non-normal Recurrent Neural Network (nnRNN): learning long time dependencies while improving expressivity with transient dynamics Giancarlo Kerg Kyle Goyette M. P. Touzel Gauthier Gidel Eugene Vorontsov Yoshua Bengio Guillaume Lajoie 38 58 0 28 May 2019
Dynamical Isometry and a Mean Field Theory of LSTMs and GRUs D. Gilboa B. Chang Minmin Chen Greg Yang S. Schoenholz Ed H. Chi Jeffrey Pennington 61 41 0 25 Jan 2019