Orthogonal Recurrent Neural Networks with Scaled Cayley Transform

29 July 2017

Papers citing "Orthogonal Recurrent Neural Networks with Scaled Cayley Transform"

14 / 14 papers shown

Title
Quantum-PEFT: Ultra parameter-efficient fine-tuning Toshiaki Koike-Akino F. Tonin Yongtao Wu Frank Zhengqing Wu Leyla Naz Candogan Volkan Cevher MQ 136 5 0 07 Mar 2025
HadamRNN: Binary and Sparse Ternary Orthogonal RNNs Armand Foucault Franck Mamalet François Malgouyres MQ 154 0 0 28 Jan 2025
Gated Orthogonal Recurrent Units: On Learning to Forget Li Jing Çağlar Gülçehre J. Peurifoy Yichen Shen Max Tegmark Marin Soljacic Yoshua Bengio 59 126 0 08 Jun 2017
On orthogonality and learning recurrent networks with long term dependencies Eugene Vorontsov C. Trabelsi Samuel Kadoury C. Pal ODL 70 239 0 31 Jan 2017
Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNNs Li Jing Yichen Shen T. Dubček J. Peurifoy S. Skirlo Yann LeCun Max Tegmark Marin Soljacic 62 177 0 15 Dec 2016
Efficient Orthogonal Parametrisation of Recurrent Neural Networks Using Householder Reflections Zakaria Mhammedi Andrew D. Hellicar Ashfaqur Rahman James Bailey 77 129 0 01 Dec 2016
Full-Capacity Unitary Recurrent Neural Networks Scott Wisdom Thomas Powers J. Hershey Jonathan Le Roux L. Atlas 38 292 0 31 Oct 2016
Learning Unitary Operators with Help From u(n) Stephanie L. Hyland Gunnar Rätsch 113 42 0 17 Jul 2016
Recurrent Orthogonal Networks and Long-Memory Tasks Mikael Henaff Arthur Szlam Yann LeCun 52 131 0 22 Feb 2016
Unitary Evolution Recurrent Neural Networks Martín Arjovsky Amar Shah Yoshua Bengio ODL 53 769 0 20 Nov 2015
A Simple Way to Initialize Recurrent Networks of Rectified Linear Units Quoc V. Le Navdeep Jaitly Geoffrey E. Hinton ODL 63 717 0 03 Apr 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.1K 149,474 0 22 Dec 2014
On the Properties of Neural Machine Translation: Encoder-Decoder Approaches Kyunghyun Cho B. V. Merrienboer Dzmitry Bahdanau Yoshua Bengio AI4CE AIMat 178 6,760 0 03 Sep 2014
On the difficulty of training Recurrent Neural Networks Razvan Pascanu Tomas Mikolov Yoshua Bengio ODL 148 5,318 0 21 Nov 2012