Learning fixed points of recurrent neural networks by reparameterizing
the network model

v1v2 (latest)

Learning fixed points of recurrent neural networks by reparameterizing the network model

13 July 2023

Robert Rosenbaum

ArXiv (abs)PDF HTML

Papers citing "Learning fixed points of recurrent neural networks by reparameterizing the network model"

19 / 19 papers shown

Title
Synaptic Weight Distributions Depend on the Geometry of Plasticity Roman Pogodin Jonathan H. Cornford Arna Ghosh Gauthier Gidel Guillaume Lajoie Blake A. Richards 50 4 0 30 May 2023
Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systems Manuela Brenner Florian Hess Jonas M. Mikhaeil Leonard Bereska Zahra Monfared Po-Chen Kuo Daniel Durstewitz AI4CE 264 32 0 06 Jul 2022
A random energy approach to deep learning Rongrong Xie M. Marsili FedML 29 6 0 17 Dec 2021
Optimal input representation in neural systems at the edge of chaos Guillermo B. Morales M. A. Muñoz AAML 79 18 0 12 Jul 2021
Universal scaling laws in the gradient descent training of neural networks Maksim Velikanov Dmitry Yarotsky 74 9 0 02 May 2021
Explaining Neural Scaling Laws Yasaman Bahri Ethan Dyer Jared Kaplan Jaehoon Lee Utkarsh Sharma 68 263 0 12 Feb 2021
Natural-gradient learning for spiking neurons Elena Kreutzer Walter Senn Mihai A. Petrovici 38 13 0 23 Nov 2020
Multiscale Deep Equilibrium Models Shaojie Bai V. Koltun J. Zico Kolter BDL 85 211 0 15 Jun 2020
Monotone operator equilibrium networks Ezra Winston J. Zico Kolter 62 130 0 15 Jun 2020
Artificial neural networks for neuroscientists: A primer G. R. Yang Xiao-Jing Wang 93 251 0 01 Jun 2020
Control of criticality and computation in spiking neuromorphic networks with plasticity Benjamin Cramer David Stöckel Markus Kreft Michael Wibral Johannes Schemmel K. Meier V. Priesemann 41 103 0 17 Sep 2019
Deep Equilibrium Models Shaojie Bai J. Zico Kolter V. Koltun 92 667 0 03 Sep 2019
Reviving and Improving Recurrent Back-Propagation Renjie Liao Yuwen Xiong Ethan Fetaya Lisa Zhang Kijung Yoon Xaq Pitkow R. Urtasun R. Zemel BDL 75 120 0 16 Mar 2018
Characterizing Implicit Bias in Terms of Optimization Geometry Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro AI4CE 73 410 0 22 Feb 2018
The Implicit Bias of Gradient Descent on Separable Data Daniel Soudry Elad Hoffer Mor Shpigel Nacson Suriya Gunasekar Nathan Srebro 158 921 0 27 Oct 2017
full-FORCE: A Target-Based Method for Training Recurrent Networks Brian DePasquale Christopher J. Cueva Kanaka Rajan G. S. Escola L. F. Abbott 44 122 0 09 Oct 2017
Implicit Regularization in Matrix Factorization Suriya Gunasekar Blake E. Woodworth Srinadh Bhojanapalli Behnam Neyshabur Nathan Srebro 79 493 0 25 May 2017
Training recurrent networks online without backtracking Yann Ollivier Corentin Tallec Guillaume Charpiat 53 39 0 28 Jul 2015
New insights and perspectives on the natural gradient method James Martens ODL 73 624 0 03 Dec 2014

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.