Approximating Real-Time Recurrent Learning with Random Kronecker Factors

28 May 2018

Papers citing "Approximating Real-Time Recurrent Learning with Random Kronecker Factors"

13 / 13 papers shown

Title
Convergence Analysis of Real-time Recurrent Learning (RTRL) for a class of Recurrent Neural Networks Samuel Chun-Hei Lam Justin A. Sirignano K. Spiliopoulos 58 0 0 14 Jan 2025
Mind the truncation gap: challenges of learning on dynamic graphs with recurrent architectures Joao Bravo Jacopo Bono Pedro Saleiro Hugo Ferreira P. Bizarro 42 0 0 31 Dec 2024
Real-Time Recurrent Reinforcement Learning Julian Lemmel Radu Grosu 34 2 0 08 Nov 2023
Variance-Reduced Gradient Estimation via Noise-Reuse in Online Evolution Strategies Oscar Li James Harrison Jascha Narain Sohl-Dickstein Virginia Smith Luke Metz 54 5 0 21 Apr 2023
Online Training Through Time for Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 45 60 0 09 Oct 2022
Amortized Proximal Optimization Juhan Bae Paul Vicol Jeff Z. HaoChen Roger C. Grosse ODL 27 14 0 28 Feb 2022
Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization Frederik Benzing ODL 43 23 0 28 Jan 2022
Unbiased Gradient Estimation in Unrolled Computation Graphs with Persistent Evolution Strategies Paul Vicol Luke Metz Jascha Narain Sohl-Dickstein 27 67 0 27 Dec 2021
Brain-Inspired Learning on Neuromorphic Substrates Friedemann Zenke Emre Neftci 38 87 0 22 Oct 2020
A Unified Framework of Online Learning Algorithms for Training Recurrent Neural Networks O. Marschall Kyunghyun Cho Cristina Savin FedML 33 72 0 05 Jul 2019
Adaptively Truncating Backpropagation Through Time to Control Gradient Bias Christopher Aicher N. Foti E. Fox MQ 24 32 0 17 May 2019
Optimal Kronecker-Sum Approximation of Real Time Recurrent Learning Frederik Benzing M. Gauy Asier Mujika A. Martinsson Angelika Steger 23 22 0 11 Feb 2019
Continual Learning of Recurrent Neural Networks by Locally Aligning Distributed Representations Alexander Ororbia A. Mali C. Lee Giles Daniel Kifer 19 63 0 17 Oct 2018