Parallelizing non-linear sequential models over the sequence length

Parallelizing non-linear sequential models over the sequence length

21 September 2023

Joshua Selfridge

Papers citing "Parallelizing non-linear sequential models over the sequence length"

14 / 14 papers shown

Title
It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimization Ali Behrouz Meisam Razaviyayn Peilin Zhong Vahab Mirrokni 41 0 0 17 Apr 2025
PCM : Picard Consistency Model for Fast Parallel Sampling of Diffusion Models Junhyuk So Jiwoong Shin Chaeyeon Jang Eunhyeok Park DiffM 53 0 0 25 Mar 2025
Fixed-Point RNNs: From Diagonal to Dense in a Few Iterations Sajad Movahedi Felix Sarnthein Nicola Muca Cirone Antonio Orvieto 48 2 0 13 Mar 2025
Towards Scalable and Stable Parallelization of Nonlinear RNNs Xavier Gonzalez Andrew Warrington Jimmy T.H. Smith Scott W. Linderman 93 8 0 17 Jan 2025
Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues Riccardo Grazzi Julien N. Siems Jörg Franke Arber Zela Frank Hutter Massimiliano Pontil 92 11 0 19 Nov 2024
Real-Time Recurrent Learning using Trace Units in Reinforcement Learning Esraa Elelimy Adam White Michael Bowling Martha White OffRL 38 2 0 02 Sep 2024
Rethinking Transformers in Solving POMDPs Chenhao Lu Ruizhe Shi Yuyao Liu Kaizhe Hu Simon S. Du Huazhe Xu AI4CE 35 3 0 27 May 2024
Accelerating Parallel Sampling of Diffusion Models Zhiwei Tang Jiasheng Tang Hao Luo Fan Wang Tsung-Hui Chang 32 12 0 15 Feb 2024
Sequence Modeling with Multiresolution Convolutional Memory Jiaxin Shi Ke Alexander Wang E. Fox 42 13 0 02 May 2023
Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto Samuel L. Smith Albert Gu Anushan Fernando Çağlar Gülçehre Razvan Pascanu Soham De 88 266 0 11 Mar 2023
Liquid Structural State-Space Models Ramin Hasani Mathias Lechner Tsun-Hsuan Wang Makram Chahine Alexander Amini Daniela Rus AI4TS 104 95 0 26 Sep 2022
Matching Normalizing Flows and Probability Paths on Manifolds Heli Ben-Hamu Samuel N. Cohen Joey Bose Brandon Amos Aditya Grover Maximilian Nickel Ricky T. Q. Chen Y. Lipman 58 39 0 11 Jul 2022
FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizes David W. Romero Robert-Jan Bruintjes Jakub M. Tomczak Erik J. Bekkers Mark Hoogendoorn J. C. V. Gemert 80 82 0 15 Oct 2021
Symplectic Recurrent Neural Networks Zhengdao Chen Jianyu Zhang Martín Arjovsky Léon Bottou 152 220 0 29 Sep 2019