HiPPO: Recurrent Memory with Optimal Polynomial Projections

17 August 2020

Papers citing "HiPPO: Recurrent Memory with Optimal Polynomial Projections"

26 / 326 papers shown

Title
How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections Albert Gu Isys Johnson Aman Timalsina Atri Rudra Christopher Ré Mamba 95 90 0 24 Jun 2022
On the Parameterization and Initialization of Diagonal State Space Models Albert Gu Ankit Gupta Karan Goel Christopher Ré 25 298 0 23 Jun 2022
Towards a General Purpose CNN for Long Range Dependencies in $N$ D David W. Romero David M. Knigge Albert Gu Erik J. Bekkers E. Gavves Jakub M. Tomczak Mark Hoogendoorn 24 19 0 07 Jun 2022
Improving the Diagnosis of Psychiatric Disorders with Self-Supervised Graph State Space Models A. E. Gazzar R. Thomas G. Wingen AI4MH 13 6 0 07 Jun 2022
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Tri Dao Daniel Y. Fu Stefano Ermon Atri Rudra Christopher Ré VLM 93 2,045 0 27 May 2022
FiLM: Frequency improved Legendre Memory Model for Long-term Time Series Forecasting Tian Zhou Ziqing Ma Xue Wang Qingsong Wen Liang Sun Tao Yao Wotao Yin Rong Jin AI4TS 121 170 0 18 May 2022
Long Movie Clip Classification with State-Space Video Models Md. Mohaiminul Islam Gedas Bertasius VLM 46 102 0 04 Apr 2022
Path Development Network with Finite-dimensional Lie Group Representation Han Lou Siran Li Hao Ni 18 7 0 02 Apr 2022
Monarch: Expressive Structured Matrices for Efficient and Accurate Training Tri Dao Beidi Chen N. Sohoni Arjun D Desai Michael Poli Jessica Grogan Alexander Liu Aniruddh Rao Atri Rudra Christopher Ré 26 87 0 01 Apr 2022
Diagonal State Spaces are as Effective as Structured State Spaces Ankit Gupta Albert Gu Jonathan Berant 59 292 0 27 Mar 2022
projUNN: efficient method for training deep networks with unitary matrices B. Kiani Randall Balestriero Yann LeCun S. Lloyd 43 32 0 10 Mar 2022
It's Raw! Audio Generation with State-Space Models Karan Goel Albert Gu Chris Donahue Christopher Ré 16 187 0 20 Feb 2022
Efficiently Modeling Long Sequences with Structured State Spaces Albert Gu Karan Goel Christopher Ré 52 1,673 0 31 Oct 2021
Scatterbrain: Unifying Sparse and Low-rank Attention Approximation Beidi Chen Tri Dao Eric Winsor Zhao Song Atri Rudra Christopher Ré 37 125 0 28 Oct 2021
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers Albert Gu Isys Johnson Karan Goel Khaled Kamal Saab Tri Dao Atri Rudra Christopher Ré 54 555 0 26 Oct 2021
FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizes David W. Romero Robert-Jan Bruintjes Jakub M. Tomczak Erik J. Bekkers Mark Hoogendoorn Jan van Gemert 80 82 0 15 Oct 2021
Multiwavelet-based Operator Learning for Differential Equations Gaurav Gupta Xiongye Xiao P. Bogdan 126 202 0 28 Sep 2021
Closed-form Continuous-time Neural Models Ramin Hasani Mathias Lechner Alexander Amini Lucas Liebenwein Aaron Ray Max Tschaikowski G. Teschl Daniela Rus PINN AI4TS 31 82 0 25 Jun 2021
Rethinking Neural Operations for Diverse Tasks Nicholas Roberts M. Khodak Tri Dao Liam Li Christopher Ré Ameet Talwalkar AI4CE 38 22 0 29 Mar 2021
Discrete Function Bases and Convolutional Neural Networks A. Stockel 13 2 0 09 Mar 2021
Constructing Dampened LTI Systems Generating Polynomial Bases Andreas Stöckel 11 1 0 26 Feb 2021
Parallelizing Legendre Memory Unit Training Narsimha Chilkuri C. Eliasmith 12 37 0 22 Feb 2021
CKConv: Continuous Kernel Convolution For Sequential Data David W. Romero Anna Kuzina Erik J. Bekkers Jakub M. Tomczak Mark Hoogendoorn 30 123 0 04 Feb 2021
Neural Rough Differential Equations for Long Time Series James Morrill C. Salvi Patrick Kidger James Foster Terry Lyons AI4TS 31 124 0 17 Sep 2020
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 252 580 0 12 Mar 2020
Recurrent Neural Networks for Multivariate Time Series with Missing Values Zhengping Che S. Purushotham Kyunghyun Cho David Sontag Yan Liu AI4TS 246 1,900 0 06 Jun 2016