How to Train Your HiPPO: State Space Models with Generalized Orthogonal
Basis Projections

How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections

24 June 2022

Christopher Ré

Papers citing "How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections"

13 / 63 papers shown

Title
State-space Models with Layer-wise Nonlinearity are Universal Approximators with Exponential Decaying Memory Shida Wang Beichen Xue 27 24 0 23 Sep 2023
Advancing Regular Language Reasoning in Linear Recurrent Neural Networks Ting-Han Fan Ta-Chung Chi Alexander I. Rudnicky LRM 30 5 0 14 Sep 2023
Facing Off World Model Backbones: RNNs, Transformers, and S4 Fei Deng Junyeong Park Sungjin Ahn 32 24 0 05 Jul 2023
Hyena Neural Operator for Partial Differential Equations Saurabh Patil Zijie Li Amir Barati Farimani AI4CE 32 4 0 28 Jun 2023
Neural Oscillators are Universal S. Lanthaler T. Konstantin Rusch Siddhartha Mishra 35 10 0 15 May 2023
Scallop: A Language for Neurosymbolic Programming Ziyang Li Jiani Huang Mayur Naik ReLM LRM NAI 24 30 0 10 Apr 2023
Resurrecting Recurrent Neural Networks for Long Sequences Antonio Orvieto Samuel L. Smith Albert Gu Anushan Fernando Çağlar Gülçehre Razvan Pascanu Soham De 88 271 0 11 Mar 2023
Simple Hardware-Efficient Long Convolutions for Sequence Modeling Daniel Y. Fu Elliot L. Epstein Eric N. D. Nguyen A. Thomas Michael Zhang Tri Dao Atri Rudra Christopher Ré 22 52 0 13 Feb 2023
Hungry Hungry Hippos: Towards Language Modeling with State Space Models Daniel Y. Fu Tri Dao Khaled Kamal Saab A. Thomas Atri Rudra Christopher Ré 75 372 0 28 Dec 2022
What Makes Convolutional Models Great on Long Sequence Modeling? Yuhong Li Tianle Cai Yi Zhang De-huai Chen Debadeepta Dey VLM 39 96 0 17 Oct 2022
S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spaces Eric N. D. Nguyen Karan Goel Albert Gu Gordon W. Downs Preey Shah Tri Dao S. Baccus Christopher Ré VLM 22 39 0 12 Oct 2022
Liquid Structural State-Space Models Ramin Hasani Mathias Lechner Tsun-Hsuan Wang Makram Chahine Alexander Amini Daniela Rus AI4TS 107 97 0 26 Sep 2022
Diffusion-based Time Series Imputation and Forecasting with Structured State Space Models Juan Miguel Lopez Alcaraz Nils Strodthoff DiffM 28 168 0 19 Aug 2022