Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,149 papers shown

Title
Benchmarking Neural Decoding Backbones towards Enhanced On-edge iBCI Applications Zhou Zhou Guohang He Zheng Zhang Luziwei Leng Qinghai Guo Jianxing Liao Xuan Song Ran Cheng 62 2 0 08 Jun 2024
LoCoCo: Dropping In Convolutions for Long Context Compression Ruisi Cai Yuandong Tian Zhangyang Wang Beidi Chen 56 10 0 08 Jun 2024
C-Mamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting Chaolv Zeng Zhanyu Liu Guanjie Zheng Linghe Kong Mamba 58 5 0 08 Jun 2024
A Tensor Decomposition Perspective on Second-order RNNs M. Lizaire Michael Rizvi-Martel Marawan Gamal Abdel Hameed Guillaume Rabusseau 60 0 0 07 Jun 2024
Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs Shentong Mo Mamba 39 4 0 07 Jun 2024
MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation Ionuţ Grigore Călin-Adrian Popa Mamba MDE 72 1 0 06 Jun 2024
Small-E: Small Language Model with Linear Attention for Efficient Speech Synthesis Théodor Lemerle Nicolas Obin Axel Roebel 47 6 0 06 Jun 2024
Learning 1D Causal Visual Representation with De-focus Attention Networks Chenxin Tao Xizhou Zhu Shiqian Su Lewei Lu Changyao Tian ... Gao Huang Hongsheng Li Ping Luo Jie Zhou Jifeng Dai 70 1 0 06 Jun 2024
RoboMamba: Multimodal State Space Model for Efficient Robot Reasoning and Manipulation Jiaming Liu Mengzhen Liu Zhenyu Wang Lily Lee Kaichen Zhou Pengju An Senqiao Yang Renrui Zhang Yandong Guo Shanghang Zhang LM&Ro LRM Mamba 43 8 0 06 Jun 2024
Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Models Ali Behrouz Michele Santacatterina Ramin Zabih Mamba AI4TS 59 4 0 06 Jun 2024
TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification Md Atik Ahamed Qiang Cheng Mamba 70 2 0 06 Jun 2024
Combining Graph Neural Network and Mamba to Capture Local and Global Tissue Spatial Relationships in Whole Slide Images Ruiwen Ding Kha-Dinh Luong Erika Rodriguez Ana Cristina Araujo Lemos da Silva William Hsu Mamba 54 2 0 05 Jun 2024
Learning Long Range Dependencies on Graphs via Random Walks Dexiong Chen Till Hendrik Schulz Karsten Borgwardt 41 2 0 05 Jun 2024
Audio Mamba: Bidirectional State Space Model for Audio Representation Learning Mehmet Hamza Erol Arda Senocak Jiu Feng Joon Son Chung Mamba 104 20 0 05 Jun 2024
GrootVL: Tree Topology is All You Need in State Space Model Yicheng Xiao Lin Song Shaoli Huang Jiangshan Wang Siyu Song Yixiao Ge Xiu Li Ying Shan Mamba 52 11 0 04 Jun 2024
A Survey of Transformer Enabled Time Series Synthesis Alexander Sommers Logan Cummins Sudip Mittal Shahram Rahimi Maria Seale Joseph Jaboure Thomas Arnold AI4TS 57 2 0 04 Jun 2024
Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations Sarthak Yadav Zheng-Hua Tan Mamba 47 12 0 04 Jun 2024
EchoMamba4Rec: Harmonizing Bidirectional State Space Models with Spectral Filtering for Advanced Sequential Recommendation Yuda Wang Xuxin He Shengxin Zhu Mamba 57 8 0 04 Jun 2024
LongSSM: On the Length Extension of State-space Models in Language Modelling Shida Wang 65 0 0 04 Jun 2024
Mamba as Decision Maker: Exploring Multi-scale Sequence Modeling in Offline Reinforcement Learning Jiahang Cao Qiang Zhang Ziqing Wang Jiaxu Wang Hao Cheng Yecheng Shao Wen Zhao Gang Han Yijie Guo Renjing Xu Mamba 64 2 0 04 Jun 2024
Universal In-Context Approximation By Prompting Fully Recurrent Models Aleksandar Petrov Tom A. Lamb Alasdair Paren Philip Torr Adel Bibi LRM 40 0 0 03 Jun 2024
UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation Xiang Wang Shiwei Zhang Changxin Gao Jiayu Wang Xiaoqiang Zhou Yingya Zhang Luxin Yan Nong Sang VGen 69 31 0 03 Jun 2024
Dimba: Transformer-Mamba Diffusion Models Zhengcong Fei Mingyuan Fan Changqian Yu Debang Li Youqiang Zhang Junshi Huang Mamba 67 17 0 03 Jun 2024
State Space Models on Temporal Graphs: A First-Principles Study Jintang Li Ruofan Wu Xinzhou Jin Boqun Ma Liang Chen Zibin Zheng 71 4 0 03 Jun 2024
Pretrained Hybrids with MAD Skills Nicholas Roberts Samuel Guo Zhiqi Gao Satya Sai Srinath Namburi Sonia Cromp Chengjun Wu Chengyu Duan Frederic Sala Mamba 47 0 0 02 Jun 2024
Dual Hyperspectral Mamba for Efficient Spectral Compressive Imaging Jiahua Dong Hui Yin Hongliu Li Wenbo Li Yulun Zhang Salman Khan Fahad Shahbaz Khan Mamba 57 1 0 01 Jun 2024
Recurrent neural networks: vanishing and exploding gradients are not the end of the story Nicolas Zucchet Antonio Orvieto ODL AAML 50 11 0 31 May 2024
You Only Scan Once: Efficient Multi-dimension Sequential Modeling with LightNet Zhen Qin Yuxin Mao Xuyang Shen Dong Li Jing Zhang Yuchao Dai Yiran Zhong 58 1 0 31 May 2024
Learning to Estimate System Specifications in Linear Temporal Logic using Transformers and Mamba I. Isik Ebru Aydin Gol R. G. Cinbis AI4TS 42 0 0 31 May 2024
S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion Haolong Ma Hui Li Chunyang Cheng Gaoang Wang Xiaoning Song Xiao-Jun Wu 65 1 0 31 May 2024
Rough Transformers: Lightweight and Continuous Time Series Modelling through Signature Patching Fernando Moreno-Pino Alvaro Arroyo H. Waldon Xiaowen Dong Álvaro Cartea AI4TS 68 1 0 31 May 2024
Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling Sili Huang Jifeng Hu Zhe Yang Liwei Yang Yaoyu Zhang Hechang Chen Lichao Sun Bo Yang Mamba 41 3 0 31 May 2024
WaveCastNet: An AI-enabled Wavefield Forecasting Framework for Earthquake Early Warning Dongwei Lyu R. Nakata Pu Ren Michael W. Mahoney A. Pitarka Nori Nakata N. Benjamin Erichson 46 2 0 30 May 2024
MSSC-BiMamba: Multimodal Sleep Stage Classification and Early Diagnosis of Sleep Disorders with Bidirectional Mamba Chao Zhang Weirong Cui Jingjing Guo Mamba 30 3 0 30 May 2024
Language Models Need Inductive Biases to Count Inductively Yingshan Chang Yonatan Bisk LRM 45 6 0 30 May 2024
Joint Selective State Space Model and Detrending for Robust Time Series Anomaly Detection Junqi Chen Xu Tan S. Rahardja Jiawei Yang S. Rahardja Mamba 61 2 0 30 May 2024
Encoding and Controlling Global Semantics for Long-form Video Question Answering Thong Nguyen Zhiyuan Hu Xiaobao Wu Cong-Duy Nguyen See-Kiong Ng Anh Tuan Luu 66 3 0 30 May 2024
DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark Haoxing Chen Yan Hong Zizheng Huang Zhuoer Xu Zhangxuan Gu ... Jun Lan Huijia Zhu Jianfu Zhang Weiqiang Wang Huaxiong Li Mamba 86 16 0 30 May 2024
SysCaps: Language Interfaces for Simulation Surrogates of Complex Systems Patrick Emami Zhaonan Li Saumya Sinha Truc Nguyen 66 1 0 30 May 2024
Length independent generalization bounds for deep SSM architectures via Rademacher contraction and stability constraints Dániel Rácz Mihaly Petreczky Bálint Daróczy 49 1 0 30 May 2024
FourierMamba: Fourier Learning Integration with State Space Models for Image Deraining Dong Li Yidi Liu Xueyang Fu Senyan Xu Zheng-Jun Zha Mamba 67 11 0 29 May 2024
Deep Bayesian Filter for Bayes-faithful Data Assimilation Yuta Tarumi Keisuke Fukuda Shin-ichi Maeda 26 2 0 29 May 2024
Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mamba Zefan Yang Jiajin Zhang Ge Wang Mannudeep K. Kalra Pingkun Yan Mamba 38 7 0 28 May 2024
ViG: Linear-complexity Visual Sequence Learning with Gated Linear Attention Bencheng Liao Xinggang Wang Lianghui Zhu Qian Zhang Chang Huang 62 4 0 28 May 2024
Time Series Representation Models Robert Leppich Vanessa Borst Veronika Lesch Samuel Kounev AI4TS 27 0 0 28 May 2024
Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Model Wenbing Li Hang Zhou Junqing Yu Zikai Song Wei Yang Mamba 64 3 0 28 May 2024
Efficient Time Series Processing for Transformers and State-Space Models through Token Merging Leon Götz Marcel Kollovieh Stephan Günnemann Leo Schwinn 37 2 0 28 May 2024
Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba Jiahao Huang Liutao Yang Fanwen Wang Yang Nan Weiwen Wu ... Kuangyu Shi Angelica I. Aviles-Rivero Carola-Bibiane Schönlieb Daoqiang Zhang Guang Yang Mamba 51 0 0 27 May 2024
SMR: State Memory Replay for Long Sequence Modeling Biqing Qi Junqi Gao Kaiyan Zhang Dong Li Jianxing Liu Ligang Wu Bowen Zhou 59 5 0 27 May 2024
The Expressive Capacity of State Space Models: A Formal Language Perspective Yash Sarrof Yana Veitsman Michael Hahn Mamba 43 8 0 27 May 2024