Diagonal State Spaces are as Effective as Structured State Spaces

27 March 2022

Papers citing "Diagonal State Spaces are as Effective as Structured State Spaces"

50 / 228 papers shown

Title
V2M: Visual 2-Dimensional Mamba for Image Representation Learning Chengkun Wang Wenzhao Zheng Yuanhui Huang Jie Zhou Jiwen Lu Mamba 33 0 0 14 Oct 2024
GlobalMamba: Global Image Serialization for Vision Mamba Chengkun Wang Wenzhao Zheng Jie Zhou Jiwen Lu Mamba 40 0 0 14 Oct 2024
Drama: Mamba-Enabled Model-Based Reinforcement Learning Is Sample and Parameter Efficient Wenlong Wang Ivana Dusparic Yucheng Shi Ke Zhang Vinny Cahill Mamba 146 0 0 11 Oct 2024
Parameter-Efficient Fine-Tuning of State Space Models Kevin Galim Wonjun Kang Yuchen Zeng H. Koo Kangwook Lee 31 4 0 11 Oct 2024
QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model Fei Xie Weijia Zhang Zhongdao Wang Chao Ma Mamba 29 3 0 09 Oct 2024
EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment Yifei Xing Xiangyuan Lan Ruiping Wang D. Jiang Wenjun Huang Qingfang Zheng Yaowei Wang Mamba 38 0 0 08 Oct 2024
SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning Yan Zhong Ruoyu Zhao Chao Wang Qinghai Guo Jianguo Zhang Zhichao Lu Luziwei Leng 46 2 0 07 Oct 2024
On Efficient Variants of Segment Anything Model: A Survey Xiaorui Sun Xiaozhong Liu H. Shen Xiaofeng Zhu Ping Hu VLM 48 4 0 07 Oct 2024
Efficient and Robust Long-Form Speech Recognition with Hybrid H3-Conformer Tomoki Honda S. Sakai Tatsuya Kawahara 23 0 0 05 Oct 2024
Can Mamba Always Enjoy the "Free Lunch"? Ruifeng Ren Zhicong Li Yong Liu 44 1 0 04 Oct 2024
Demystifying the Token Dynamics of Deep Selective State Space Models Thieu N. Vo Tung D. Pham Xin T. Tong Tan Minh Nguyen Mamba 49 0 0 04 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu S. H. Lim Michael W. Mahoney N. Benjamin Erichson 44 3 0 02 Oct 2024
FutureFill: Fast Generation from Convolutional Sequence Models Naman Agarwal Xinyi Chen Evan Dogariu Vlad Feinberg Daniel Suo Peter L. Bartlett Elad Hazan AI4TS MQ 38 2 0 02 Oct 2024
Were RNNs All We Needed? Leo Feng Frederick Tung Mohamed Osama Ahmed Yoshua Bengio Hossein Hajimirsadegh AI4TS 29 14 1 02 Oct 2024
Cottention: Linear Transformers With Cosine Attention Gabriel Mongaras Trevor Dohm Eric C. Larson 26 0 0 27 Sep 2024
Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models Xiaoxue Gao Nancy F. Chen Mamba 35 1 0 27 Sep 2024
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing Svea Marie Meyer Philipp Weidel Philipp Plank L. Campos-Macias Sumit Bam Shrestha Philipp Stratmann M. R 36 4 0 23 Sep 2024
DocMamba: Efficient Document Pre-training with State Space Model Pengfei Hu Zhenrong Zhang Jiefeng Ma Shuhang Liu Jun Du Jianshu Zhang Mamba 42 1 0 18 Sep 2024
SkinMamba: A Precision Skin Lesion Segmentation Architecture with Cross-Scale Global State Modeling and Frequency Boundary Guidance Shun Zou Mingya Zhang Bingjian Fan Zhengyi Zhou Xiuguo Zou Mamba 29 3 0 17 Sep 2024
Famba-V: Fast Vision Mamba with Cross-Layer Token Fusion Hui Shen Zhongwei Wan Xin Wang Mi Zhang Mamba 32 6 0 15 Sep 2024
Self-supervised Learning for Acoustic Few-Shot Classification Jingyong Liang Bernd Meyer Isaac Ning Lee Thanh-Toan Do SSL 52 0 0 15 Sep 2024
Learning Brain Tumor Representation in 3D High-Resolution MR Images via Interpretable State Space Models Qingqiao Hu Daoan Zhang Jiebo Luo Zhenyu Gong Benedikt Wiestler Jianguo Zhang Hongwei Bran Li 34 0 0 12 Sep 2024
Towards Efficient Modelling of String Dynamics: A Comparison of State Space and Koopman based Deep Learning Methods Rodrigo Diaz Carlos De La Vega Martin Mark Sandler 33 2 0 29 Aug 2024
SpikingSSMs: Learning Long Sequences with Sparse and Parallel Spiking State Space Models Shuaijie Shen Chao Wang Renzhuo Huang Yan Zhong Qinghai Guo Zhichao Lu Jianguo Zhang Luziwei Leng 42 8 0 27 Aug 2024
MambaOcc: Visual State Space Model for BEV-based Occupancy Prediction with Local Adaptive Reordering Yonglin Tian Songlin Bai Zhiyao Luo Yutong Wang Yisheng Lv Fei-Yue Wang Mamba 39 2 0 21 Aug 2024
Advancing Spatio-Temporal Processing in Spiking Neural Networks through Adaptation Maximilian Baronig Romain Ferrand Silvester Sabathiel Robert Legenstein 45 3 0 14 Aug 2024
DyG-Mamba: Continuous State Space Modeling on Dynamic Graphs Dongyuan Li Shiyin Tan Ying Zhang Ming Jin Shirui Pan Manabu Okumura Renhe Jiang Mamba 34 3 0 13 Aug 2024
Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network Xinyi Zhang Qiqi Bao Qinpeng Cui Wenming Yang Qingmin Liao 3DH Mamba 28 1 0 06 Aug 2024
LaMamba-Diff: Linear-Time High-Fidelity Diffusion Models Based on Local Attention and Mamba Yunxiang Fu Chaoqi Chen Yizhou Yu Mamba 70 3 0 05 Aug 2024
Long Range Switching Time Series Prediction via State Space Model Jiaming Zhang Yang Ding Yunfeng Gao 31 0 0 27 Jul 2024
Longhorn: State Space Models are Amortized Online Learners Bo Liu Rui Wang Lemeng Wu Yihao Feng Peter Stone Qian Liu 51 10 0 19 Jul 2024
VideoMamba: Spatio-Temporal Selective State Space Model Jinyoung Park Hee-Seon Kim Kangwook Ko Minbeom Kim Changick Kim Mamba 39 7 0 11 Jul 2024
Parallelizing Autoregressive Generation with Variational State Space Models Gaspard Lambrechts Yann Claes Pierre Geurts Damien Ernst 18 0 0 11 Jul 2024
Towards a theory of learning dynamics in deep state space models Jakub Smékal Jimmy T.H. Smith Michael Kleinman D. Biderman Scott W. Linderman 31 3 0 10 Jul 2024
RotRNN: Modelling Long Sequences with Rotations Rares Dolga Kai Biegun Jake Cunningham David Barber 42 2 0 09 Jul 2024
On the Power of Convolution Augmented Transformer Mingchen Li Xuechen Zhang Yixiao Huang Samet Oymak 37 0 0 08 Jul 2024
SpeakerBeam-SS: Real-time Target Speaker Extraction with Lightweight Conv-TasNet and State Space Modeling Hiroshi Sato Takafumi Moriya Masato Mimura Shota Horiguchi Tsubasa Ochiai Takanori Ashihara Atsushi Ando Kentaro Shinayama Marc Delcroix 35 1 0 01 Jul 2024
MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion Jing Zou Lanqing Liu Qi Chen Shujun Wang Zhanli Hu Xiaohan Xing Jing Qin Mamba 45 2 0 27 Jun 2024
Soft Masked Mamba Diffusion Model for CT to MRI Conversion Zhenbin Wang Lei Zhang Lituan Wang Zhenwei Zhang Mamba MedIm 46 6 0 22 Jun 2024
KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty P. Becker Niklas Freymuth Gerhard Neumann Mamba 26 2 0 21 Jun 2024
DeciMamba: Exploring the Length Extrapolation Potential of Mamba Assaf Ben-Kish Itamar Zimerman Shady Abu Hussein Nadav Cohen Amir Globerson Lior Wolf Raja Giryes Mamba 77 13 0 20 Jun 2024
Slot State Space Models Jindong Jiang Fei Deng Gautam Singh Minseung Lee Sungjin Ahn 44 4 0 18 Jun 2024
Separations in the Representational Capabilities of Transformers and Recurrent Architectures S. Bhattamishra Michael Hahn Phil Blunsom Varun Kanade GNN 44 9 0 13 Jun 2024
Q-S5: Towards Quantized State Space Models Steven Abreu Jens Egholm Pedersen Kade Heckel Alessandro Pierro MQ 40 7 0 13 Jun 2024
MaIL: Improving Imitation Learning with Mamba Xiaogang Jia Qian Wang Atalay Donat Bowen Xing Ge Li Hongyi Zhou Onur Celik Denis Blessing Rudolf Lioutikov Gerhard Neumann Mamba 35 10 0 12 Jun 2024
Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences Zicheng Liu Siyuan Li Li Wang Zedong Wang Yunfan Liu Stan Z. Li 35 7 0 12 Jun 2024
RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection Yujie Chen Jiangyan Yi Jun Xue Chenglong Wang Xiaohui Zhang Shunbo Dong Siding Zeng Jianhua Tao Lv Zhao Cunhang Fan Mamba 42 16 0 10 Jun 2024
PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis Jia-wei Chen Yu-jie Xiong Yong-Bin Gao Mamba 37 1 0 10 Jun 2024
What Can We Learn from State Space Models for Machine Learning on Graphs? Yinan Huang Siqi Miao Pan Li 44 7 0 09 Jun 2024
Exploring Adversarial Robustness of Deep State Space Models Biqing Qi Yang Luo Junqi Gao Pengfei Li Kai Tian Zhiyuan Ma Bowen Zhou AAML 50 1 0 08 Jun 2024