Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,149 papers shown

Title
SpeakerBeam-SS: Real-time Target Speaker Extraction with Lightweight Conv-TasNet and State Space Modeling Hiroshi Sato Takafumi Moriya Masato Mimura Shota Horiguchi Tsubasa Ochiai Takanori Ashihara Atsushi Ando Kentaro Shinayama Marc Delcroix 48 1 0 01 Jul 2024
SE(3)-Hyena Operator for Scalable Equivariant Learning Artem Moskalev Mangal Prakash Rui Liao Tommaso Mansi 63 2 0 01 Jul 2024
Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model Haobo Yuan Xiangtai Li Lu Qi Tao Zhang Ming-Hsuan Yang Shuicheng Yan Chen Change Loy VLM 45 10 0 27 Jun 2024
Latent Diffusion for Neural Spiking Data J. Kapoor Auguste Schulz Julius Vetter Felix Pei Richard Gao Jakob H. Macke DiffM 45 2 0 27 Jun 2024
MMR-Mamba: Multi-Modal MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion Jing Zou Lanqing Liu Qi Chen Shujun Wang Zhanli Hu Xiaohan Xing Jing Qin Mamba 58 2 0 27 Jun 2024
Building Understandable Messaging for Policy and Evidence Review (BUMPER) with AI Katherine A. Rosenfeld Maike Sonnewald Sonia J. Jindal Kevin A. McCarthy Joshua L. Proctor 37 0 0 27 Jun 2024
From Pixels to Torques with Linear Feedback Jeong Hun Lee Sam Schoedel Aditya Bhardwaj Zachary Manchester 44 0 0 26 Jun 2024
SUM: Saliency Unification through Mamba for Visual Attention Modeling Alireza Hosseini A. Kazerouni Saeed Akhavan Michael Brudno Babak Taati Mamba 36 6 0 25 Jun 2024
The Overcooked Generalisation Challenge Constantin Ruhdorfer Matteo Bortoletto Anna Penzkofer Andreas Bulling 51 4 0 25 Jun 2024
Exploring the Capability of Mamba in Speech Applications Koichi Miyazaki Yoshiki Masuyama Masato Murata Mamba 45 12 0 24 Jun 2024
Sparser is Faster and Less is More: Efficient Sparse Attention for Long-Range Transformers Chao Lou Zixia Jia Zilong Zheng Kewei Tu ODL 35 19 0 24 Jun 2024
Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba Yuchen Zou Yineng Chen Zuchao Li Lefei Zhang Hai Zhao 68 1 0 24 Jun 2024
Scaling Laws for Linear Complexity Language Models Xuyang Shen Dong Li Ruitao Leng Zhen Qin Weigao Sun Yiran Zhong LRM 33 6 0 24 Jun 2024
Vision Mamba-based autonomous crack segmentation on concrete, asphalt, and masonry surfaces Zhaohui Chen Elyas Asadi Shamsabadi Sheng Jiang Luming Shen Daniel Dias-da-Costa Mamba 44 3 0 24 Jun 2024
An All-MLP Sequence Modeling Architecture That Excels at Copying Chenwei Cui Zehao Yan Gedeon Muhawenayo Hannah Kerner 28 0 0 23 Jun 2024
SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery Jialang Xu Nazir Sirajudeen M. Boal Nader K Francis Danail Stoyanov E. Mazomenos Mamba 43 2 0 22 Jun 2024
Soft Masked Mamba Diffusion Model for CT to MRI Conversion Zhenbin Wang Lei Zhang Lituan Wang Zhenwei Zhang Mamba MedIm 53 6 0 22 Jun 2024
KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty P. Becker Niklas Freymuth Gerhard Neumann Mamba 31 2 0 21 Jun 2024
DeciMamba: Exploring the Length Extrapolation Potential of Mamba Assaf Ben-Kish Itamar Zimerman Shady Abu Hussein Nadav Cohen Amir Globerson Lior Wolf Raja Giryes Mamba 85 13 0 20 Jun 2024
DrVideo: Document Retrieval Based Long Video Understanding Ziyu Ma Chenhui Gou Hengcan Shi Bin Sun Shutao Li Hamid Rezatofighi Jianfei Cai VLM 41 13 0 18 Jun 2024
LFMamba: Light Field Image Super-Resolution with State Space Model Wang xia Yao Lu Shunzhou Wang Ziqi Wang Peiqi Xia Tianfei Zhou Mamba 61 4 0 18 Jun 2024
Slot State Space Models Jindong Jiang Fei Deng Gautam Singh Minseung Lee Sungjin Ahn 58 4 0 18 Jun 2024
A Scalable and Effective Alternative to Graph Transformers Kaan Sancak Zhigang Hua Jin Fang Yan Xie Andrey Malevich Bo Long M. F. Balin Ümit V. Çatalyürek 55 1 0 17 Jun 2024
Delay Embedding Theory of Neural Sequence Models Mitchell Ostrow Adam J. Eisen Ila Fiete AI4TS 37 2 0 17 Jun 2024
Promises, Outlooks and Challenges of Diffusion Language Modeling Justin Deschenaux Çağlar Gülçehre DiffM 62 3 0 17 Jun 2024
SpoT-Mamba: Learning Long-Range Dependency on Spatio-Temporal Graphs with Selective State Spaces Jinhyeok Choi Heehyeon Kim Minhyeong An Joyce Jiyoung Whang Mamba 32 1 0 17 Jun 2024
Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detection Guowen Zhang Lue Fan Chenhang He Zhen Lei Zhaoxiang Zhang Lei Zhang Mamba 65 21 0 15 Jun 2024
BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack Yuri Kuratov Aydar Bulatov Petr Anokhin Ivan Rodkin Dmitry Sorokin Artyom Sorokin Andrey Kravchenko RALM ALM LRM ReLM ELM 56 64 0 14 Jun 2024
ECGMamba: Towards Efficient ECG Classification with BiSSM Yupeng Qiang Xunde Dong Xiuling Liu Yang Yang Yihai Fang Jianhong Dou Mamba 29 2 0 14 Jun 2024
Q-S5: Towards Quantized State Space Models Steven Abreu Jens Egholm Pedersen Kade Heckel Alessandro Pierro MQ 42 7 0 13 Jun 2024
Toward Fully-End-to-End Listened Speech Decoding from EEG Signals Jihwan Lee Aditya Kommineni Tiantian Feng Kleanthis Avramidis Xuan Shi Sudarsana Reddy Kadiri Shrikanth Narayanan 41 1 0 12 Jun 2024
On Evaluating Adversarial Robustness of Volumetric Medical Segmentation Models H. Malik Numan Saeed Asif Hanif Muzammal Naseer Mohammad Yaqub Salman Khan Fahad Shahbaz Khan 63 0 0 12 Jun 2024
State Soup: In-Context Skill Learning, Retrieval and Mixing Maciej Pióro Maciej Wołczyk Razvan Pascanu J. Oswald João Sacramento 38 1 0 12 Jun 2024
MaIL: Improving Imitation Learning with Mamba Xiaogang Jia Qian Wang Atalay Donat Bowen Xing Ge Li Hongyi Zhou Onur Celik Denis Blessing Rudolf Lioutikov Gerhard Neumann Mamba 48 10 0 12 Jun 2024
Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences Zicheng Liu Siyuan Li Li Wang Zedong Wang Yunfan Liu Stan Z. Li 43 8 0 12 Jun 2024
An Empirical Study of Mamba-based Language Models R. Waleffe Wonmin Byeon Duncan Riach Brandon Norick V. Korthikanti ... Vartika Singh Jared Casper Jan Kautz Mohammad Shoeybi Bryan Catanzaro 68 66 0 12 Jun 2024
Autoregressive Pretraining with Mamba in Vision Sucheng Ren Xianhang Li Haoqin Tu Feng Wang Fangxun Shu ... L. Yang Peng Wang Heng Wang Alan Yuille Cihang Xie Mamba 75 9 0 11 Jun 2024
Simple and Effective Masked Diffusion Language Models Subham Sekhar Sahoo Marianne Arriola Yair Schiff Aaron Gokaslan Edgar Marroquin Justin T Chiu Alexander M. Rush Volodymyr Kuleshov DiffM 58 77 0 11 Jun 2024
MambaLRP: Explaining Selective State Space Sequence Models F. Jafari G. Montavon Klaus-Robert Müller Oliver Eberle Mamba 76 9 0 11 Jun 2024
DualMamba: A Lightweight Spectral-Spatial Mamba-Convolution Network for Hyperspectral Image Classification Jiamu Sheng Jingyi Zhou Jiong Wang Peng Ye Jiayuan Fan 47 13 0 11 Jun 2024
Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling Liliang Ren Yang Liu Yadong Lu Yelong Shen Chen Liang Weizhu Chen Mamba 77 57 0 11 Jun 2024
RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection Yujie Chen Jiangyan Yi Jun Xue Chenglong Wang Xiaohui Zhang Shunbo Dong Siding Zeng Jianhua Tao Lv Zhao Cunhang Fan Mamba 61 17 0 10 Jun 2024
PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis Jia-wei Chen Yu-jie Xiong Yong-Bin Gao Mamba 42 1 0 10 Jun 2024
Mamba YOLO: SSMs-Based YOLO For Object Detection Zeyu Wang Chen Li Huiying Xu Xinzhong Zhu Mamba 66 3 0 09 Jun 2024
What Can We Learn from State Space Models for Machine Learning on Graphs? Yinan Huang Siqi Miao Pan Li 52 7 0 09 Jun 2024
Convolution and Attention-Free Mamba-based Cardiac Image Segmentation Abbas Khan Muhammad Asad Martin Benning C. Roney Gregory Slabaugh Mamba 40 2 0 09 Jun 2024
Vision Mamba: Cutting-Edge Classification of Alzheimer's Disease with 3D MRI Scans Muthukumar K A Amit Gurung Priya Ranjan 52 1 0 09 Jun 2024
Automata Extraction from Transformers Yihao Zhang Zeming Wei Meng Sun AI4CE 50 1 0 08 Jun 2024
Exploring Adversarial Robustness of Deep State Space Models Biqing Qi Yang Luo Junqi Gao Pengfei Li Kai Tian Zhiyuan Ma Bowen Zhou AAML 55 1 0 08 Jun 2024
Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RL Qi Lv Xiang Deng Gongwei Chen Michael Yu Wang Liqiang Nie 78 7 0 08 Jun 2024