Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,165 papers shown

Title
LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory Zicheng Liu Li Wang Siyuan Li Zedong Wang Haitao Lin Stan Z. Li VLM 37 4 0 17 Apr 2024
HumMUSS: Human Motion Understanding using State Space Models Arnab Kumar Mondal Stefano Alletto Denis Tome 44 4 0 16 Apr 2024
HSIDMamba: Exploring Bidirectional State-Space Models for Hyperspectral Denoising Yang Liu Jiahua Xiao Yu-Xiao Guo Peilin Jiang Haiwei Yang Fei Wang Mamba 40 6 0 15 Apr 2024
State Space Model for New-Generation Network Alternative to Transformers: A Survey Tianlin Li Shiao Wang Yuhe Ding Yuehang Li Wentao Wu ... Bowei Jiang Chenglong Li Yaowei Wang Yonghong Tian Jin Tang Mamba 52 50 0 15 Apr 2024
FreqMamba: Viewing Mamba from a Frequency Perspective for Image Deraining Zou Zhen Yu Hu Zhao Feng Mamba 55 38 0 15 Apr 2024
A Novel State Space Model with Local Enhancement and State Sharing for Image Fusion Zihan Cao Xiao Wu Liang-Jian Deng Yu Zhong Mamba 47 9 0 14 Apr 2024
TransformerFAM: Feedback attention is working memory Dongseong Hwang Weiran Wang Zhuoyuan Huo K. Sim P. M. Mengibar 40 12 0 14 Apr 2024
Navigating the Landscape of Large Language Models: A Comprehensive Review and Analysis of Paradigms and Fine-Tuning Strategies Benjue Weng LM&MA 59 8 0 13 Apr 2024
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length Xuezhe Ma Xiaomeng Yang Wenhan Xiong Beidi Chen Lili Yu Hao Zhang Jonathan May Luke Zettlemoyer Omer Levy Chunting Zhou 53 27 0 12 Apr 2024
SpectralMamba: Efficient Mamba for Hyperspectral Image Classification Jing Yao Danfeng Hong Chenyu Li J. Chanussot Mamba 70 43 0 12 Apr 2024
MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion Zhe Li Haiwei Pan Kejia Zhang Yuhua Wang Feng Yu Mamba 41 20 0 12 Apr 2024
The Illusion of State in State-Space Models William Merrill Jackson Petty Ashish Sabharwal 54 46 0 12 Apr 2024
FusionMamba: Efficient Image Fusion with State Space Model Siran Peng Xiangyu Zhu Haoyu Deng Zhen Lei Liang-Jian Deng Mamba 43 7 0 11 Apr 2024
HGRN2: Gated Linear RNNs with State Expansion Zhen Qin Aaron Courville Weixuan Sun Xuyang Shen Dong Li Weigao Sun Yiran Zhong LRM 49 48 0 11 Apr 2024
SurvMamba: State Space Model with Multi-grained Multi-modal Interaction for Survival Prediction Ying Chen Jiajing Xie Yuxiang Lin Yuhang Song Wenxian Yang Rongshan Yu Mamba 59 6 0 11 Apr 2024
RecurrentGemma: Moving Past Transformers for Efficient Open Language Models Aleksandar Botev Soham De Samuel L. Smith Anushan Fernando George-Christian Muraru ... Koray Kavukcuoglu Demis Hassabis R. Hadsell Yee Whye Teh Nando de Frietas VLM RALM 53 28 0 11 Apr 2024
ViM-UNet: Vision Mamba for Biomedical Segmentation Anwai Archit Constantin Pape Mamba 44 9 0 11 Apr 2024
Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in Videos S. Chaudhuri Saumik Bhattacharya Mamba 42 9 0 11 Apr 2024
3DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion Yixuan Li Weidong Yang Ben Fei 54 9 0 10 Apr 2024
RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurement Bochao Zou Zizheng Guo Xiaocheng Hu Huimin Ma Mamba 43 1 0 09 Apr 2024
MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection Haoyang He Yuhu Bai Jiangning Zhang Qingdong He Hongxu Chen Zhenye Gan Chengjie Wang Xiangtai Li Guanzhong Tian Lei Xie Mamba 76 39 0 09 Apr 2024
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence Bo Peng Daniel Goldstein Quentin G. Anthony Alon Albalak Eric Alcaide ... Bingchen Zhao Qihang Zhao Peng Zhou Jian Zhu Ruijie Zhu 56 75 0 08 Apr 2024
Softmax Attention with Constant Cost per Token Franz A. Heinsen 29 1 0 08 Apr 2024
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding Bo He Hengduo Li Young Kyun Jang Menglin Jia Xuefei Cao Ashish Shah Abhinav Shrivastava Ser-Nam Lim MLLM 88 89 0 08 Apr 2024
VMambaMorph: a Multi-Modality Deformable Image Registration Framework based on Visual State Space Model with Cross-Scan Module Ziyang Wang Jian-Qing Zheng Chao Ma Tao Guo Mamba 53 3 0 07 Apr 2024
Diffusion-RWKV: Scaling RWKV-Like Architectures for Diffusion Models Zhengcong Fei Mingyuan Fan Changqian Yu Debang Li Junshi Huang 59 24 0 06 Apr 2024
Locating and Editing Factual Associations in Mamba Arnab Sen Sharma David Atkinson David Bau KELM 82 29 0 04 Apr 2024
AdaGlimpse: Active Visual Exploration with Arbitrary Glimpse Position and Scale Adam Pardyl Michal Wronka Maciej Wolczyk Kamil Adamczewski Tomasz Trzciñski Bartosz Zieliñski 53 2 0 04 Apr 2024
ChangeMamba: Remote Sensing Change Detection with Spatio-Temporal State Space Model Hongruixuan Chen Jian Song Chengxi Han Junshi Xia Naoto Yokoya Mamba 39 78 0 04 Apr 2024
RS-Mamba for Large Remote Sensing Image Dense Prediction Sijie Zhao Hao Chen Xue-liang Zhang Pengfeng Xiao Lei Bai Wanli Ouyang Mamba 45 85 0 03 Apr 2024
RS3Mamba: Visual State Space Model for Remote Sensing Images Semantic Segmentation Xianping Ma Xiaokang Zhang Man-On Pun Mamba 52 54 0 03 Apr 2024
Linear Attention Sequence Parallelism Weigao Sun Zhen Qin Dong Li Xuyang Shen Yu Qiao Yiran Zhong 86 2 0 03 Apr 2024
SPMamba: State-space model is all you need in speech separation Kai Li Guo Chen Mamba 60 26 0 02 Apr 2024
Rethinking the Relationship between Recurrent and Non-Recurrent Neural Networks: A Study in Sparsity Quincy Hershey Randy Paffenroth Harsh Nilesh Pathak Simon Tavener 97 1 0 01 Apr 2024
HSIMamba: Hyperpsectral Imaging Efficient Feature Learning with Bidirectional State Space for Classification Judy X Yang Jun Zhou Jing Wang Hui Tian Alan Wee-Chung Liew Mamba 54 15 0 30 Mar 2024
FISBe: A real-world benchmark dataset for instance segmentation of long-range thin filamentous structures Lisa Mais Peter Hirsch Claire Managan Ramya Kandarpa J. L. Rumberger Annika Reinke Lena Maier-Hein Gudrun Ihrke Dagmar Kainmueller 43 0 0 29 Mar 2024
Decision Mamba: Reinforcement Learning via Sequence Modeling with Selective State Spaces Toshihiro Ota Mamba 51 16 0 29 Mar 2024
MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection Ali Behrouz Michele Santacatterina Ramin Zabih 57 31 0 29 Mar 2024
Jamba: A Hybrid Transformer-Mamba Language Model Opher Lieber Barak Lenz Hofit Bata Gal Cohen Jhonathan Osin ... Nir Ratner N. Rozen Erez Shwartz Mor Zusman Y. Shoham 51 214 0 28 Mar 2024
LLMSense: Harnessing LLMs for High-level Reasoning Over Spatiotemporal Sensor Traces Xiaomin Ouyang Mani B. Srivastava LRM 45 19 0 28 Mar 2024
RSMamba: Remote Sensing Image Classification with State Space Model Keyan Chen Bo-Ying Chen Chenyang Liu Wenyuan Li Zhengxia Zou Z. Shi Mamba 45 117 0 28 Mar 2024
Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction Qiuhong Shen Zike Wu Xuanyu Yi Pan Zhou Hanwang Zhang Shuicheng Yan Xinchao Wang 3DGS 66 40 0 27 Mar 2024
RankMamba: Benchmarking Mamba's Document Ranking Performance in the Era of Transformers Zhichao Xu 45 12 0 27 Mar 2024
Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation Xilin Jiang Cong Han N. Mesgarani Mamba 61 45 0 27 Mar 2024
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis Badri N. Patro Suhas Ranganath Vinay P. Namboodiri Vijay Srinivas Agneeswaran 51 2 0 26 Mar 2024
Serpent: Scalable and Efficient Image Restoration via Multi-scale Structured State Space Models Mohammad Shahab Sepehri Zalan Fabian Mahdi Soltanolkotabi 58 5 0 26 Mar 2024
Mechanistic Design and Scaling of Hybrid Architectures Michael Poli Armin W. Thomas Eric N. D. Nguyen Pragaash Ponnusamy Bjorn Deiseroth ... Brian Hie Stefano Ermon Christopher Ré Ce Zhang Stefano Massaroli MoE 69 23 0 26 Mar 2024
ReMamber: Referring Image Segmentation with Mamba Twister Yu-Hao Yang Chaofan Ma Jiangchao Yao Zhun Zhong Ya Zhang Yanfeng Wang Mamba 75 20 0 26 Mar 2024
Rotate to Scan: UNet-like Mamba with Triplet SSM Module for Medical Image Segmentation Hao Tang Lianglun Cheng Guoheng Huang Zhengguang Tan Junhao Lu Kaihong Wu Mamba 62 11 0 26 Mar 2024
PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition Chenhongyi Yang Zehui Chen Miguel Espinosa Linus Ericsson Zhenyu Wang Jiaming Liu Elliot J. Crowley Mamba 62 90 0 26 Mar 2024