Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,165 papers shown

Title
LeaPformer: Enabling Linear Transformers for Autoregressive and Simultaneous Tasks via Learned Proportions Victor Agostinelli Sanghyun Hong Lizhong Chen KELM 51 1 0 18 May 2024
Efficient Multimodal Large Language Models: A Survey Yizhang Jin Jian Li Yexin Liu Tianjun Gu Kai Wu ... Xin Tan Zhenye Gan Yabiao Wang Chengjie Wang Lizhuang Ma LRM 75 50 0 17 May 2024
CM-UNet: Hybrid CNN-Mamba UNet for Remote Sensing Image Semantic Segmentation Mushui Liu Jun Dan Ziqian Lu Yunlong Yu Yingming Li Xi Li Mamba 47 20 0 17 May 2024
Improving Transformers with Dynamically Composable Multi-Head Attention Da Xiao Qingye Meng Shengping Li Xingyuan Yuan 40 3 0 14 May 2024
Rethinking Scanning Strategies with Vision Mamba in Semantic Segmentation of Remote Sensing Imagery: An Experimental Study Qinfeng Zhu Yuan-Sheng Fang Yuanzhi Cai Cheng Chen Lei Fan Mamba 50 16 0 14 May 2024
WaterMamba: Visual State Space Model for Underwater Image Enhancement Meisheng Guan Haiyong Xu G. Jiang Mei Yu Yeyao Chen Ting Luo Yang Song Mamba 70 3 0 14 May 2024
MambaOut: Do We Really Need Mamba for Vision? Weihao Yu Xinchao Wang Mamba 55 54 0 13 May 2024
GMSR:Gradient-Guided Mamba for Spectral Reconstruction from RGB Images Xinying Wang Zhixiong Huang Sifan Zhang Jiawen Zhu Lin Feng Mamba 37 5 0 13 May 2024
Predictive Modeling in the Reservoir Kernel Motif Space Peter Tino Robert Simon Fong R. Leonarduzzi AI4TS 32 2 0 11 May 2024
DTMamba : Dual Twin Mamba for Time Series Forecasting Zexue Wu Yifeng Gong Aoqian Zhang 26 1 0 11 May 2024
Linearizing Large Language Models Jean Mercat Igor Vasiljevic Sedrick Scott Keh Kushal Arora Achal Dave Adrien Gaidon Thomas Kollar 51 20 0 10 May 2024
An Investigation of Incorporating Mamba for Speech Enhancement Rong-Yu Chao Wen-Huang Cheng Moreno La Quatra Sabato Marco Siniscalchi Chao-Han Huck Yang Szu-Wei Fu Yu Tsao Mamba 69 28 0 10 May 2024
State-Free Inference of State-Space Models: The Transfer Function Approach Rom N. Parnichkun Stefano Massaroli Alessandro Moro Jimmy T.H. Smith Ramin Hasani ... Hajime Asama Stefano Ermon Taiji Suzuki Atsushi Yamashita Michael Poli 56 7 0 10 May 2024
Self-Supervised Learning of Time Series Representation via Diffusion Process and Imputation-Interpolation-Forecasting Mask Zineb Senane Lele Cao V. Buchner Yusuke Tashiro Lei You P. Herman Mats Nordahl Ruibo Tu Vilhelm von Ehrenheim DiffM AI4TS 56 11 0 09 May 2024
Rethinking Efficient and Effective Point-based Networks for Event Camera Classification and Regression: EventMamba Hongwei Ren Yue Zhou Jiadong Zhu Haotian Fu Yulong Huang Xiaopeng Lin Yuetong Fang Fei Ma Hao Yu Bo-Xun Cheng Mamba 50 9 0 09 May 2024
Frequency-Assisted Mamba for Remote Sensing Image Super-Resolution Yi Xiao Qiangqiang Yuan Kui Jiang Yuzeng Chen Qiang Zhang Chia-Wen Lin Mamba 62 37 0 08 May 2024
Vision Mamba: A Comprehensive Survey and Taxonomy Xiao Liu Chenxu Zhang Lei Zhang Mamba 46 28 0 07 May 2024
Deep Event-based Object Detection in Autonomous Driving: A Survey Bin Zhou Jie Jiang 65 0 0 07 May 2024
Simple Drop-in LoRA Conditioning on Attention Layers Will Improve Your Diffusion Model Joo Young Choi Jaesung R. Park Inkyu Park Jaewoong Cho Albert No Ernest K. Ryu AI4CE 55 4 0 07 May 2024
MemoryMamba: Memory-Augmented State Space Model for Defect Recognition Qianning Wang He Hu Yucheng Zhou Mamba 52 14 0 06 May 2024
Retinexmamba: Retinex-based Mamba for Low-light Image Enhancement Jiesong Bai Yuhao Yin Qiyuan He Yuanxian Li Xiaofeng Zhang Mamba 45 29 0 06 May 2024
TimeMIL: Advancing Multivariate Time Series Classification via a Time-aware Multiple Instance Learning Xiwen Chen Peijie Qiu Wenhui Zhu Huayu Li Hao Wang Aristeidis Sotiras Yalin Wang Abolfazl Razi AI4TS 42 7 0 06 May 2024
Matten: Video Generation with Mamba-Attention Yu Gao Jiancheng Huang Xiaopeng Sun Zequn Jie Yujie Zhong Lin Ma 98 13 0 05 May 2024
AC-MAMBASEG: An adaptive convolution and Mamba-based architecture for enhanced skin lesion segmentation Viet-Thanh Nguyen Van-Truong Pham Thi-Thao Tran Mamba 55 5 0 05 May 2024
DVMSR: Distillated Vision Mamba for Efficient Super-Resolution Xiaoyan Lei Wenlong Zhang Weifeng Cao 42 12 0 05 May 2024
From Generalization Analysis to Optimization Designs for State Space Models Fusheng Liu Qianxiao Li 38 8 0 04 May 2024
FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space Hui Ma Sen Lei Turgay Celik Heng-Chao Li Mamba 52 13 0 03 May 2024
SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising Guanyiman Fu Fengchao Xiong Jianfeng Lu Jun Zhou Mamba 44 19 0 02 May 2024
Lipschitz constant estimation for general neural network architectures using control tools Patricia Pauli Dennis Gramlich Frank Allgöwer 58 4 0 02 May 2024
HandS3C: 3D Hand Mesh Reconstruction with State Space Spatial Channel Attention from RGB images Zixun Jiao Xihan Wang Zhaoqiang Xia Lianhe Shao Quanli Gao 3DH 52 0 0 02 May 2024
Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models Rishav Mukherji Mark Schöne Khaleelulla Khan Nazeer Christian Mayr David Kappel Anand Subramoney 44 2 0 01 May 2024
Neural Controlled Differential Equations with Quantum Hidden Evolutions Lingyi Yang Zhen Shao 34 0 0 30 Apr 2024
RSCaMa: Remote Sensing Image Change Captioning with State Space Model Chenyang Liu Keyan Chen Bo-Ying Chen Haotian Zhang Zhengxia Zou Z. Shi Mamba 38 28 0 29 Apr 2024
Visual Mamba: A Survey and New Outlooks Rui Xu Shu Yang Yihui Wang Yu Cai Bo Du Hao Chen Mamba 60 26 0 29 Apr 2024
Scalable Event-by-event Processing of Neuromorphic Sensory Signals With Deep State-Space Models Mark Schöne Neeraj Mohan Sushma Jingyue Zhuge Christian Mayr Anand Subramoney David Kappel AI4TS BDL 58 9 0 29 Apr 2024
Spectral-Spatial Mamba for Hyperspectral Image Classification Lin Huang Yushi Chen Xin He Mamba 48 29 0 29 Apr 2024
Mamba-FETrack: Frame-Event Tracking via State Space Model Ju Huang Shiao Wang Shuai Wang Zhe Wu Tianlin Li Bowei Jiang Mamba 54 14 0 28 Apr 2024
Revisiting Multi-modal Emotion Learning with Broad State Space Models and Probability-guidance Fusion Yuntao Shou Tao Meng Fuchen Zhang Nan Yin Keqin Li Mamba 48 22 0 27 Apr 2024
Sparse Reconstruction of Optical Doppler Tomography with Alternative State Space Model and Attention Zhenghong Li Jiaxiang Ren Wensheng Cheng C. Du Yingtian Pan Haibin Ling 50 0 0 26 Apr 2024
CFMW: Cross-modality Fusion Mamba for Multispectral Object Detection under Adverse Weather Conditions Haoyuan Li Qi Hu You Yao Kailun Yang Peng Chen 56 5 0 25 Apr 2024
Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges Badri N. Patro Vijay Srinivas Agneeswaran Mamba 59 38 0 24 Apr 2024
Bi-Mamba+: Bidirectional Mamba for Time Series Forecasting Aobo Liang Xingguo Jiang Yan Sun Xiaohou Shi Ke Li AI4TS Mamba 33 6 0 24 Apr 2024
Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model Xu Han Yuan Tang Zhaoxuan Wang Xianzhi Li 47 24 0 23 Apr 2024
A Survey on Efficient Inference for Large Language Models Zixuan Zhou Xuefei Ning Ke Hong Tianyu Fu Jiaming Xu ... Shengen Yan Guohao Dai Xiao-Ping Zhang Yuhan Dong Yu Wang 75 91 0 22 Apr 2024
MambaUIE&SR: Unraveling the Ocean's Secrets with Only 2.8 GFLOPs Zhihao Chen Yiyuan Ge Mamba 48 5 0 22 Apr 2024
ST-Mamba: Spatial-Temporal Selective State Space Model for Traffic Flow Prediction Zhiqi Shao Michael G. H. Bell Ze Wang D. Geers Haoning Xi Junbin Gao Mamba 42 2 0 20 Apr 2024
Vim4Path: Self-Supervised Vision Mamba for Histopathology Images Ali Nasiri-Sarvi Vincent Quoc-Huy Trinh Hassan Rivaz Mahdi S. Hosseini 46 8 0 20 Apr 2024
MambaPupil: Bidirectional Selective Recurrent model for Event-based Eye tracking Zhong Wang Zengyu Wan Han Han Bohao Liao Yuliang Wu Wei Zhai Yang Cao Zheng-jun Zha Mamba 49 5 0 18 Apr 2024
CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration Rui Deng Tianpei Gu Mamba 62 17 0 17 Apr 2024
Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion Xinghan Wang Zixi Kang Yadong Mu Mamba 41 8 0 17 Apr 2024