Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,149 papers shown

Title
Semi-LLIE: Semi-supervised Contrastive Learning with Mamba-based Low-light Image Enhancement Guanlin Li Ke Zhang Ting Wang Ming Li Bin Zhao Xuelong Li 19 0 0 25 Sep 2024
Medha: Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations A. Agrawal Haoran Qiu Junda Chen Íñigo Goiri Chaojie Zhang Rayyan Shahid Ramachandran Ramjee Alexey Tumanov Esha Choukse RALM LRM 34 1 0 25 Sep 2024
DepMamba: Progressive Fusion Mamba for Multimodal Depression Detection Jiaxin Ye Junping Zhang Hongming Shan Mamba 31 2 0 24 Sep 2024
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing Svea Marie Meyer Philipp Weidel Philipp Plank L. Campos-Macias Sumit Bam Shrestha Philipp Stratmann M. R 43 4 0 23 Sep 2024
Inference-Friendly Models With MixAttention Shashank Rajput Ying Sheng Sean Owen Vitaliy Chiley 86 1 0 23 Sep 2024
Approximated Orthogonal Projection Unit: Stabilizing Regression Network Training Using Natural Gradient Shaoqi Wang Chunjie Yang Siwei Lou 38 1 0 23 Sep 2024
DiSPo: Diffusion-SSM based Policy Learning for Coarse-to-Fine Action Discretization Nayoung Oh Jaehyeong Jang Moonkyeong Jung Daehyung Park 253 0 0 23 Sep 2024
Test Time Learning for Time Series Forecasting Panayiotis Christou Shichu Chen Xupeng Chen Parijat Dube AI4TS 40 0 0 21 Sep 2024
OneBEV: Using One Panoramic Image for Bird's-Eye-View Semantic Mapping Jiale Wei Junwei Zheng Ruiping Liu Jie Hu Jiaming Zhang Rainer Stiefelhagen 42 2 0 20 Sep 2024
State space models, emergence, and ergodicity: How many parameters are needed for stable predictions? Ingvar M. Ziemann Nikolai Matni George J. Pappas 40 1 0 20 Sep 2024
Contextual Compression in Retrieval-Augmented Generation for Large Language Models: A Survey Sourav Verma RALM 3DV 37 2 0 20 Sep 2024
Towards LifeSpan Cognitive Systems Yu Wang Chi Han Tongtong Wu Xiaoxin He Wangchunshu Zhou ... Zexue He Wei Wang Gholamreza Haffari Heng Ji Julian McAuley KELM CLL 250 1 0 20 Sep 2024
MambaRecon: MRI Reconstruction with Structured State Space Models Yilmaz Korkmaz V. Patel Mamba 48 2 0 19 Sep 2024
PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba Chaoqi Luo Yiping Xie Zitong Yu Mamba 46 5 0 18 Sep 2024
DocMamba: Efficient Document Pre-training with State Space Model Pengfei Hu Zhenrong Zhang Jiefeng Ma Shuhang Liu Jun Du Jianshu Zhang Mamba 49 1 0 18 Sep 2024
SPRMamba: Surgical Phase Recognition for Endoscopic Submucosal Dissection with Mamba Xiangning Zhang Qingwei Zhang Jinnan Chen Chengfeng Zhou Yaqi Wang XiaoBo Li Xiaobo Li Dahong Qian Mamba 39 0 0 18 Sep 2024
Mamba Fusion: Learning Actions Through Questioning Zhikang Dong Apoorva Beedu Jason Sheinkopf Irfan Essa Mamba 70 2 0 17 Sep 2024
SkinMamba: A Precision Skin Lesion Segmentation Architecture with Cross-Scale Global State Modeling and Frequency Boundary Guidance Shun Zou Mingya Zhang Bingjian Fan Zhengyi Zhou Xiuguo Zou Mamba 42 3 0 17 Sep 2024
Mamba-ST: State Space Model for Efficient Style Transfer Filippo Botti Alex Ergasti Leonardo Rossi Tomaso Fontanini Claudio Ferrari Massimo Bertozzi Andrea Prati Mamba 61 2 0 16 Sep 2024
MARCA: Mamba Accelerator with ReConfigurable Architecture Jinhao Li Shan Huang Jiaming Xu Jun Liu Li Ding Ningyi Xu Guohao Dai 45 6 0 16 Sep 2024
Leveraging Joint Spectral and Spatial Learning with MAMBA for Multichannel Speech Enhancement Wenze Ren Haibin Wu Yi-Cheng Lin Xuanjun Chen Rong-Yu Chao Kuo-Hsuan Hung You-Jin Li Wen-Yuan Ting Hsin-Min Wang Yu Tsao Mamba 49 0 0 16 Sep 2024
Flash STU: Fast Spectral Transform Units Y. Isabel Liu Windsor Nguyen Yagiz Devre Evan Dogariu Anirudha Majumdar Elad Hazan AI4TS 74 1 0 16 Sep 2024
Famba-V: Fast Vision Mamba with Cross-Layer Token Fusion Hui Shen Zhongwei Wan Xin Wang Mi Zhang Mamba 32 6 0 15 Sep 2024
Spatial-Temporal Mamba Network for EEG-based Motor Imagery Classification Xiaoxiao Yang Ziyu Jia Mamba 35 2 0 15 Sep 2024
Self-supervised Learning for Acoustic Few-Shot Classification Jingyong Liang Bernd Meyer Isaac Ning Lee Thanh-Toan Do SSL 57 0 0 15 Sep 2024
Bridging Dynamic Factor Models and Neural Controlled Differential Equations for Nowcasting GDP S. Lim Jeongwhan Choi Noseong Park Sang-Ha Yoon ShinHyuck Kang Young-Min Kim Hyunjoong Kang AIFin AI4TS 41 0 0 13 Sep 2024
GenMapping: Unleashing the Potential of Inverse Perspective Mapping for Robust Online HD Map Construction Siyu Li Kailun Yang Hao Shi Song Wang You Yao Zhiyong Li 43 2 0 13 Sep 2024
Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics Wenqing Zhang Junming Huang Ruotong Wang Changsong Wei Wenqian Huang Yuxin Qiao Mamba 47 10 0 13 Sep 2024
Mamba-YOLO-World: Marrying YOLO-World with Mamba for Open-Vocabulary Detection Haoxuan Wang Qu He Jinlong Peng Hao Yang Mingmin Chi Yabiao Wang Mamba 44 1 0 13 Sep 2024
MambaFoley: Foley Sound Generation using Selective State-Space Models Marco Furio Colombo Francesca Ronchini Luca Comanducci Fabio Antonacci Mamba 27 1 0 13 Sep 2024
Learning Brain Tumor Representation in 3D High-Resolution MR Images via Interpretable State Space Models Qingqiao Hu Daoan Zhang Jiebo Luo Zhenyu Gong Benedikt Wiestler Jianguo Zhang Hongwei Bran Li 39 0 0 12 Sep 2024
Synthetic continued pretraining Zitong Yang Neil Band Shuangping Li Emmanuel Candès Tatsunori Hashimoto CLL SyDa 44 11 0 11 Sep 2024
Mamba for Scalable and Efficient Personalized Recommendations Andrew Starnes Clayton Webster Mamba 38 0 0 11 Sep 2024
Retrieval Or Holistic Understanding? Dolce: Differentiate Our Long Context Evaluation Tasks Zi Yang 33 0 0 10 Sep 2024
PPMamba: A Pyramid Pooling Local Auxiliary SSM-Based Model for Remote Sensing Image Semantic Segmentation Yin Hu Xianping Ma Jialu Sui Man-On Pun Mamba 42 3 0 10 Sep 2024
A Two-Stage Band-Split Mamba-2 Network For Music Separation Jinglin Bai Yuan Fang Jiajie Wang Xueliang Zhang Mamba 29 1 0 10 Sep 2024
Vector Quantized Diffusion Model Based Speech Bandwidth Extension Yuan Fang Jinglin Bai Jiajie Wang Xueliang Zhang 30 0 0 09 Sep 2024
DSDFormer: An Innovative Transformer-Mamba Framework for Robust High-Precision Driver Distraction Identification Junzhou Chen Zirui Zhang Jing Yu Heqiang Huang Ronghui Zhang Xuemiao Xu Bin Sheng Hong Yan Mamba 50 1 0 09 Sep 2024
Graffin: Stand for Tails in Imbalanced Node Classification Xiaorui Qi Yanlong Wen Xiaojie Yuan 33 0 0 09 Sep 2024
Cross-attention Inspired Selective State Space Models for Target Sound Extraction Donghang Wu Yiwen Wang Xihong Wu T. Qu Mamba 45 3 0 07 Sep 2024
Why mamba is effective? Exploit Linear Transformer-Mamba Network for Multi-Modality Image Fusion Chenguang Zhu Shan Gao Huafeng Chen Guangqian Guo Chaowei Wang Yaoxing Wang Chen Shu Lei Quanjiang Fan Mamba 32 0 0 05 Sep 2024
aTENNuate: Optimized Real-time Speech Enhancement with Deep SSMs on Raw Audio Yan Ru Pei Ritik Shrivastava FNU Sidharth 48 1 0 05 Sep 2024
LinFusion: 1 GPU, 1 Minute, 16K Image Songhua Liu Weihao Yu Zhenxiong Tan Xinchao Wang 48 13 0 03 Sep 2024
Shuffle Mamba: State Space Models with Random Shuffle for Multi-Modal Image Fusion Ke Cao Xuanhua He Tao Hu Chengjun Xie Jie Zhang Man Zhou Danfeng Hong Mamba 39 3 0 03 Sep 2024
EDCSSM: Edge Detection with Convolutional State Space Model Q. Hong Haoyou Jiang Pingdan Xiao Sichun Du Tao Li 37 0 0 03 Sep 2024
TrackSSM: A General Motion Predictor by State-Space Model Bin Hu Run Luo Zelin Liu Cheng Wang Wenyu Liu 48 2 0 31 Aug 2024
A Hybrid Transformer-Mamba Network for Single Image Deraining Shangquan Sun Wenqi Ren Juxiang Zhou Jianhou Gan Rui Wang Xiaochun Cao Mamba 64 6 0 31 Aug 2024
Towards Efficient Modelling of String Dynamics: A Comparison of State Space and Koopman based Deep Learning Methods Rodrigo Diaz Carlos De La Vega Martin Mark Sandler 48 2 0 29 Aug 2024
Evaluating Time-Series Training Dataset through Lens of Spectrum in Deep State Space Models Sekitoshi Kanai Yasutoshi Ida Kazuki Adachi Mihiro Uchida Tsukasa Yoshida Shin'ya Yamaguchi 20 1 0 29 Aug 2024
Audio xLSTMs: Learning Self-Supervised Audio Representations with xLSTMs Sarthak Yadav Sergios Theodoridis Zheng-Hua Tan 53 3 0 29 Aug 2024