Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,145 papers shown

Title
A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models Cong Guo Feng Cheng Zhixu Du James Kiessling Jonathan Ku ... Qilin Zheng Guanglei Zhou Hai Li-Wei Li Yiran Chen 33 7 0 08 Oct 2024
Monocular Visual Place Recognition in LiDAR Maps via Cross-Modal State Space Model and Multi-View Matching Gongxin Yao Xinyang Li Luowei Fu Yu Pan 35 1 0 08 Oct 2024
EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment Yifei Xing Xiangyuan Lan Ruiping Wang D. Jiang Wenjun Huang Qingfang Zheng Yaowei Wang Mamba 43 0 0 08 Oct 2024
TIMBA: Time series Imputation with Bi-directional Mamba Blocks and Diffusion models Javier Solís-García Belén Vega-Márquez Juan A. Nepomuceno Isabel A. Nepomuceno-Chamorro Mamba AI4TS AI4CE 25 0 0 08 Oct 2024
Remote Sensing Image Segmentation Using Vision Mamba and Multi-Scale Multi-Frequency Feature Fusion Yice Cao Chenchen Liu Zhenhua Wu Wenxin Yao Liu Xiong Jie Chen Zhixiang Huang Mamba 39 2 0 08 Oct 2024
Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series Byoungwoo Park Hyungi Lee Juho Lee AI4TS 51 0 0 08 Oct 2024
IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classification Yan He Bing Tu Puzhao Jiang Bo Liu Jun Li Antonio J. Plaza 50 10 0 07 Oct 2024
SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning Yan Zhong Ruoyu Zhao Chao Wang Qinghai Guo Jianguo Zhang Zhichao Lu Luziwei Leng 57 2 0 07 Oct 2024
On Efficient Variants of Segment Anything Model: A Survey Xiaorui Sun Jing Liu H. Shen Xiaofeng Zhu Ping Hu VLM 59 4 0 07 Oct 2024
Neural Fourier Modelling: A Highly Compact Approach to Time-Series Analysis Minjung Kim Yusuke Hioka Michael Witbrock AI4TS 42 0 0 07 Oct 2024
Large Language Model Inference Acceleration: A Comprehensive Hardware Perspective Jinhao Li Jiaming Xu Shan Huang Yonghua Chen Wen Li ... Jiayi Pan Li Ding Hao Zhou Yu Wang Guohao Dai 62 17 0 06 Oct 2024
Accelerating Inference of Networks in the Frequency Domain Chenqiu Zhao Guanfang Dong Anup Basu 48 0 0 06 Oct 2024
LongGenBench: Long-context Generation Benchmark Xiang Liu Peijie Dong Xuming Hu Xiaowen Chu RALM 55 8 0 05 Oct 2024
Efficient and Robust Long-Form Speech Recognition with Hybrid H3-Conformer Tomoki Honda S. Sakai Tatsuya Kawahara 28 0 0 05 Oct 2024
Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detection Dingwen Zhang Liangbo Cheng Yi Liu Xinggang Wang Jiawei Han Mamba 33 3 0 05 Oct 2024
System 2 Reasoning Capabilities Are Nigh Scott C. Lowe VLM LRM 57 0 0 04 Oct 2024
PRF: Parallel Resonate and Fire Neuron for Long Sequence Learning in Spiking Neural Networks Yulong Huang Zunchang Liu Changchun Feng Xiaopeng Lin Hongwei Ren Haotian Fu Yue Zhou Hong Xing Bojun Cheng 49 1 0 04 Oct 2024
S7: Selective and Simplified State Space Layers for Sequence Modeling Taylan Soydan Nikola Zubić Nico Messikommer Siddhartha Mishra Davide Scaramuzza 54 4 0 04 Oct 2024
Can Mamba Always Enjoy the "Free Lunch"? Ruifeng Ren Zhicong Li Yong Liu 49 1 0 04 Oct 2024
HRVMamba: High-Resolution Visual State Space Model for Dense Prediction Hao Zhang Yongqiang Ma Wenqi Shao Ping Luo Nanning Zheng Kaipeng Zhang Mamba 37 1 0 04 Oct 2024
Mathematical Formalism for Memory Compression in Selective State Space Models Siddhanth Bhat 36 1 0 04 Oct 2024
Oscillatory State-Space Models T. Konstantin Rusch Daniela Rus AI4TS 192 6 0 04 Oct 2024
Demystifying the Token Dynamics of Deep Selective State Space Models Thieu N. Vo Tung D. Pham Xin T. Tong Tan Minh Nguyen Mamba 54 0 0 04 Oct 2024
TrajGPT: Irregular Time-Series Representation Learning for Health Trajectory Analysis Ziyang Song Qingcheng Lu He Zhu David L. Buckeridge Yue Li AI4TS 30 0 0 03 Oct 2024
Flow Matching with Gaussian Process Priors for Probabilistic Time Series Forecasting Marcel Kollovieh Marten Lienen David Lüdke Leo Schwinn Stephan Günnemann AI4TS BDL DiffM 50 6 0 03 Oct 2024
Selective Attention Improves Transformer Yaniv Leviathan Matan Kalman Yossi Matias 51 9 0 03 Oct 2024
Tuning Frequency Bias of State Space Models Annan Yu Dongwei Lyu Soon Hoe Lim Michael W. Mahoney N. Benjamin Erichson 52 3 0 02 Oct 2024
Samba: Synchronized Set-of-Sequences Modeling for Multiple Object Tracking Mattia Segu Luigi Piccinelli Siyuan Li Yung-Hsu Yang Bernt Schiele Luc Van Gool Mamba 55 2 0 02 Oct 2024
FutureFill: Fast Generation from Convolutional Sequence Models Naman Agarwal Xinyi Chen Evan Dogariu Vlad Feinberg Daniel Suo Peter L. Bartlett Elad Hazan AI4TS MQ 48 2 0 02 Oct 2024
Were RNNs All We Needed? Leo Feng Frederick Tung Mohamed Osama Ahmed Yoshua Bengio Hossein Hajimirsadegh AI4TS 34 14 1 02 Oct 2024
Tracking objects that change in appearance with phase synchrony Sabine Muzellec Drew Linsley A. Ashok E. Mingolla Girik Malik Rufin VanRullen Thomas Serre 33 1 0 02 Oct 2024
Recovering Time-Varying Networks From Single-Cell Data Euxhen Hasanaj Barnabás Póczos Ziv Bar-Joseph AI4CE 26 0 0 01 Oct 2024
Zero-Shot Text-to-Speech from Continuous Text Streams Trung D. Q. Dang David Aponte Dung Tran Tianyi Chen K. Koishida AuLLM VLM 42 3 0 01 Oct 2024
A SSM is Polymerized from Multivariate Time Series Haixiang Wu AI4TS 25 0 0 30 Sep 2024
MaskMamba: A Hybrid Mamba-Transformer Model for Masked Image Generation Wenchao Chen Liqiang Niu Ziyao Lu Fandong Meng Jie Zhou Mamba 40 4 0 30 Sep 2024
SWIM: Short-Window CNN Integrated with Mamba for EEG-Based Auditory Spatial Attention Decoding Ziyang Zhang Andrew Thwaites Alexandra Woolgar Brian Moore Chao Zhang Mamba 62 1 0 30 Sep 2024
Hybrid Mamba for Few-Shot Segmentation Qianxiong Xu Xuanyi Liu Lanyun Zhu Guosheng Lin Cheng Long Ziyue Li Rui Zhao Mamba 40 4 0 29 Sep 2024
MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentation Xiaoxiang Han Xinyu Li Jiang Shang Yiman Liu Keyan Chen Qiaohong Liu Qi Zhang Qi Zhang Mamba 37 0 0 28 Sep 2024
TTT4Rec: A Test-Time Training Approach for Rapid Adaption in Sequential Recommendation Zhaoqi Yang Yanan Wang Yong Ge VLM TTA 27 1 0 27 Sep 2024
Exploring Token Pruning in Vision State Space Models Zheng Zhan Zhenglun Kong Yifan Gong Yushu Wu Zichong Meng ... Xuan Shen Stratis Ioannidis Wei Niu Pu Zhao Yanzhi Wang 40 9 0 27 Sep 2024
MECG-E: Mamba-based ECG Enhancer for Baseline Wander Removal Kuo-Hsuan Hung Kuan-Chen Wang Kai-Chun Liu Wei-Lun Chen Xugang Lu Yu Tsao Chii-Wann Lin Mamba 34 0 0 27 Sep 2024
Cottention: Linear Transformers With Cosine Attention Gabriel Mongaras Trevor Dohm Eric C. Larson 26 0 0 27 Sep 2024
Speech Boosting: Low-Latency Live Speech Enhancement for TWS Earbuds Hanbin Bae Pavel Andreev Azat Saginbaev Nicholas Babaev Won-Jun Lee Hosang Sung Hoon-Young Cho 29 0 0 27 Sep 2024
Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models Xiaoxue Gao Nancy F. Chen Mamba 43 1 0 27 Sep 2024
A Fly on the Wall -- Exploiting Acoustic Side-Channels in Differential Pressure Sensors Yonatan Gizachew Achamyeleh Mohamad Fakih Gabriel Garcia Anomadarshi Barua Mohammad Abdullah Al Faruque AAML 32 0 0 26 Sep 2024
EM-Net: Efficient Channel and Frequency Learning with Mamba for 3D Medical Image Segmentation Ao Chang Jiajun Zeng Ruobing Huang Dong Ni Mamba 43 2 0 26 Sep 2024
Semi-LLIE: Semi-supervised Contrastive Learning with Mamba-based Low-light Image Enhancement Guanlin Li Ke Zhang Ting Wang Ming Li Bin Zhao Xuelong Li 19 0 0 25 Sep 2024
Medha: Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations A. Agrawal Haoran Qiu Junda Chen Íñigo Goiri Chaojie Zhang Rayyan Shahid Ramachandran Ramjee Alexey Tumanov Esha Choukse RALM LRM 34 1 0 25 Sep 2024
DepMamba: Progressive Fusion Mamba for Multimodal Depression Detection Jiaxin Ye Junping Zhang Hongming Shan Mamba 31 2 0 24 Sep 2024
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing Svea Marie Meyer Philipp Weidel Philipp Plank L. Campos-Macias Sumit Bam Shrestha Philipp Stratmann M. R 43 4 0 23 Sep 2024