Efficiently Modeling Long Sequences with Structured State Spaces

31 October 2021

Papers citing "Efficiently Modeling Long Sequences with Structured State Spaces"

50 / 1,149 papers shown

Title
What comes after transformers? -- A selective survey connecting ideas in deep learning Johannes Schneider AI4CE 61 2 0 01 Aug 2024
Enhanced Structured State Space Models via Grouped FIR Filtering and Attention Sink Mechanisms Yueran Zhang Yating Yu Lingtong Min Mamba 34 0 0 01 Aug 2024
RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining Hongtao Wu Yijun Yang Huihui Xu Weiming Wang Jinni Zhou Lei Zhu Mamba 44 17 0 31 Jul 2024
MambaCapsule: Towards Transparent Cardiac Disease Diagnosis with Electrocardiography Using Mamba Capsule Network Yinlong Xu Xiaoqiang Liu Zitai Kong YiXuan Wu Yue Wang Yingzhou Lu Hong-Yan Gao Jian Wu Hongxia Xu Mamba 40 7 0 30 Jul 2024
FlexAttention for Efficient High-Resolution Vision-Language Models Junyan Li Delin Chen Tianle Cai Peihao Chen Yining Hong Zhenfang Chen Yikang Shen Chuang Gan VLM 77 5 0 29 Jul 2024
ML-Mamba: Efficient Multi-Modal Large Language Model Utilizing Mamba-2 Wenjun Huang Jiakai Pan Jiahao Tang Yanyu Ding Yifei Xing Yuhe Wang Zhengzhuo Wang Jianguo Hu Mamba 58 5 0 29 Jul 2024
Long Range Switching Time Series Prediction via State Space Model Jiaming Zhang Yang Ding Yunfeng Gao 47 0 0 27 Jul 2024
Reinforcement Learning for Sustainable Energy: A Survey Koen Ponse Felix Kleuker Márton Fejér Álvaro Serra-Gómez Aske Plaat Thomas M. Moerland OffRL AI4CE 47 1 0 26 Jul 2024
VSSD: Vision Mamba with Non-Causal State Space Duality Yuheng Shi Minjing Dong Mingjia Li Chang Xu Mamba 38 5 0 26 Jul 2024
Harnessing Temporal Causality for Advanced Temporal Action Detection Shuming Liu Lin Sui Chen-Da Liu-Zhang Fangzhou Mu Chen Zhao Guohao Li CML 44 2 0 25 Jul 2024
MxT: Mamba x Transformer for Image Inpainting Shuang Chen Amir Atapour-Abarghouei Haozheng Zhang Hubert P. H. Shum Mamba 45 2 0 23 Jul 2024
Mamba meets crack segmentation Zhili He Yuhao Wang Mamba 47 3 0 22 Jul 2024
FMamba: Mamba based on Fast-attention for Multivariate Time-series Forecasting Shusen Ma Yu Kang Peng Bai Yunan Zhao Mamba AI4TS 30 3 0 20 Jul 2024
Longhorn: State Space Models are Amortized Online Learners Bo Liu Rui Wang Lemeng Wu Yihao Feng Peter Stone Qian Liu 60 11 0 19 Jul 2024
OE-BevSeg: An Object Informed and Environment Aware Multimodal Framework for Bird's-eye-view Vehicle Semantic Segmentation Jian Sun Yuqi Dai Chi-Man Vong Qing Xu Shengbo Eben Li Jianqiang Wang Lei He Keqiang Li 45 1 0 18 Jul 2024
Enhancing Temporal Action Localization: Advanced S6 Modeling with Recurrent Mechanism Sangyoun Lee Juho Jung Changdae Oh Sunghee Yun 57 0 0 18 Jul 2024
GroupMamba: Efficient Group-Based Visual State Space Model Abdelrahman M. Shaker Syed Talal Wasim Salman Khan Juergen Gall Fahad Shahbaz Khan Mamba 61 0 0 18 Jul 2024
Mamba-PTQ: Outlier Channels in Recurrent Large Language Models Alessandro Pierro Steven Abreu MQ Mamba 45 6 0 17 Jul 2024
Genomic Language Models: Opportunities and Challenges Gonzalo Benegas Chengzhong Ye C. Albors Jianan Canal Li Yun S. Song AI4CE LM&MA ELM 58 18 0 16 Jul 2024
OPa-Ma: Text Guided Mamba for 360-degree Image Out-painting Penglei Gao Kai Yao Tiandi Ye Steven Wang Yuan Yao Xiaofeng Wang Mamba 47 2 0 15 Jul 2024
SSSD-ECG-nle: New Label Embeddings with Structured State-Space Models for ECG generation Sergey Skorik A. Avetisyan DiffM MedIm 61 0 0 15 Jul 2024
Omni-Dimensional Frequency Learner for General Time Series Analysis Xianing Chen Hanting Chen Hailin Hu AI4TS 45 0 0 15 Jul 2024
An Empirical Study of Mamba-based Pedestrian Attribute Recognition Tianlin Li Weizhe Kong Jiandong Jin Shiao Wang Ruichong Gao Qingchuan Ma Chenglong Li Jin Tang Mamba 44 5 0 15 Jul 2024
xLSTMTime : Long-term Time Series Forecasting With xLSTM Musleh Alharthi A. Mahmood AI4TS 23 14 0 14 Jul 2024
Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond Yingcong Li A. S. Rawat Samet Oymak 35 7 0 13 Jul 2024
Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers Sukjun Hwang Aakash Lahoti Tri Dao Albert Gu Mamba 62 13 0 13 Jul 2024
Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba Haoye Dong Aviral Chharia Wenbo Gou Francisco Vicente Carrasco Fernando de la Torre Mamba 58 3 0 12 Jul 2024
HiPPO-Prophecy: State-Space Models can Provably Learn Dynamical Systems in Context Federico Arangath Joseph K. Haefeli Noah Liniger Çağlar Gülçehre 31 2 0 12 Jul 2024
Combining Federated Learning and Control: A Survey Jakob Weber Markus Gurtner A. Lobe Adrian Trachte Andreas Kugi FedML AI4CE 48 2 0 12 Jul 2024
Inference Optimization of Foundation Models on AI Accelerators Youngsuk Park Kailash Budhathoki Liangfu Chen Jonas M. Kübler Jiaji Huang Matthäus Kleindessner Jun Huan V. Cevher Yida Wang George Karypis 50 3 0 12 Jul 2024
SliceMamba with Neural Architecture Search for Medical Image Segmentation Chao Fan Hongyuan Yu Yan Huang Liang Wang Zhenghan Yang Xibin Jia Mamba 53 1 0 11 Jul 2024
VideoMamba: Spatio-Temporal Selective State Space Model Jinyoung Park Hee-Seon Kim Kangwook Ko Minbeom Kim Changick Kim Mamba 49 7 0 11 Jul 2024
GraphMamba: An Efficient Graph Structure Learning Vision Mamba for Hyperspectral Image Classification Aitao Yang Min Li Yao Ding Leyuan Fang Yaoming Cai Yujie He 60 9 0 11 Jul 2024
DMM: Disparity-guided Multispectral Mamba for Oriented Object Detection in Remote Sensing Minghang Zhou Tianyu Li Chaofan Qiao Dongyu Xie Guoqing Wang Ningjuan Ruan Lin Mei Yang Yang Mamba 53 5 0 11 Jul 2024
Towards a theory of learning dynamics in deep state space models Jakub Smékal Jimmy T.H. Smith Michael Kleinman D. Biderman Scott W. Linderman 35 3 0 10 Jul 2024
RotRNN: Modelling Long Sequences with Rotations Rares Dolga Kai Biegun Jake Cunningham David Barber 44 3 0 09 Jul 2024
HTD-Mamba: Efficient Hyperspectral Target Detection with Pyramid State Space Model Dunbin Shen Xuanbing Zhu Jiacheng Tian Jianjun Liu Zhenrong Du Hongyu Wang Xiaorui Ma Mamba 29 1 0 09 Jul 2024
LETS-C: Leveraging Language Embedding for Time Series Classification Rachneet Kaur Zhen Zeng T. Balch Manuela Veloso AI4TS 46 0 0 09 Jul 2024
Mamba-FSCIL: Dynamic Adaptation with Selective State Space Model for Few-Shot Class-Incremental Learning Xiaojie Li Yibo Yang Jianlong Wu Guohao Li Liqiang Nie Min Zhang Mamba 46 5 0 08 Jul 2024
A Mamba-based Siamese Network for Remote Sensing Change Detection Jay N. Paranjape C. D. Melo Vishal M. Patel Mamba 42 5 0 08 Jul 2024
TransMA: an explainable multi-modal deep learning model for predicting properties of ionizable lipid nanoparticles in mRNA delivery Kun Wu Zixu Wang Xiulong Yang Yangyang Chen Zhenqi Han Jialu Zhang Lizhuang Liu 40 0 0 08 Jul 2024
On the Power of Convolution Augmented Transformer Mingchen Li Xuechen Zhang Yixiao Huang Samet Oymak 40 1 0 08 Jul 2024
Mamba Hawkes Process Anningzhe Gao Shan Dai Yan Hu Mamba 37 1 0 07 Jul 2024
Missed Causes and Ambiguous Effects: Counterfactuals Pose Challenges for Interpreting Neural Networks Aaron Mueller CML 38 10 0 05 Jul 2024
Micro-gesture Online Recognition using Learnable Query Points Pengyu Liu Fei Wang Kun Li Guoliang Chen Yanyan Wei Shengeng Tang Zhiliang Wu Dan Guo EgoV 62 6 0 05 Jul 2024
Learning to (Learn at Test Time): RNNs with Expressive Hidden States Yu Sun Xinhao Li Karan Dalal Jiarui Xu Arjun Vikram ... Xinlei Chen Xiaolong Wang Sanmi Koyejo Tatsunori Hashimoto Carlos Guestrin 78 93 0 05 Jul 2024
Vision Mamba for Classification of Breast Ultrasound Images Ali Nasiri-Sarvi Mahdi S. Hosseini Hassan Rivaz 44 5 0 04 Jul 2024
MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention Huiqiang Jiang Yucheng Li Chengruidong Zhang Qianhui Wu Xufang Luo ... Amir H. Abdi Dongsheng Li Chin-Yew Lin Yuqing Yang L. Qiu 77 88 0 02 Jul 2024
VFIMamba: Video Frame Interpolation with State Space Models Guozhen Zhang Chunxu Liu Yutao Cui Xiaotong Zhao Kai Ma Limin Wang 50 10 0 02 Jul 2024
MTMamba: Enhancing Multi-Task Dense Scene Understanding by Mamba-Based Decoders Baijiong Lin Weisen Jiang Pengguang Chen Yu Zhang Shu Liu Ying-Cong Chen Mamba 51 9 0 02 Jul 2024