Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba

24 June 2024

Yuchen Zou

Yineng Chen

Zuchao Li

Lefei Zhang

Hai Zhao

ArXiv PDF HTML

Papers citing "Venturing into Uncharted Waters: The Navigation Compass from Transformer to Mamba"

27 / 27 papers shown

Title
A Survey on Mamba Architecture for Vision Applications Fady Ibrahim Guangjun Liu Guanghui Wang Mamba 59 2 0 11 Feb 2025
Dimba: Transformer-Mamba Diffusion Models Zhengcong Fei Mingyuan Fan Changqian Yu Debang Li Youqiang Zhang Junshi Huang Mamba 59 16 0 03 Jun 2024
LLEMamba: Low-Light Enhancement via Relighting-Guided Mamba with Deep Unfolding Network Xuanqi Zhang Haijin Zeng Jinwang Pan Qiangqiang Shen Yongyong Chen Mamba 44 5 0 03 Jun 2024
A Novel State Space Model with Local Enhancement and State Sharing for Image Fusion Zihan Cao Xiao Wu Liang-Jian Deng Yu Zhong Mamba 40 9 0 14 Apr 2024
MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion Zhe Li Haiwei Pan Kejia Zhang Yuhua Wang Feng Yu Mamba 39 19 0 12 Apr 2024
FusionMamba: Efficient Image Fusion with State Space Model Siran Peng Xiangyu Zhu Haoyu Deng Zhen Lei Liang-Jian Deng Mamba 36 7 0 11 Apr 2024
SurvMamba: State Space Model with Multi-grained Multi-modal Interaction for Survival Prediction Ying Chen Jiajing Xie Yuxiang Lin Yuhang Song Wenxian Yang Rongshan Yu Mamba 34 6 0 11 Apr 2024
Heracles: A Hybrid SSM-Transformer Model for High-Resolution Image and Time-Series Analysis Badri N. Patro Suhas Ranganath Vinay P. Namboodiri Vijay Srinivas Agneeswaran 43 2 0 26 Mar 2024
ReMamber: Referring Image Segmentation with Mamba Twister Yu-Hao Yang Chaofan Ma Jiangchao Yao Zhun Zhong Ya-Qin Zhang Yanfeng Wang Mamba 58 20 0 26 Mar 2024
TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting Md. Atik Ahamed Qiang Cheng Mamba AI4TS 60 47 0 14 Mar 2024
VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation Mingya Zhang Yue Yu Limei Gu Tingsheng Lin Xianping Tao Mamba 55 44 0 14 Mar 2024
Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers Changsheng Quan Xiaofei Li 44 23 0 12 Mar 2024
ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes Zhichao Yang Avijit Mitra Sunjae Kwon Hong-ye Yu 34 20 0 09 Mar 2024
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models Soham De Samuel L. Smith Anushan Fernando Aleksandar Botev George-Christian Muraru ... David Budden Yee Whye Teh Razvan Pascanu Nando de Freitas Çağlar Gülçehre Mamba 58 117 0 29 Feb 2024
Simple linear attention language models balance the recall-throughput tradeoff Simran Arora Sabri Eyuboglu Michael Zhang Aman Timalsina Silas Alberti Dylan Zinsley James Zou Atri Rudra Christopher Ré 41 18 0 28 Feb 2024
MambaIR: A Simple Baseline for Image Restoration with State-Space Model Hang Guo Jinmin Li Tao Dai Zhihao Ouyang Xudong Ren Shu-Tao Xia Mamba 55 200 0 23 Feb 2024
Pan-Mamba: Effective pan-sharpening with State Space Model Xuanhua He Ke Cao K. Yan Rui Li Chengjun Xie Jie Zhang Man Zhou Mamba 60 62 0 19 Feb 2024
PointMamba: A Simple State Space Model for Point Cloud Analysis Dingkang Liang Xin Zhou Wei Xu Xingkui Zhu Zhikang Zou Xiaoqing Ye Xinyu Wang Xiang Bai 89 90 0 16 Feb 2024
Graph Mamba: Towards Learning on Graphs with State Space Models Ali Behrouz Farnoosh Hashemi AI4CE 109 58 0 13 Feb 2024
Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data Shufan Li Harkanwar Singh Aditya Grover Mamba 92 56 0 08 Feb 2024
U-shaped Vision Mamba for Single Image Dehazing Zhuoran Zheng Chen Henry Wu 70 34 0 06 Feb 2024
VM-UNet: Vision Mamba UNet for Medical Image Segmentation Jiacheng Ruan Suncheng Xiang Mamba 78 254 0 04 Feb 2024
LOCOST: State-Space Models for Long Document Abstractive Summarization Florian Le Bronnec Song Duong Mathieu Ravaut Alexandre Allauzen Nancy F. Chen Vincent Guigue Alberto Lumbreras Laure Soulier Patrick Gallinari 40 8 0 31 Jan 2024
U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation Jun Ma Feifei Li Bo Wang Mamba 82 330 0 09 Jan 2024
How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections Albert Gu Isys Johnson Aman Timalsina Atri Rudra Christopher Ré Mamba 95 89 0 24 Jun 2022
U-Net: Convolutional Networks for Biomedical Image Segmentation Olaf Ronneberger Philipp Fischer Thomas Brox SSeg 3DV 294 75,800 0 18 May 2015
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 296 39,194 0 01 Sep 2014