v1v2v3 (latest)

MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining

1 October 2024

Papers citing "MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining"

50 / 51 papers shown

Title
VideoMAP: Toward Scalable Mamba-based Video Autoregressive Pretraining Yunze Liu Peiran Wu C. Liang Junxiao Shen Limin Wang Li Yi Mamba 136 1 0 16 Mar 2025
RoMA: Scaling up Mamba-based Foundation Models for Remote Sensing Fengxiang Wang Hongru Wang Yansen Wang Di Wang Mingshuo Chen ... Yangang Sun Shuo Wang L. Lan Wenjing Yang Jing Zhang Mamba 105 3 0 13 Mar 2025
VMamba: Visual State Space Model Yue Liu Yunjie Tian Yuzhong Zhao Hongtian Yu Lingxi Xie Yaowei Wang Qixiang Ye Jianbin Jiao Yunfan Liu Mamba 288 699 0 31 Dec 2024
MaskMamba: A Hybrid Mamba-Transformer Model for Masked Image Generation Wenchao Chen Liqiang Niu Ziyao Lu Fandong Meng Jie Zhou Mamba 77 4 0 30 Sep 2024
MambaVision: A Hybrid Mamba-Transformer Vision Backbone Ali Hatamizadeh Jan Kautz Mamba 129 70 0 10 Jul 2024
Autoregressive Image Generation without Vector Quantization Tianhong Li Yonglong Tian He Li Mingyang Deng Kaiming He DiffM 124 235 0 17 Jun 2024
Autoregressive Pretraining with Mamba in Vision Sucheng Ren Xianhang Li Haoqin Tu Feng Wang Fangxun Shu ... L. Yang Peng Wang Heng Wang Alan Yuille Cihang Xie Mamba 114 12 0 11 Jun 2024
Mamba-R: Vision Mamba ALSO Needs Registers Feng Wang Jiahao Wang Sucheng Ren Guoyizhe Wei J. Mei Wei Shao Yuyin Zhou Alan Yuille Cihang Xie Mamba 67 23 0 23 May 2024
Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model Xu Han Yuan Tang Zhaoxuan Wang Xianzhi Li 65 28 0 23 Apr 2024
Jamba: A Hybrid Transformer-Mamba Language Model Opher Lieber Barak Lenz Hofit Bata Gal Cohen Jhonathan Osin ... Nir Ratner N. Rozen Erez Shwartz Mor Zusman Y. Shoham 90 226 0 28 Mar 2024
PointMamba: A Simple State Space Model for Point Cloud Analysis Dingkang Liang Xin Zhou Wei Xu Xingkui Zhu Zhikang Zou Xiaoqing Ye Xinyu Wang Xiang Bai 158 100 0 16 Feb 2024
Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model Lianghui Zhu Bencheng Liao Qian Zhang Xinlong Wang Wenyu Liu Xinggang Wang Mamba 105 768 0 17 Jan 2024
Mamba: Linear-Time Sequence Modeling with Selective State Spaces Albert Gu Tri Dao Mamba 148 2,767 0 01 Dec 2023
Decoupled Local Aggregation for Point Cloud Learning Binjie Chen Yunzhou Xia Yu Zang Cheng-Yu Wang Jonathan Li 3DPC 62 10 0 31 Aug 2023
Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models Yaohua Zha Jinpeng Wang Tao Dai Bin Chen Zhi Wang Shutao Xia VLM 89 48 0 14 Apr 2023
Self-positioning Point-based Transformer for Point Cloud Understanding Jinyoung Park S. Lee S. Kim Yunyang Xiong Hyunwoo J. Kim ViT 3DPC 68 60 0 29 Mar 2023
Point Cloud Classification Using Content-based Transformer via Clustering in Feature Space Yahui Liu Bin Wang Yisheng Lv Lingxi Li Feiyue Wang ViT 3DPC 81 45 0 08 Mar 2023
P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Prompting Ziyi Wang Xumin Yu Yongming Rao Jie Zhou Jiwen Lu VPVLM VLM 77 77 0 04 Aug 2022
PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies Guocheng Qian Yuchen Li Houwen Peng Jinjie Mai Hasan Hammoud Mohamed Elhoseiny Guohao Li 3DPC 108 636 0 09 Jun 2022
Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training Renrui Zhang Ziyu Guo Rongyao Fang Bingyan Zhao Dong Wang Yu Qiao Hongsheng Li Peng Gao 3DPC 252 258 0 28 May 2022
Masked Discrimination for Self-Supervised Learning on Point Clouds Haotian Liu Mu Cai Yong Jae Lee 3DPC 95 169 0 21 Mar 2022
Masked Autoencoders for Point Cloud Self-supervised Learning Yatian Pang Wenxiao Wang Francis E. H. Tay Wen Liu Yonghong Tian Liuliang Yuan 3DPC ViT 100 476 0 13 Mar 2022
CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding Mohamed Afham Isuru Dissanayake Dinithi Dissanayake Amaya Dharmasiri Kanchana Thilakarathna Ranga Rodrigo 3DPC 87 257 0 01 Mar 2022
Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Framework Xu Ma Can Qin Haoxuan You Haoxi Ran Y. Fu 3DPC 62 598 0 15 Feb 2022
A ConvNet for the 2020s Zhuang Liu Hanzi Mao Chaozheng Wu Christoph Feichtenhofer Trevor Darrell Saining Xie ViT 178 5,213 0 10 Jan 2022
PRA-Net: Point Relation-Aware Network for 3D Point Cloud Analysis Shuyang Cheng Xiwu Chen Xinwei He Zhe Liu X. Bai 3DPC 83 138 0 09 Dec 2021
Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling Xumin Yu Lulu Tang Yongming Rao Tiejun Huang Jie Zhou Jiwen Lu 3DPC 142 684 0 29 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 477 7,819 0 11 Nov 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 147 854 0 14 Jun 2021
Revisiting Point Cloud Shape Classification with a Simple and Effective Baseline Ankit Goyal Hei Law Bowei Liu Alejandro Newell Jia Deng 3DPC 81 230 0 09 Jun 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 463 21,566 0 25 Mar 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 389 6,802 0 23 Dec 2020
PCT: Point cloud transformer Meng-Hao Guo Junxiong Cai Zheng-Ning Liu Tai-Jiang Mu Ralph Robert Martin Shimin Hu ViT 3DPC 160 1,624 0 17 Dec 2020
MVTN: Multi-View Transformation Network for 3D Shape Recognition Abdullah Hamdi Silvio Giancola Guohao Li 3DV 3DPC 103 203 0 26 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 670 41,430 0 22 Oct 2020
Unsupervised Point Cloud Pre-Training via Occlusion Completion Hanchen Wang Qi Liu Xiangyu Yue Joan Lasenby Matt J. Kusner 3DPC 68 251 0 02 Oct 2020
PointContrast: Unsupervised Pre-training for 3D Point Cloud Understanding Saining Xie Jiatao Gu Demi Guo C. Qi Leonidas Guibas Or Litany 3DPC 211 640 0 21 Jul 2020
Dense-Resolution Network for Point Cloud Classification and Segmentation Shi Qiu Saeed Anwar Nick Barnes 3DPC 54 93 0 14 May 2020
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 213 12,124 0 13 Nov 2019
Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Data Mikaela Angelina Uy Quang Pham Binh-Son Hua D. Nguyen Sai-Kit Yeung 3DV 3DPC 108 784 0 13 Aug 2019
Cascade R-CNN: High Quality Object Detection and Instance Segmentation Zhaowei Cai Nuno Vasconcelos ObjD 82 1,358 0 24 Jun 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 153 18,179 0 28 May 2019
Unified Perceptual Parsing for Scene Understanding Tete Xiao Yingcheng Liu Bolei Zhou Yuning Jiang Jian Sun OCL VOS 195 1,895 0 26 Jul 2018
Dynamic Graph CNN for Learning on Point Clouds Yue Wang Yongbin Sun Ziwei Liu Sanjay E. Sarma M. Bronstein Justin Solomon GNN 3DPC 257 6,169 0 24 Jan 2018
$PointCNN: Convolution On $\mathcal{X}$-Transformed Points$ PointCNN: Convolution On $\mathcal{X}$ -Transformed Points Yangyan Li Rui Bu Mingchao Sun Wei Wu Xinhan Di Baoquan Chen 3DPC 235 2,450 0 23 Jan 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 783 132,363 0 12 Jun 2017
PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space C. Qi L. Yi Hao Su Leonidas Guibas 3DPC 3DV 366 11,142 0 07 Jun 2017
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation C. Qi Hao Su Kaichun Mo Leonidas Guibas 3DH 3DPC 3DV PINN 493 14,360 0 02 Dec 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.2K 194,426 0 10 Dec 2015
ShapeNet: An Information-Rich 3D Model Repository Angel X. Chang Thomas Funkhouser Leonidas Guibas Pat Hanrahan Qi-Xing Huang ... Shuran Song Hao Su Jianxiong Xiao L. Yi Feng Yu 3DV 172 5,538 0 09 Dec 2015