PiMAE: Point Cloud and Image Interactive Masked Autoencoders for 3D Object Detection

14 March 2023

Shanghang Zhang

ArXiv (abs)PDF HTML Github (133★)

Papers citing "PiMAE: Point Cloud and Image Interactive Masked Autoencoders for 3D Object Detection"

48 / 48 papers shown

Title
Masked Image Modeling: A Survey Vlad Hondru Florinel-Alin Croitoru Shervin Minaee Radu Tudor Ionescu N. Sebe 135 8 0 13 Aug 2024
Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoders Renrui Zhang Liuhui Wang Yu Qiao Peng Gao Hongsheng Li 3DPC 79 133 0 13 Dec 2022
i-MAE: Are Latent Representations in Masked Autoencoders Linearly Separable? Kevin Zhang Zhiqiang Shen 49 8 0 20 Oct 2022
Boosting 3D Object Detection via Object-Focused Image Fusion Hao-Hsiang Yang Chen Shi Yihong Chen Liwei Wang 3DPC 50 24 0 21 Jul 2022
Can Language Understand Depth? Renrui Zhang Ziyao Zeng Ziyu Guo Yafeng Li VLM MDE 79 73 0 03 Jul 2022
Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training Renrui Zhang Ziyu Guo Rongyao Fang Bingyan Zhao Dong Wang Yu Qiao Hongsheng Li Peng Gao 3DPC 250 257 0 28 May 2022
Multimodal Masked Autoencoders Learn Transferable Representations Xinyang Geng Hao Liu Lisa Lee Dale Schuurams Sergey Levine Pieter Abbeel 75 118 0 27 May 2022
ConvMAE: Masked Convolution Meets Masked Autoencoders Peng Gao Teli Ma Hongsheng Li Ziyi Lin Jifeng Dai Yu Qiao ViT 77 126 0 08 May 2022
MultiMAE: Multi-modal Multi-task Masked Autoencoders Roman Bachmann David Mizrahi Andrei Atanov Amir Zamir 129 277 0 04 Apr 2022
POS-BERT: Point Cloud One-Stage BERT Pre-Training Kexue Fu Peng Gao Shaolei Liu Renrui Zhang Yu Qiao Manning Wang 3DPC 67 18 0 03 Apr 2022
MonoDETR: Depth-guided Transformer for Monocular 3D Object Detection Renrui Zhang Han Qiu Tai Wang Ziyu Guo Xuan Xu Xuanzhuo Xu Ziteng Cui Peng Gao Hongsheng Li Hongsheng Li ViT MDE 102 90 0 24 Mar 2022
Masked Autoencoders for Point Cloud Self-supervised Learning Yatian Pang Wenxiao Wang Francis E. H. Tay Wen Liu Yonghong Tian Liuliang Yuan 3DPC ViT 86 475 0 13 Mar 2022
CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding Mohamed Afham Isuru Dissanayake Dinithi Dissanayake Amaya Dharmasiri Kanchana Thilakarathna Ranga Rodrigo 3DPC 74 255 0 01 Mar 2022
SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-Training for Spatial-Aware Visual Representations Zhenyu Li Zehui Chen Ang Li Liangji Fang Qinhong Jiang Xianming Liu Junjun Jiang Bolei Zhou Hang Zhao 3DPC SSL 79 66 0 09 Dec 2021
FCAF3D: Fully Convolutional Anchor-Free 3D Object Detection D. Rukhovich Anna Vorontsova Anton Konushin 3DPC 109 117 0 01 Dec 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 467 7,814 0 11 Nov 2021
An End-to-End Transformer Model for 3D Object Detection Ishan Misra Rohit Girdhar Armand Joulin 3DPC ViT 85 486 0 16 Sep 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 281 2,826 0 15 Jun 2021
ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detection D. Rukhovich Anna Vorontsova Anton Konushin 3DPC 75 172 0 02 Jun 2021
Dual-stream Network for Visual Recognition Mingyuan Mao Renrui Zhang Honghui Zheng Peng Gao Teli Ma Yan Peng Errui Ding Baochang Zhang Shumin Han ViT 58 66 0 31 May 2021
Pri3D: Can 3D Priors Help 2D Representation Learning? Ji Hou Saining Xie Benjamin Graham Angela Dai Matthias Nießner SSL 3DPC MDE 123 80 0 22 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 157 1,868 0 05 Apr 2021
Self-Supervised Pretraining of 3D Features on any Point-Cloud Zaiwei Zhang Rohit Girdhar Armand Joulin Ishan Misra 3DPC 176 272 0 07 Jan 2021
P4Contrast: Contrastive Learning with Pairs of Point-Pixel Pairs for RGB-D Scene Understanding Yunze Liu Li Yi Shanghang Zhang Qingnan Fan Thomas Funkhouser Hao Dong SSL 95 60 0 24 Dec 2020
Deep Continuous Fusion for Multi-Sensor 3D Object Detection Ming Liang Binh Yang Shenlong Wang R. Urtasun 3DPC 261 845 0 20 Dec 2020
Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts Ji Hou Benjamin Graham Matthias Nießner Saining Xie 3DPC 107 270 0 16 Dec 2020
End-to-End Object Detection with Adaptive Clustering Transformer Minghang Zheng Peng Gao Renrui Zhang Kunchang Li Xiaogang Wang Hongsheng Li Hao Dong ViT 154 199 0 18 Nov 2020
Point Transformer Nico Engel Vasileios Belagiannis Klaus C. J. Dietmayer 3DPC 181 1,994 0 02 Nov 2020
Debiased Contrastive Learning Ching-Yao Chuang Joshua Robinson Yen-Chen Lin Antonio Torralba Stefanie Jegelka SSL 76 566 0 01 Jul 2020
Generative Sparse Detection Networks for 3D Single-shot Object Detection JunYoung Gwak Chris Choy Silvio Savarese 3DPC 59 102 0 22 Jun 2020
H3DNet: 3D Object Detection Using Hybrid Geometric Primitives Zaiwei Zhang Bo Sun Haitao Yang Qi-Xing Huang 3DPC 77 200 0 10 Jun 2020
End-to-End Object Detection with Transformers Nicolas Carion Francisco Massa Gabriel Synnaeve Nicolas Usunier Alexander Kirillov Sergey Zagoruyko ViT 3DV PINN 421 13,048 0 26 May 2020
PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection Shaoshuai Shi Chaoxu Guo Li Jiang Zhe Wang Jianping Shi Xiaogang Wang Hongsheng Li 3DPC 98 1,777 0 31 Dec 2019
TANet: Robust 3D Object Detection from Point Clouds with Triple Attention Zhe Liu Xin Zhao Tengteng Huang Ruolan Hu Yu Zhou X. Bai 3DPC 64 347 0 11 Dec 2019
Deep Hough Voting for 3D Object Detection in Point Clouds C. Qi Or Litany Kaiming He Leonidas Guibas 3DPC 108 1,290 0 21 Apr 2019
3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans Ji Hou Angela Dai Matthias Nießner ISeg 82 468 0 17 Dec 2018
PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud Shaoshuai Shi Xiaogang Wang Hongsheng Li 3DPC 182 2,410 0 11 Dec 2018
Meta-learning with differentiable closed-form solvers Luca Bertinetto João F. Henriques Philip Torr Andrea Vedaldi ODL 93 930 0 21 May 2018
Joint 3D Proposal Generation and Object Detection from View Aggregation Jason Ku Melissa Mozifian Jungwook Lee Ali Harakeh Steven Waslander 3DPC 84 1,399 0 06 Dec 2017
Frustum PointNets for 3D Object Detection from RGB-D Data C. Qi Wen Liu Chenxia Wu Hao Su Leonidas Guibas 3DPC 150 2,265 0 22 Nov 2017
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection Yin Zhou Oncel Tuzel 3DPC 112 3,723 0 17 Nov 2017
Learning to Compare: Relation Network for Few-Shot Learning Flood Sung Yongxin Yang Li Zhang Tao Xiang Philip Torr Timothy M. Hospedales 301 4,050 0 16 Nov 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 823 11,937 0 09 Mar 2017
ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes Angela Dai Angel X. Chang Manolis Savva Maciej Halber Thomas Funkhouser Matthias Nießner 3DPC 3DV 481 4,062 0 14 Feb 2017
A Point Set Generation Network for 3D Object Reconstruction from a Single Image Haoqiang Fan Hao Su Leonidas Guibas 3DPC 3DV 169 2,241 0 02 Dec 2016
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation C. Qi Hao Su Kaichun Mo Leonidas Guibas 3DH 3DPC 3DV PINN 493 14,353 0 02 Dec 2016
Matching Networks for One Shot Learning Oriol Vinyals Charles Blundell Timothy Lillicrap Koray Kavukcuoglu Daan Wierstra VLM 373 7,323 0 13 Jun 2016
Deep Sliding Shapes for Amodal 3D Object Detection in RGB-D Images Shuran Song Jianxiong Xiao 3DPC 96 681 0 07 Nov 2015