Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling

29 November 2021

Jie Zhou

Papers citing "Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling"

49 / 399 papers shown

Title
Self-Supervised Learning with Multi-View Rendering for 3D Point Cloud Analysis Bach Tran Binh-Son Hua Anh Tran Minh Hoai 3DPC 36 7 0 28 Oct 2022
Common Corruption Robustness of Point Cloud Detectors: Benchmark and Enhancement Shuangzhi Li Zhijie Wang Felix Juefei Xu Qing-Wu Guo Xingyu Li L. Ma 3DPC 29 20 0 12 Oct 2022
Data Augmentation-free Unsupervised Learning for 3D Point Cloud Understanding Guofeng Mei Cristiano Saltori Fabio Poiesi Jian Zhang Elisa Ricci N. Sebe Qiang Wu 3DPC 56 5 0 06 Oct 2022
CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-training Tianyu Huang Bowen Dong Yunhan Yang Xiaoshui Huang Rynson W. H. Lau Wanli Ouyang W. Zuo VLM 3DPC CLIP 42 144 0 03 Oct 2022
Self-Supervised Masked Convolutional Transformer Block for Anomaly Detection Neelu Madan Nicolae-Cătălin Ristea Radu Tudor Ionescu Kamal Nasrollahi F. Khan T. Moeslund M. Shah ViT MedIm 258 61 0 25 Sep 2022
3DGTN: 3D Dual-Attention GLocal Transformer Network for Point Cloud Classification and Segmentation Dening Lu K. Gao Qian Xie Linlin Xu Jonathan Li 3DPC ViT 35 4 0 21 Sep 2022
Diffusion Unit: Interpretable Edge Enhancement and Suppression Learning for 3D Point Cloud Segmentation H. Xiu Xin Liu Weimin Wang Kyoung-Sook Kim T. Shinohara Qiong Chang M. Matsuoka 3DPC 44 11 0 20 Sep 2022
Can We Solve 3D Vision Tasks Starting from A 2D Vision Transformer? Yi Wang Zhiwen Fan Tianlong Chen Hehe Fan Zhangyang Wang ViT 53 9 0 15 Sep 2022
SeRP: Self-Supervised Representation Learning Using Perturbed Point Clouds Siddhant Garg Mudit Chaudhary 3DPC 45 2 0 13 Sep 2022
Pix4Point: Image Pretrained Standard Transformers for 3D Point Cloud Understanding Guocheng Qian Abdullah Hamdi Xingdi Zhang Guohao Li 3DPC ViT 27 4 0 25 Aug 2022
3D Vision with Transformers: A Survey Jean Lahoud Jiale Cao F. Khan Hisham Cholakkal Rao Muhammad Anwer Salman Khan Ming Yang ViT MedIm 29 32 0 08 Aug 2022
P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Prompting Ziyi Wang Xumin Yu Yongming Rao Jie Zhou Jiwen Lu VPVLM VLM 21 75 0 04 Aug 2022
A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyond Chaoning Zhang Chenshuang Zhang Junha Song John Seon Keun Yi Kang Zhang In So Kweon SSL 57 71 0 30 Jul 2022
Boosting Point-BERT by Multi-choice Tokens Kexue Fu Ming-Dong Yuan Manning Wang 3DPC 26 6 0 27 Jul 2022
Unsupervised pre-training of graph transformers on patient population graphs Chantal Pellegrini Nassir Navab Anees Kazi MedIm AI4CE 42 11 0 21 Jul 2022
MeshMAE: Masked Autoencoders for 3D Mesh Data Analysis Yaqian Liang Shanshan Zhao Baosheng Yu Jing Zhang Fazhi He ViT 31 37 0 20 Jul 2022
Masked Surfel Prediction for Self-Supervised Point Cloud Learning Yabin Zhang Jiehong Lin Chenhang He Y. Chen Kui Jia Lei Zhang 3DPC 21 19 0 07 Jul 2022
Masked Autoencoders in 3D Point Cloud Representation Learning Jincen Jiang Xuequan Lu Lizhi Zhao Richard Dazeley Meili Wang 3DPC ViT 56 28 0 04 Jul 2022
Masked Autoencoder for Self-Supervised Pre-training on Lidar Point Clouds Georg Hess Johan Jaxing Elias Svensson David Hagerman Christoffer Petersson Lennart Svensson 3DPC ViT 25 33 0 01 Jul 2022
Occupancy-MAE: Self-supervised Pre-training Large-scale LiDAR Point Clouds with Masked Occupancy Autoencoders Chen Min Xinli Xu Dawei Zhao Liang Xiao Yiming Nie Bin Dai 3DPC 35 50 0 20 Jun 2022
PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies Guocheng Qian Yuchen Li Houwen Peng Jinjie Mai Hasan Hammoud Mohamed Elhoseiny Guohao Li 3DPC 31 601 0 09 Jun 2022
Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training Renrui Zhang Ziyu Guo Rongyao Fang Bingyan Zhao Dong Wang Yu Qiao Hongsheng Li Peng Gao 3DPC 178 244 0 28 May 2022
3DILG: Irregular Latent Grids for 3D Generative Modeling Biao Zhang Matthias Nießner Peter Wonka 3DV 30 87 0 27 May 2022
PointVector: A Vector Representation In Point Cloud Analysis Xin Deng Wenyu Zhang Qing Ding Xinming Zhang 3DPC 45 28 0 21 May 2022
Advanced Feature Learning on Point Clouds using Multi-resolution Features and Learnable Pooling Kevin Tirta Wijaya Dong-Hee Paek Seung-Hyun Kong 3DPC 24 21 0 20 May 2022
Transformers in 3D Point Clouds: A Survey Dening Lu Qian Xie Mingqiang Wei Kyle Gao Linlin Xu Jonathan Li 3DPC ViT 32 49 0 16 May 2022
POS-BERT: Point Cloud One-Stage BERT Pre-Training Kexue Fu Peng Gao Shaolei Liu Renrui Zhang Yu Qiao Manning Wang 3DPC 24 18 0 03 Apr 2022
Meta-Sampler: Almost-Universal yet Task-Oriented Sampling for Point Clouds Ta-Ying Cheng Qingyong Hu Qian Xie Niki Trigoni Andrew Markham 3DPC 14 13 0 30 Mar 2022
3D-OAE: Occlusion Auto-Encoders for Self-Supervised Learning on Point Clouds Junsheng Zhou Xin Wen Baorui Ma Yu-Shen Liu Yue Gao Yi Fang Zhizhong Han 3DPC 33 17 0 26 Mar 2022
Masked Discrimination for Self-Supervised Learning on Point Clouds Haotian Liu Mu Cai Yong Jae Lee 3DPC 21 164 0 21 Mar 2022
Masked Autoencoders for Point Cloud Self-supervised Learning Yatian Pang Wenxiao Wang Francis E. H. Tay Wei Liu Yonghong Tian Liuliang Yuan 3DPC ViT 33 454 0 13 Mar 2022
Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Survey Aoran Xiao Jiaxing Huang Dayan Guan Xiaoqin Zhang Shijian Lu Ling Shao 3DPC 18 71 0 28 Feb 2022
COLA: COarse LAbel pre-training for 3D semantic segmentation of sparse LiDAR datasets Jules Sanchez Jean-Emmanuel Deschaud Franccois Goulette 3DPC 36 7 0 14 Feb 2022
Benchmarking and Analyzing Point Cloud Classification under Corruptions Jiawei Ren Liang Pan Ziwei Liu 3DPC 19 80 0 07 Feb 2022
ShapeFormer: Transformer-based Shape Completion via Sparse Representation Xingguang Yan Liqiang Lin Niloy J. Mitra Dani Lischinski Daniel Cohen-Or Hui Huang ViT 64 112 0 25 Jan 2022
CP-Net: Contour-Perturbed Reconstruction Network for Self-Supervised Point Cloud Learning Mingye Xu Yali Wang Zhipeng Zhou Hongbin Xu Yu Qiao 3DPC 13 13 0 20 Jan 2022
Implicit Autoencoder for Point-Cloud Self-Supervised Representation Learning Siming Yan Zhenpei Yang Haoxiang Li Chen Song Li Guan Hao Kang G. Hua Qi-Xing Huang 3DPC 43 61 0 03 Jan 2022
PU-Transformer: Point Cloud Upsampling Transformer Shi Qiu Saeed Anwar Nick Barnes 3DPC ViT 29 51 0 24 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 305 7,443 0 11 Nov 2021
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Zhongchao Shi Jianping Fan Zhiqiang He 3DGS ViT 74 330 0 11 Nov 2021
PVT: Point-Voxel Transformer for Point Cloud Learning Cheng Zhang Haocheng Wan Xinyi Shen Zizhao Wu 3DPC ViT 19 80 0 13 Aug 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 255 4,781 0 24 Feb 2021
Self-Supervised Pretraining of 3D Features on any Point-Cloud Zaiwei Zhang Rohit Girdhar Armand Joulin Ishan Misra 3DPC 126 268 0 07 Jan 2021
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir F. Khan M. Shah ViT 227 2,430 0 04 Jan 2021
PointContrast: Unsupervised Pre-training for 3D Point Cloud Understanding Saining Xie Jiatao Gu Demi Guo C. Qi Leonidas J. Guibas Or Litany 3DPC 141 622 0 21 Jul 2020
Cross-Shape Attention for Part Segmentation of 3D Point Clouds Marios Loizou Siddhant Garg Dmitry Petrov Melinos Averkiou E. Kalogerakis 3DPC 19 2 0 20 Mar 2020
DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processing Yongcheng Liu Bin Fan Gaofeng Meng Jiwen Lu Shiming Xiang Chunhong Pan 3DPC 119 270 0 09 Sep 2019
SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters Yifan Xu Tianqi Fan Mingye Xu Long Zeng Yu Qiao 3DV 3DPC 152 769 0 30 Mar 2018
PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation C. Qi Hao Su Kaichun Mo Leonidas J. Guibas 3DH 3DPC 3DV PINN 222 14,103 0 02 Dec 2016