Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling

29 November 2021

Jie Zhou

Papers citing "Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling"

50 / 399 papers shown

Title
Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Prediction Chenxin Xu R. Tan Yuhong Tan Siheng Chen Xinchao Wang Yanfeng Wang 3DH 45 20 0 17 Aug 2023
Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenes Zehan Wang Haifeng Huang Yang Zhao Ziang Zhang Zhou Zhao 19 60 0 17 Aug 2023
3DHacker: Spectrum-based Decision Boundary Generation for Hard-label 3D Point Cloud Attack Yunbo Tao Daizong Liu Pan Zhou Yulai Xie Wei Du Wei Hu 3DPC AAML 19 11 0 15 Aug 2023
Experts Weights Averaging: A New General Training Scheme for Vision Transformers Yongqian Huang Peng Ye Xiaoshui Huang Sheng Li Tao Chen Tong He Wanli Ouyang MoMe 28 8 0 11 Aug 2023
Robustifying Point Cloud Networks by Refocusing Meir Yossef Levi Guy Gilboa 3DPC 27 4 0 10 Aug 2023
Self-supervised Learning of Rotation-invariant 3D Point Set Features using Transformer and its Self-distillation T. Furuya Zhoujie Chen Ryutarou Ohbuchi Zhenzhong Kuang 3DPC 26 2 0 09 Aug 2023
Beyond First Impressions: Integrating Joint Multi-modal Cues for Comprehensive 3D Representation Haowei Wang Jiji Tang Jiayi Ji Xiaoshuai Sun Rongsheng Zhang ... Minda Zhao Lincheng Li zeng zhao Tangjie Lv Rongrong Ji 3DV 23 13 0 06 Aug 2023
Sketch and Text Guided Diffusion Model for Colored Point Cloud Generation Zijie Wu Yaonan Wang Mingtao Feng He-ping Xie Ajmal Saeed Mian DiffM 19 32 0 05 Aug 2023
RegionBLIP: A Unified Multi-modal Pre-training Framework for Holistic and Regional Comprehension Qiang-feng Zhou Chaohui Yu Shaofeng Zhang Sitong Wu Zhibin Wang Fan Wang 34 27 0 03 Aug 2023
Disruptive Autoencoders: Leveraging Low-level features for 3D Medical Image Pre-training Jeya Maria Jose Valanarasu Yucheng Tang Dong Yang Ziyue Xu Can Zhao ... Vishal M. Patel Bennett Landman Daguang Xu Yufan He V. Nath MedIm 23 13 0 31 Jul 2023
VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation Zekun Qi Muzhou Yu Runpei Dong Kaisheng Ma 3DPC 20 11 0 28 Jul 2023
Point Clouds Are Specialized Images: A Knowledge Transfer Approach for 3D Understanding Jiachen Kang W. Jia Xiangjian He Kin-Man Lam 3DPC 29 2 0 28 Jul 2023
Take-A-Photo: 3D-to-2D Generative Pre-training of Point Cloud Models Ziyi Wang Xumin Yu Yongming Rao Jie Zhou Jiwen Lu DiffM 3DPC 27 18 0 27 Jul 2023
Building3D: An Urban-Scale Dataset and Benchmarks for Learning Roof Structures from Point Clouds Ruisheng Wang Shangfeng Huang Hongxin Yang 3DPC 3DV 16 26 0 21 Jul 2023
Meta-Transformer: A Unified Framework for Multimodal Learning Yiyuan Zhang Kaixiong Gong Kaipeng Zhang Hongsheng Li Yu Qiao Wanli Ouyang Xiangyu Yue 24 137 0 20 Jul 2023
Self-supervised adversarial masking for 3D point cloud representation learning Michal Szachniewicz Wojciech Kozlowski Michal Stypulkowski Maciej Ziȩba 3DPC 16 2 0 11 Jul 2023
Feature Activation Map: Visual Explanation of Deep Learning Models for Image Classification Yiwen Liao Yongsheng Gao Weichuan Zhang FAtt 12 0 0 11 Jul 2023
Mx2M: Masked Cross-Modality Modeling in Domain Adaptation for 3D Semantic Segmentation Boxiang Zhang Zunran Wang Yonggen Ling Yuanyuan Guan Shenghao Zhang Wenhui Li 37 6 0 09 Jul 2023
Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectors Nicolae-Cătălin Ristea Florinel-Alin Croitoru Radu Tudor Ionescu Marius Popescu F. Khan M. Shah ViT 26 20 0 21 Jun 2023
Event Stream GPT: A Data Pre-processing and Modeling Library for Generative, Pre-trained Transformers over Continuous-time Sequences of Complex Events Matthew B. A. McDermott Bret A. Nestor Peniel Argaw I. Kohane AI4TS 24 21 0 20 Jun 2023
ExpPoint-MAE: Better interpretability and performance for self-supervised point cloud transformers Ioannis Romanelis Vlassis Fotis Konstantinos Moustakas Adrian Munteanu ViT 3DPC 21 4 0 19 Jun 2023
A Universal Semantic-Geometric Representation for Robotic Manipulation Tong Zhang Yingdong Hu Hanchen Cui Hang Zhao Yang Gao 70 17 0 18 Jun 2023
Explore In-Context Learning for 3D Point Cloud Understanding Zhongbin Fang Xiangtai Li Xia Li J. M. Buhmann Chen Change Loy Mengyuan Liu 3DPC 25 24 0 14 Jun 2023
FlowFormer: A Transformer Architecture and Its Masked Cost Volume Autoencoding for Optical Flow Zhaoyang Huang Xiaoyu Shi Chao Zhang Qiang Wang Yijin Li Hongwei Qin Jifeng Dai Xiaogang Wang Hongsheng Li 33 4 0 08 Jun 2023
3D Human Keypoints Estimation From Point Clouds in the Wild Without Human Labels Zhenzhen Weng Alexander S. Gorban Jingwei Ji Mahyar Najibi Yin Zhou Drago Anguelov 3DPC 3DH 13 9 0 07 Jun 2023
Randomized 3D Scene Generation for Generalizable Self-Supervised Pre-Training Lanxiao Li M. Heizmann 19 0 0 07 Jun 2023
Multi-View Representation is What You Need for Point-Cloud Pre-Training Siming Yan Chen Song Youkang Kong Qi-Xing Huang 3DPC 31 2 0 05 Jun 2023
Collect-and-Distribute Transformer for 3D Point Cloud Analysis Haibo Qiu Baosheng Yu Dacheng Tao 3DPC ViT 27 6 0 02 Jun 2023
Point-GCC: Universal Self-supervised 3D Scene Pre-training via Geometry-Color Contrast Guo Fan Zekun Qi Wenkai Shi Kaisheng Ma 3DPC SSL 31 9 0 31 May 2023
GMSF: Global Matching Scene Flow Yushan Zhang Johan Edstedt Bastian Wandt Per-Erik Forssén Maria Magnusson M. Felsberg 35 9 0 27 May 2023
Point2SSM: Learning Morphological Variations of Anatomies from Point Cloud Jadie Adams Shireen Elhabian 3DPC 21 10 0 23 May 2023
Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised Learning Xiaoxiao Sheng Zhiqiang Shen Gang Xiao 3DPC SSL 28 6 0 22 May 2023
Connecting Multi-modal Contrastive Representations Zehan Wang Yang Zhao Xize Cheng Haifeng Huang Jiageng Liu ... Lin Li Yongqiang Wang Aoxiong Yin Ziang Zhang Zhou Zhao 27 22 0 22 May 2023
PointGPT: Auto-regressively Generative Pre-training from Point Clouds Guang-Sheng Chen Meiling Wang Yi Yang Kai Yu Li-xin Yuan Yufeng Yue 3DPC 18 80 0 19 May 2023
OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understanding Minghua Liu Ruoxi Shi Kaiming Kuang Yinhao Zhu Xuanlin Li Shizhong Han H. Cai Fatih Porikli Hao Su 3DPC 39 116 0 18 May 2023
GeoMAE: Masked Geometric Target Prediction for Self-supervised Point Cloud Pre-Training Xiaoyu Tian Haoxi Ran Yue Wang Hang Zhao 3DPC ViT 29 38 0 15 May 2023
Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation Models Zhimin Chen Longlong Jing Yingwei Li Bing Li 29 31 0 15 May 2023
ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding Le Xue Ning Yu Shu Zhen Zhang Artemis Panagopoulou Junnan Li ... Jiajun Wu Caiming Xiong Ran Xu Juan Carlos Niebles Silvio Savarese 24 115 0 14 May 2023
FreePoint: Unsupervised Point Cloud Instance Segmentation Zhikai Zhang Jian Ding Li Jiang Dengxin Dai Guisong Xia 3DPC 48 6 0 11 May 2023
When ChatGPT for Computer Vision Will Come? From 2D to 3D Chenghao Li Chaoning Zhang 34 2 0 10 May 2023
VTPNet for 3D deep learning on point cloud Wei Zhou Weiwei Jin Qian Wang Yifan Wang Dekui Wang Xingxing Hao Yong Yu 3DPC ViT 14 0 0 10 May 2023
Self-Supervised Learning for Point Clouds Data: A Survey Changyu Zeng Wei Wang A. Nguyen Yutao Yue 3DPC 36 0 0 09 May 2023
Self-supervised Pre-training with Masked Shape Prediction for 3D Scene Understanding Li Jiang Zetong Yang Shaoshuai Shi Vladislav Golyanik Dengxin Dai Bernt Schiele 3DPC 14 13 0 08 May 2023
Self-supervised Learning for Pre-Training 3D Point Clouds: A Survey Ben Fei Weidong Yang Liwen Liu Tian-jian Luo Rui Zhang Yixuan Li Ying He 3DPC 29 17 0 08 May 2023
PointCMP: Contrastive Mask Prediction for Self-supervised Learning on Point Cloud Videos Zhiqiang Shen Xiaoxiao Sheng Longguang Wang Y. Guo Qiong Liu Xiaoping Zhou 3DPC SSL 29 14 0 06 May 2023
OctFormer: Octree-based Transformers for 3D Point Clouds Peng-Shuai Wang ViT 3DPC 32 81 0 04 May 2023
Multi-view Vision-Prompt Fusion Network: Can 2D Pre-trained Model Boost 3D Point Cloud Data-scarce Learning? Hao Peng Baopu Li Bo-Wen Zhang Xin Chen Tao Chen Hongyuan Zhu 3DPC 21 1 0 20 Apr 2023
Transformer-Based Visual Segmentation: A Survey Xiangtai Li Henghui Ding Haobo Yuan Wenwei Zhang Jiangmiao Pang Guangliang Cheng Kai-xiang Chen Ziwei Liu Chen Change Loy ViT MedIm 42 132 0 19 Apr 2023
Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models Yaohua Zha Jinpeng Wang Tao Dai Bin Chen Zhi Wang Shutao Xia VLM 45 45 0 14 Apr 2023
3D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretraining Siming Yan Yu-Qi Yang Yu-Xiao Guo Hao Pan Peng-shuai Wang Xin Tong Yang Liu Qi-Xing Huang 3DPC 38 15 0 14 Apr 2023