Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling

29 November 2021

Jie Zhou

Papers citing "Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling"

50 / 398 papers shown

Title
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 35 139 0 13 Dec 2023
Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation Xianghui Xie Bharat Lal Bhatnagar J. E. Lenssen Gerard Pons-Moll 3DH 34 13 0 12 Dec 2023
Cross-BERT for Point Cloud Pretraining Xin Li Peng Li Zeyong Wei Zhe Zhu Mingqiang Wei Junhui Hou Liangliang Nan J. Qin H. Xie F. Wang SSL 3DPC 30 0 0 08 Dec 2023
Novel class discovery meets foundation models for 3D semantic segmentation Luigi Riz Cristiano Saltori Yiming Wang Elisa Ricci Fabio Poiesi 3DPC 31 0 0 06 Dec 2023
PointMoment:Mixed-Moment-based Self-Supervised Representation Learning for 3D Point Clouds Xin Cao Xinxin Han Yifan Wang Mengna Yang Kang Li 3DPC 44 0 0 06 Dec 2023
PointJEM: Self-supervised Point Cloud Understanding for Reducing Feature Redundancy via Joint Entropy Maximization Xin Cao Huan Xia Xinxin Han Yifan Wang Kang Li Linzhi Su 3DPC 13 1 0 06 Dec 2023
DiffPMAE: Diffusion Masked Autoencoders for Point Cloud Reconstruction Yanlong Li Chamara Madarasingha Kanchana Thilakarathna 18 1 0 06 Dec 2023
GPT4Point: A Unified Framework for Point-Language Understanding and Generation Zhangyang Qi Ye Fang Zeyi Sun Xiaoyang Wu Tong Wu Jiaqi Wang Dahua Lin Hengshuang Zhao MLLM 71 35 0 05 Dec 2023
Improving Normalization with the James-Stein Estimator Seyedalireza Khoshsirat Chandra Kambhamettu 18 5 0 01 Dec 2023
MV-CLIP: Multi-View CLIP for Zero-shot 3D Shape Recognition Dan Song Xinwei Fu Weizhi Nie Wenhui Li Lanjun Wang You Yang Anan Liu VLM 29 6 0 30 Nov 2023
ViT-Lens: Towards Omni-modal Representations Weixian Lei Yixiao Ge Kun Yi Jianfeng Zhang Difei Gao Dylan Sun Yuying Ge Ying Shan Mike Zheng Shou 21 18 0 27 Nov 2023
MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers Yawar Siddiqui A. Alliegro Alexey Artemov Tatiana Tommasi Daniele Sirigatti Vladislav Rosov Angela Dai Matthias Nießner 20 111 0 27 Nov 2023
Visual Programming for Zero-shot Open-Vocabulary 3D Visual Grounding Zhihao Yuan Jinke Ren Chun-Mei Feng Hengshuang Zhao Shuguang Cui Zhen Li 28 26 0 26 Nov 2023
Point Cloud Pre-training with Diffusion Models Xiao Zheng Xiaoshui Huang Guofeng Mei Yuenan Hou Zhaoyang Lyu Bo Dai Wanli Ouyang Yongshun Gong 19 19 0 25 Nov 2023
GRJointNET: Synergistic Completion and Part Segmentation on 3D Incomplete Point Clouds Yigit Gürses Melisa Taspinar Mahmut Yurt Sedat Özer 34 1 0 23 Nov 2023
An Embodied Generalist Agent in 3D World Jiangyong Huang Silong Yong Xiaojian Ma Xiongkun Linghu Puhao Li Yan Wang Qing Li Song-Chun Zhu Baoxiong Jia Siyuan Huang LM&Ro 31 134 0 18 Nov 2023
Point Cloud Self-supervised Learning via 3D to Multi-view Masked Autoencoder Zhimin Chen Yingwei Li Longlong Jing Liang Yang Bing Li 3DPC 31 9 0 17 Nov 2023
PRED: Pre-training via Semantic Rendering on LiDAR Point Clouds Hao-Yu Yang Haiyang Wang Di Dai Liwei Wang 3DPC 13 4 0 08 Nov 2023
OmniVec: Learning robust representations with cross modal sharing Siddharth Srivastava Gaurav Sharma SSL 21 64 0 07 Nov 2023
Octavius: Mitigating Task Interference in MLLMs via LoRA-MoE Zeren Chen Ziqin Wang Zhen Wang Huayang Liu Zhen-fei Yin Si Liu Lu Sheng Wanli Ouyang Yu Qiao Jing Shao MoE 20 7 0 05 Nov 2023
Deep Learning-based 3D Point Cloud Classification: A Systematic Survey and Outlook Huang Zhang Changshuo Wang Shengwei Tian Baoli Lu Liping Zhang X. Ning Xiao Bai 3DPC 30 102 0 05 Nov 2023
Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-training Yipeng Gao Zeyu Wang Wei-Shi Zheng Cihang Xie Yuyin Zhou 3DPC 24 8 0 03 Nov 2023
Three Pillars improving Vision Foundation Model Distillation for Lidar Gilles Puy Spyros Gidaris Alexandre Boulch Oriane Siméoni Corentin Sautier Patrick Pérez Andrei Bursuc Renaud Marlet 97 18 0 26 Oct 2023
BEVContrast: Self-Supervision in BEV Space for Automotive Lidar Point Clouds Corentin Sautier Gilles Puy Alexandre Boulch Renaud Marlet Vincent Lepetit 3DPC 18 15 0 26 Oct 2023
Bridging The Gaps Between Token Pruning and Full Pre-training via Masked Fine-tuning Fengyuan Shi Limin Wang ViT 24 0 0 26 Oct 2023
General Point Model with Autoencoding and Autoregressive Zhe Li Zhangyang Gao Cheng Tan Stan Z. Li Laurence T. Yang AI4CE 3DPC 22 4 0 25 Oct 2023
Pre-Training LiDAR-Based 3D Object Detectors Through Colorization Tai-Yu Pan Chenyang Ma Tianle Chen Cheng Perng Phoo Katie Z Luo Yurong You Mark E. Campbell Kilian Q. Weinberger B. Hariharan Wei-Lun Chao 3DPC 25 4 0 23 Oct 2023
Frozen Transformers in Language Models Are Effective Visual Encoder Layers Ziqi Pang Ziyang Xie Yunze Man Yu-xiong Wang 47 25 0 19 Oct 2023
JM3D & JM3D-LLM: Elevating 3D Understanding with Joint Multi-modal Cues Jiayi Ji Haowei Wang Changli Wu Yiwei Ma Xiaoshuai Sun Rongrong Ji 41 1 0 14 Oct 2023
UniPAD: A Universal Pre-training Paradigm for Autonomous Driving Honghui Yang Sha Zhang Di Huang Xiaoyang Wu Haoyi Zhu ... Hengshuang Zhao Qibo Qiu Binbin Lin Xiaofei He Wanli Ouyang SSL 30 44 0 12 Oct 2023
PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm Haoyi Zhu Honghui Yang Xiaoyang Wu Di Huang Sha Zhang ... Hengshuang Zhao Chunhua Shen Yu Qiao Tong He Wanli Ouyang SSL 71 43 0 12 Oct 2023
Uni3D: Exploring Unified 3D Representation at Scale Junsheng Zhou Jinsheng Wang Baorui Ma Yu-Shen Liu Tiejun Huang Xinlong Wang 32 87 0 10 Oct 2023
OpenPatch: a 3D patchwork for Out-Of-Distribution detection Paolo Rabino A. Alliegro Francesco Cappio Borlino Tatiana Tommasi 3DPC 19 1 0 05 Oct 2023
CSI: Enhancing the Robustness of 3D Point Cloud Recognition against Corruption Zhuoyuan Wu Jiachen Sun Chaowei Xiao 3DPC 36 1 0 05 Oct 2023
Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models Yiwen Tang Ivan Tang Ray Gu Dong Wang Eric Zhang Bin Zhao Xuelong Li 3DPC 24 19 0 04 Oct 2023
Regress Before Construct: Regress Autoencoder for Point Cloud Self-supervised Learning Yang Liu C. L. P. Chen Can Wang Xulin King Mengyuan Liu 3DPC 27 7 0 25 Sep 2023
M $^3$ CS: Multi-Target Masked Point Modeling with Learnable Codebook and Siamese Decoders Qibo Qiu Honghui Yang Wenxiao Wang Shun Zhang Haiming Gao Haochao Ying Wei Hua Xiaofei He 3DPC 32 0 0 23 Sep 2023
Real3D-AD: A Dataset of Point Cloud Anomaly Detection Jiaqi Liu Guoyang Xie Rui Chen Xinpeng Li Jinbao Wang Yong-Jin Liu Chengjie Wang Feng Zheng 30 40 0 23 Sep 2023
Sample-adaptive Augmentation for Point Cloud Recognition Against Real-world Corruptions Jie Wang Lihe Ding Tingfa Xu Shaocong Dong Xinli Xu Long Bai Jianan Li 3DPC 33 5 0 19 Sep 2023
RMP: A Random Mask Pretrain Framework for Motion Prediction Yi Yang Qingwen Zhang Thomas Gilles Nazre Batool John Folkesson 48 5 0 16 Sep 2023
SculptBot: Pre-Trained Models for 3D Deformable Object Manipulation Alison Bartsch Charlotte Avra A. Farimani 3DPC AI4CE 19 9 0 15 Sep 2023
Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objects Chuanruo Ning Ruihai Wu Haoran Lu Kaichun Mo Hao Dong 13 32 0 14 Sep 2023
$360$^\circ$ from a Single Camera: A Few-Shot Approach for LiDAR Segmentation$ 360 $^\circ$ from a Single Camera: A Few-Shot Approach for LiDAR Segmentation Laurenz Reichardt Nikolas Ebert Oliver Wasenmüller 3DPC 38 10 0 12 Sep 2023
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following Ziyu Guo Renrui Zhang Xiangyang Zhu Yiwen Tang Xianzheng Ma ... Ke Chen Peng Gao Xianzhi Li Hongsheng Li Pheng-Ann Heng MLLM 27 125 0 01 Sep 2023
PointLLM: Empowering Large Language Models to Understand Point Clouds Runsen Xu Xiaolong Wang Tai Wang Yilun Chen Jiangmiao Pang Dahua Lin MLLM 53 149 0 31 Aug 2023
ViT-Lens: Initiating Omni-Modal Exploration through 3D Insights Weixian Lei Yixiao Ge Jianfeng Zhang Dylan Sun Kun Yi Ying Shan Mike Zheng Shou 25 1 0 20 Aug 2023
Forecast-MAE: Self-supervised Pre-training for Motion Forecasting with Masked Autoencoders Jie-Zhi Cheng Xiaodong Mei Ming-Yu Liu 12 55 0 19 Aug 2023
Invariant Training 2D-3D Joint Hard Samples for Few-Shot Point Cloud Recognition Xuanyu Yi Jiajun Deng Qianru Sun Xiansheng Hua J. Lim Hanwang Zhang 3DPC 13 14 0 18 Aug 2023
Masked Spatio-Temporal Structure Prediction for Self-supervised Learning on Point Cloud Videos Zhiqiang Shen Xiaoxiao Sheng Hehe Fan Longguang Wang Y. Guo Qiong Liu Hao-Kai Wen Xiaoping Zhou 3DPC 15 14 0 18 Aug 2023
Auxiliary Tasks Benefit 3D Skeleton-based Human Motion Prediction Chenxin Xu R. Tan Yuhong Tan Siheng Chen Xinchao Wang Yanfeng Wang 3DH 43 20 0 17 Aug 2023