Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?

16 December 2022

Papers citing "Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?"

50 / 83 papers shown

Title
Hybrid-Emba3D: Geometry-Aware and Cross-Path Feature Hybrid Enhanced State Space Model for Point Cloud Classification Bin Liu Chunyang Wang Xuelian Liu Guan Xi Ge Zhang Ziteng Yao Mengxue Dong Mamba 14 0 0 16 May 2025
GAPrompt: Geometry-Aware Point Cloud Prompt for 3D Vision Model Zixiang Ai Zichen Liu Yuanhang Lei Zhenyu Cui Xu Zou Jiahuan Zhou 34 0 0 07 May 2025
PointLoRA: Low-Rank Adaptation with Token Selection for Point Cloud Learning Song Wang Xiaolu Liu Lingdong Kong Jianyun Xu Chunyong Hu Gongfan Fang Wentong Li Jianke Zhu Xinchao Wang 27 0 0 22 Apr 2025
MoST: Efficient Monarch Sparse Tuning for 3D Representation Learning Xu Han Yuan Tang Jinfeng Xu Xianzhi Li 51 0 0 24 Mar 2025
CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation Hariprasath Govindarajan Maciej K. Wozniak Marvin Klingner Camille Maurice B. R. Kiran S. Yogamani 55 0 0 12 Mar 2025
Spectral Informed Mamba for Robust Point Cloud Processing Ali Bahri Moslem Yazdanpanah Mehrdad Noori Sahar Dastani Milad Cheraghalikhani David Osowiechi G. A. V. Hakim Farzad Beizaee Ismail ben Ayed Christian Desrosiers Mamba 3DPC 71 0 0 06 Mar 2025
SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulation Zekun Qi Wenyao Zhang Yufei Ding Runpei Dong Xinqiang Yu ... Xin Jin Kaisheng Ma Zhizheng Zhang He Wang Li Yi LM&Ro 131 4 0 18 Feb 2025
KAE: Kolmogorov-Arnold Auto-Encoder for Representation Learning Fangchen Yu Ruilizhen Hu Yidong Lin Yuqi Ma Zhenghao Huang Wenye Li 27 0 0 03 Jan 2025
MICAS: Multi-grained In-Context Adaptive Sampling for 3D Point Cloud Processing Feifei Shao Ping Liu Zhao Wang Yawei Luo Hongwei Wang Jun Xiao 3DPC 71 0 0 25 Nov 2024
SAM-Guided Masked Token Prediction for 3D Scene Understanding Zhimin Chen Liang Yang Yingwei Li Longlong Jing Bing Li 32 3 0 16 Oct 2024
Block-to-Scene Pre-training for Point Cloud Hybrid-Domain Masked Autoencoders Yaohua Zha Tao Dai Yanzi Wang Hang Guo Taolin Zhang Zhihao Ouyang Chunlin Fan B. Chen Ke Chen Shu-Tao Xia 3DPC 30 1 0 13 Oct 2024
Pic@Point: Cross-Modal Learning by Local and Global Point-Picture Correspondence Vencia Herzog Stefan Suwelack 3DPC 29 0 0 12 Oct 2024
Parameter-Efficient Fine-Tuning in Spectral Domain for Point Cloud Learning Dingkang Liang Tianrui Feng Xin Zhou Yumeng Zhang Zhikang Zou Xiang Bai 28 5 0 10 Oct 2024
Triple Point Masking Jiaming Liu Linghe Kong Yue Wu Maoguo Gong Hao Li Qiguang Miao Wenping Ma Can Qin 3DPC 34 0 0 26 Sep 2024
3D-JEPA: A Joint Embedding Predictive Architecture for 3D Self-Supervised Representation Learning Naiwen Hu Haozhe Cheng Yifan Xie Shiqi Li Jihua Zhu AI4TS 3DV 29 0 0 24 Sep 2024
RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learning Kunming Su Qiuxia Wu Panpan Cai Xiaogang Zhu Xuequan Lu Zhiyong Wang Kun Hu 3DPC 34 2 0 31 Aug 2024
Positional Prompt Tuning for Efficient 3D Representation Learning Shaochen Zhang Zekun Qi Runpei Dong Xiuxiu Bai Xing Wei 39 4 0 21 Aug 2024
ShapeSplat: A Large-scale Dataset of Gaussian Splats and Their Self-Supervised Pretraining Qi Ma Yue Li Bin Ren N. Sebe E. Konukoglu Theo Gevers Luc Van Gool D. Paudel 3DGS 3DPC 38 10 0 20 Aug 2024
PCP-MAE: Learning to Predict Centers for Point Masked Autoencoders Xiangdong Zhang Shaofeng Zhang Junchi Yan 3DPC 38 2 0 16 Aug 2024
Multi-modal Relation Distillation for Unified 3D Representation Learning Huiqun Wang Yiping Bao Panwang Pan Zeming Li Xiao Liu Ruijie Yang Di Huang 52 0 0 19 Jul 2024
Adapt PointFormer: 3D Point Cloud Analysis via Adapting 2D Visual Transformers Mengke Li Da Li Guoqing Yang Yiu-ming Cheung Hui Huang 3DPC 48 2 0 18 Jul 2024
Pre-training Point Cloud Compact Model with Partial-aware Reconstruction Yaohua Zha Yanzi Wang Tao Dai Shu-Tao Xia 40 0 0 12 Jul 2024
Bringing Masked Autoencoders Explicit Contrastive Properties for Point Cloud Self-Supervised Learning Bin Ren Guofeng Mei D. Paudel Weijie Wang Yawei Li Mengyuan Liu Rita Cucchiara Luc Van Gool N. Sebe 3DPC 45 7 0 08 Jul 2024
Masked Generative Extractor for Synergistic Representation and 3D Generation of Point Clouds Hongliang Zeng Ping Zhang Fang Li Jiahua Wang Tingyu Ye Pengteng Guo 3DPC 39 0 0 25 Jun 2024
DreamBench++: A Human-Aligned Benchmark for Personalized Image Generation Yuang Peng Yuxin Cui Haomiao Tang Zekun Qi Runpei Dong Jing Bai Chunrui Han Zheng Ge Xiangyu Zhang Shu-Tao Xia EGVM 75 31 0 24 Jun 2024
Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision Minglei Li Peng Ye Yongqi Huang Lin Zhang Tao Chen Tong He Jiayuan Fan Wanli Ouyang MoE 34 4 0 05 Jun 2024
LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling Yaohua Zha Naiqi Li Yanzi Wang Tao Dai Hang Guo Bin Chen Zhi Wang Zhihao Ouyang Shu-Tao Xia Mamba 42 8 0 27 May 2024
GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3D Ali Bahri Moslem Yazdanpanah Mehrdad Noori Milad Cheraghalikhani G. A. V. Hakim David Osowiechi Farzad Beizaee Ismail Ben Ayed Christian Desrosiers 3DPC 78 1 0 20 May 2024
Robust Fine-tuning for Pre-trained 3D Point Cloud Models Zhibo Zhang Ximing Yang Weizhong Zhang Cheng Jin 3DPC 36 1 0 25 Apr 2024
Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model Xu Han Yuan Tang Zhaoxuan Wang Xianzhi Li 37 23 0 23 Apr 2024
Any2Point: Empowering Any-modality Large Models for Efficient 3D Understanding Yiwen Tang Ray Zhang Jiaming Liu Zoey Guo Dong Wang ... Bin Zhao Shanghang Zhang Peng Gao Hongsheng Li Xuelong Li 40 10 0 11 Apr 2024
SUGAR: Pre-training 3D Visual Representations for Robotics Shizhe Chen Ricardo Garcia Pinel Ivan Laptev Cordelia Schmid 47 14 0 01 Apr 2024
Dynamic Adapter Meets Prompt Tuning: Parameter-Efficient Transfer Learning for Point Cloud Analysis Xin Zhou Dingkang Liang Wei Xu Xingkui Zhu Yihan Xu Zhikang Zou Xiang Bai 24 26 0 03 Mar 2024
ShapeLLM: Universal 3D Object Understanding for Embodied Interaction Zekun Qi Runpei Dong Shaochen Zhang Haoran Geng Chunrui Han Zheng Ge Li Yi Kaisheng Ma 41 51 0 27 Feb 2024
Parameter-efficient Prompt Learning for 3D Point Cloud Understanding Hongyu Sun Yongcai Wang Wang Chen Haoran Deng Deying Li VPVLM 49 5 0 24 Feb 2024
PointMamba: A Simple State Space Model for Point Cloud Analysis Dingkang Liang Xin Zhou Wei Xu Xingkui Zhu Zhikang Zou Xiaoqing Ye Xinyu Wang Xiang Bai 89 91 0 16 Feb 2024
Masked Modeling for Self-supervised Representation Learning on Vision and Beyond Siyuan Li Luyuan Zhang Zedong Wang Di Wu Lirong Wu ... Jun-Xiong Xia Cheng Tan Yang Liu Baigui Sun Stan Z. Li SSL 36 14 0 31 Dec 2023
FILP-3D: Enhancing 3D Few-shot Class-incremental Learning with Pre-trained Vision-Language Models Wan Xu Tianyu Huang Tianyu Qu Guanglei Yang Yiwen Guo Wangmeng Zuo 21 0 0 28 Dec 2023
Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoders Yaohua Zha Huizhen Ji Jinmin Li Rongsheng Li Tao Dai Bin Chen Zhi Wang Shu-Tao Xia 3DPC 27 23 0 17 Dec 2023
3DAxiesPrompts: Unleashing the 3D Spatial Task Capabilities of GPT-4V Dingning Liu Xiaomeng Dong Renrui Zhang Xu Luo Peng Gao Xiaoshui Huang Yongshun Gong Zhihui Wang 34 10 0 15 Dec 2023
Chat-3D v2: Bridging 3D Scene and Large Language Models with Object Identifiers Haifeng Huang Zehan Wang Rongjie Huang Luping Liu Xize Cheng Yang Zhao Tao Jin Zhou Zhao 59 43 0 13 Dec 2023
Cross-BERT for Point Cloud Pretraining Xin Li Peng Li Zeyong Wei Zhe Zhu Mingqiang Wei Junhui Hou Liangliang Nan J. Qin H. Xie F. Wang SSL 3DPC 33 0 0 08 Dec 2023
Point Cloud Self-supervised Learning via 3D to Multi-view Masked Autoencoder Zhimin Chen Yingwei Li Longlong Jing Liang Yang Bing Li 3DPC 33 9 0 17 Nov 2023
Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-training Yipeng Gao Zeyu Wang Wei-Shi Zheng Cihang Xie Yuyin Zhou 3DPC 24 8 0 03 Nov 2023
Three Pillars improving Vision Foundation Model Distillation for Lidar Gilles Puy Spyros Gidaris Alexandre Boulch Oriane Siméoni Corentin Sautier Patrick Pérez Andrei Bursuc Renaud Marlet 101 18 0 26 Oct 2023
General Point Model with Autoencoding and Autoregressive Zhe Li Zhangyang Gao Cheng Tan Stan Z. Li Laurence T. Yang AI4CE 3DPC 22 4 0 25 Oct 2023
Point-PEFT: Parameter-Efficient Fine-Tuning for 3D Pre-trained Models Yiwen Tang Ivan Tang Ray Gu Dong Wang Eric Zhang Bin Zhao Xuelong Li 3DPC 24 19 0 04 Oct 2023
Regress Before Construct: Regress Autoencoder for Point Cloud Self-supervised Learning Yang Liu C. L. P. Chen Can Wang Xulin King Mengyuan Liu 3DPC 32 7 0 25 Sep 2023
DreamLLM: Synergistic Multimodal Comprehension and Creation Runpei Dong Chunrui Han Yuang Peng Zekun Qi Zheng Ge ... Hao-Ran Wei Xiangwen Kong Xiangyu Zhang Kaisheng Ma Li Yi MLLM 34 170 0 20 Sep 2023
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following Ziyu Guo Renrui Zhang Xiangyang Zhu Yiwen Tang Xianzheng Ma ... Ke Chen Peng Gao Xianzhi Li Hongsheng Li Pheng-Ann Heng MLLM 27 125 0 01 Sep 2023