CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation

12 March 2025

Papers citing "CleverDistiller: Simple and Spatially Consistent Cross-modal Distillation"

44 / 44 papers shown

Title
Fine-grained Image-to-LiDAR Contrastive Distillation with Visual Foundation Models Yifan Zhang Junhui Hou 126 1 0 03 Jan 2025
S3PT: Scene Semantics and Structure Guided Clustering to Boost Self-Supervised Pre-Training for Autonomous Driving Maciej K. Wozniak Hariprasath Govindarajan Marvin Klingner Camille Maurice B Ravi Kiran S. Yogamani 3DPC 136 1 0 30 Oct 2024
Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Driving Lingdong Kong Xiang Xu Jiawei Ren Wenwei Zhang Liang Pan Kai-xiang Chen Wei Tsang Ooi Ziwei Liu 102 23 0 08 May 2024
DINO-Tracker: Taming DINO for Self-Supervised Point Tracking in a Single Video Narek Tumanyan Assaf Singer Shai Bagon Tali Dekel MQ 85 32 0 21 Mar 2024
An Empirical Study of the Generalization Ability of Lidar 3D Object Detectors to Unseen Domains George Eskandar Chongzhe Zhang Abhishek Kaushik Karim Guirguis Mohamed Sayed Bin Yang OOD 3DPC 101 9 0 27 Feb 2024
GPA-3D: Geometry-aware Prototype Alignment for Unsupervised Domain Adaptive 3D Object Detection from Point Clouds Ziyu Li Jingming Guo Tongtong Cao Bingbing Liu Wankou Yang 3DPC 81 10 0 16 Aug 2023
MS3D: Leveraging Multiple Detectors for Unsupervised Domain Adaptation in 3D Object Detection Darren Tsai J. S. Berrio Mao Shan E. Nebot Stewart Worrall 3DPC 105 11 0 05 Apr 2023
3D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Clouds Aoran Xiao Jiaxing Huang Weihao Xuan Ruijie Ren Kangcheng Liu Dayan Guan Abdulmotaleb El Saddik Shijian Lu Eric P. Xing 90 46 0 03 Apr 2023
CrOC: Cross-View Online Clustering for Dense Visual Representation Learning Thomas Stegmüller Tim Lebailly Behzad Bozorgtabar Tinne Tuytelaars Jean-Philippe Thiran 83 17 0 23 Mar 2023
Bi3D: Bi-domain Active Learning for Cross-domain 3D Object Detection Jiakang Yuan Bo Zhang Xiangchao Yan Tao Chen Botian Shi Yikang Li Yu Qiao 153 24 0 10 Mar 2023
Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning? Runpei Dong Zekun Qi Linfeng Zhang Junbo Zhang Jian‐Yuan Sun Zheng Ge Li Yi Kaisheng Ma ViT 3DPC 96 91 0 16 Dec 2022
Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoders Renrui Zhang Liuhui Wang Yu Qiao Peng Gao Hongsheng Li 3DPC 79 134 0 13 Dec 2022
BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection Zehui Chen Zhenyu Li Shiquan Zhang Liangji Fang Qinhong Jiang Feng Zhao 86 61 0 17 Nov 2022
LaserMix for Semi-Supervised LiDAR Semantic Segmentation Lingdong Kong Jiawei Ren Liang Pan Ziwei Liu 90 83 0 30 Jun 2022
Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Florian Bordes Pascal Vincent Armand Joulin Michael G. Rabbat Nicolas Ballas SSL 114 323 0 14 Apr 2022
DeiT III: Revenge of the ViT Hugo Touvron Matthieu Cord Hervé Jégou ViT 129 417 0 14 Apr 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data Corentin Sautier Gilles Puy Spyros Gidaris Alexandre Boulch Andrei Bursuc Renaud Marlet 3DPC 106 118 0 30 Mar 2022
ConDA: Unsupervised Domain Adaptation for LiDAR Segmentation via Regularized Domain Concatenation Lingdong Kong N. Quader Venice Erin Liong 84 49 0 30 Nov 2021
Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling Xumin Yu Lulu Tang Yongming Rao Tiejun Huang Jie Zhou Jiwen Lu 3DPC 142 685 0 29 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 477 7,827 0 11 Nov 2021
Mix3D: Out-of-Context Data Augmentation for 3D Scenes Alexey Nekrasov Jonas Schult Or Litany Bastian Leibe Francis Engelmann 3DPC 208 156 0 05 Oct 2021
SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generation Qiangeng Xu Yin Zhou Weiyue Wang C. Qi Drago Anguelov 3DPC 72 150 0 15 Aug 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 292 2,845 0 15 Jun 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 732 6,135 0 29 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 161 1,871 0 05 Apr 2021
ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection Jihan Yang Shaoshuai Shi Zhe Wang Hongsheng Li Xiaojuan Qi 3DPC 71 189 0 09 Mar 2021
Self-Supervised Pretraining of 3D Features on any Point-Cloud Zaiwei Zhang Rohit Girdhar Armand Joulin Ishan Misra 3DPC 191 272 0 07 Jan 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 389 6,805 0 23 Dec 2020
How Well Do Self-Supervised Models Transfer? Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 118 278 0 26 Nov 2020
RELLIS-3D Dataset: Data, Benchmarks and Analysis Peng-Tao Jiang Philip R. Osteen Maggie B. Wigness Srikanth Saripalli 3DV 82 221 0 17 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 682 41,483 0 22 Oct 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 274 4,101 0 17 Jun 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 139 976 0 11 May 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 505 3,444 0 09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 390 18,897 0 13 Feb 2020
Scalability in Perception for Autonomous Driving: Waymo Open Dataset Pei Sun Henrik Kretzschmar Xerxes Dotiwalla Aurelien Chouard Vijaysai Patnaik ... Shuyang Cheng Yu Zhang Jonathon Shlens Zhifeng Chen Dragomir Anguelov 147 2,907 0 10 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 216 12,136 0 13 Nov 2019
Self-labelling via simultaneous clustering and representation learning Yuki M. Asano Christian Rupprecht Andrea Vedaldi SSL 123 778 0 13 Nov 2019
4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks Chris Choy JunYoung Gwak Silvio Savarese 3DPC 170 1,796 0 18 Apr 2019
nuScenes: A multimodal dataset for autonomous driving Holger Caesar Varun Bankiti Alex H. Lang Sourabh Vora Venice Erin Liong Qiang Xu Anush Krishnan Yuxin Pan G. Baldan Oscar Beijbom 3DPC 301 5,786 0 26 Mar 2019
PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud Shaoshuai Shi Xiaogang Wang Hongsheng Li 3DPC 182 2,415 0 11 Dec 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 185 3,468 0 05 May 2018
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.3K 194,510 0 10 Dec 2015
ShapeNet: An Information-Rich 3D Model Repository Angel X. Chang Thomas Funkhouser Leonidas Guibas Pat Hanrahan Qi-Xing Huang ... Shuran Song Hao Su Jianxiong Xiao L. Yi Feng Yu 3DV 174 5,538 0 09 Dec 2015