v1v2 (latest)

Cross Modal Distillation for Supervision Transfer

2 July 2015

Saurabh Gupta

Judy Hoffman

Jitendra Malik

ArXiv (abs)PDF HTML Github (98★)

Papers citing "Cross Modal Distillation for Supervision Transfer"

50 / 183 papers shown

Title
A Cross Modal Knowledge Distillation & Data Augmentation Recipe for Improving Transcriptomics Representations through Morphological Features Ihab Bendidi Yassir El Mesbahi Alisandra K. Denton Karush Suri Kian Kenyon-Dean Auguste Genovesio Emmanuel Noutahi 22 0 0 27 May 2025
StructVPR++: Distill Structural and Semantic Knowledge with Weighting Samples for Visual Place Recognition Yanqing Shen Sanping Zhou Jingwen Fu Ke Xu Shitao Chen N. Zheng 234 0 0 09 Mar 2025
Wearable Accelerometer Foundation Models for Health via Knowledge Distillation Salar Abbaspourazad Anshuman Mishra Joseph D. Futoma Andrew C. Miller Ian Shapiro 187 0 0 15 Dec 2024
Source-Free Cross-Modal Knowledge Transfer by Unleashing the Potential of Task-Irrelevant Data Jinjin Zhu Yucheng Chen Lin Wang 86 2 0 10 Jan 2024
MAC: ModAlity Calibration for Object Detection Yutian Lei Jun Liu Dong Huang ObjD 51 1 0 14 Oct 2023
Dissecting RGB-D Learning for Improved Multi-modal Fusion Hao Chen Hao Zhou Yunshu Zhang Zheng Lin Yongjian Deng 127 1 0 19 Aug 2023
Teacher-Student Architecture for Knowledge Distillation: A Survey Chengming Hu Xuan Li Danyang Liu Haolun Wu Xi Chen Ju Wang Xue Liu 94 19 0 08 Aug 2023
A Dimensional Structure based Knowledge Distillation Method for Cross-Modal Learning Hui Xiong Hongwei Dong Jingyao Wang J. Yu Wen-jie Zhai Changwen Zheng Fanjiang Xu Gang Hua 72 1 0 28 Jun 2023
Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation Chuanguang Yang Xinqiang Yu Zhulin An Yongjun Xu VLM OffRL 204 27 0 19 Jun 2023
Robust Cross-Modal Knowledge Distillation for Unconstrained Videos Wenke Xia Xingjian Li Andong Deng Haoyi Xiong Dejing Dou Di Hu 74 5 0 16 Apr 2023
Geometric-aware Pretraining for Vision-centric 3D Object Detection Linyan Huang Huijie Wang J. Zeng Shengchuan Zhang Liujuan Cao Junchi Yan Hongyang Li 3DPC 150 9 0 06 Apr 2023
EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understanding Shuhan Tan Tushar Nagarajan Kristen Grauman 94 22 0 05 Jan 2023
StructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognition Yanqing Shen Sanping Zhopu Jingwen Fu Ke Xu Shi-tao Chen Nanning Zheng 130 21 0 02 Dec 2022
Distilling Knowledge from Self-Supervised Teacher by Embedding Graph Alignment Yuchen Ma Yanbei Chen Zeynep Akata 61 8 0 23 Nov 2022
Self-Supervised Learning with Multi-View Rendering for 3D Point Cloud Analysis Bach Tran Binh-Son Hua Anh Tran Minh Hoai 3DPC 128 7 0 28 Oct 2022
A Survey on Heterogeneous Federated Learning Dashan Gao Xin Yao Qian Yang FedML 101 64 0 10 Oct 2022
Distill the Image to Nowhere: Inversion Knowledge Distillation for Multimodal Machine Translation Ru Peng Yawen Zeng Jiaqi Zhao 78 18 0 10 Oct 2022
Membership Inference Attacks by Exploiting Loss Trajectory Yiyong Liu Zhengyu Zhao Michael Backes Yang Zhang 102 111 0 31 Aug 2022
2DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Clouds Xu Yan Jiantao Gao Chaoda Zheng Chao Zheng Ruimao Zhang Shenghui Cui Zhen Li 3DPC 189 222 0 10 Jul 2022
Complementary Bi-directional Feature Compression for Indoor 360° Semantic Segmentation with Self-distillation Zishuo Zheng Chunyu Lin Lang Nie K. Liao Zhijie Shen Yao Zhao MDE 107 13 0 06 Jul 2022
Improving Visual Grounding by Encouraging Consistent Gradient-based Explanations Ziyan Yang Kushal Kafle Franck Dernoncourt Vicente Ordónez Román VLM 104 25 0 30 Jun 2022
PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection Linfeng Zhang Runpei Dong Hung-Shuo Tai Kaisheng Ma 3DPC 151 50 0 23 May 2022
DSGN++: Exploiting Visual-Spatial Relation for Stereo-based 3D Detectors Yilun Chen Shijia Huang Shu Liu Bei Yu Jiaya Jia 3DPC 136 27 0 06 Apr 2022
Learning Audio-Video Modalities from Image Captions Arsha Nagrani Paul Hongsuck Seo Bryan Seybold Anja Hauth Santiago Manén Chen Sun Cordelia Schmid CLIP 93 86 0 01 Apr 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data Corentin Sautier Gilles Puy Spyros Gidaris Alexandre Boulch Andrei Bursuc Renaud Marlet 3DPC 110 118 0 30 Mar 2022
Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably) Yu Huang Junyang Lin Chang Zhou Hongxia Yang Longbo Huang 68 97 0 23 Mar 2022
Keyword localisation in untranscribed speech using visually grounded speech models Kayode Olaleye Dan Oneaţă Herman Kamper 63 7 0 02 Feb 2022
MonoDistill: Learning Spatial Features for Monocular 3D Object Detection Zhiyu Chong Xinzhu Ma Hong Zhang Yuxin Yue Haojie Li Zhihui Wang Wanli Ouyang 3DPC 177 103 0 26 Jan 2022
Cross-modal Contrastive Distillation for Instructional Activity Anticipation Zhengyuan Yang Jingen Liu Jing-ling Huang Xiaodong He Tao Mei Chenliang Xu Jiebo Luo 77 6 0 18 Jan 2022
Improving Human-Object Interaction Detection via Phrase Learning and Label Composition Zhimin Li Cheng Zou Yu Zhao Boxun Li Shengtao Zhong 72 38 0 14 Dec 2021
Total-Body Low-Dose CT Image Denoising using Prior Knowledge Transfer Technique with Contrastive Regularization Mechanism Min Fu Y. Duan Zhaoping Cheng Wenjian Qin Ying Wang Dong Liang Zhanli Hu 70 7 0 01 Dec 2021
NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenes Suhani Vora Noha Radwan Klaus Greff H. Meyer Kyle Genova Mehdi S. M. Sajjadi Etienne Pot Andrea Tagliasacchi Daniel Duckworth 166 127 0 25 Nov 2021
EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillation Lin Wang Yujeong Chae Sung-Hoon Yoon Tae-Kyun Kim Kuk-Jin Yoon 83 67 0 24 Nov 2021
Facial Anatomical Landmark Detection using Regularized Transfer Learning with Application to Fetal Alcohol Syndrome Recognition Zeyu Fu Jianbo Jiao M. Suttie J. A. Noble CVBM 62 9 0 12 Sep 2021
LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector Xiaoyang Guo Shaoshuai Shi Xiaogang Wang Hongsheng Li 3DPC 100 109 0 18 Aug 2021
Feature-Supervised Action Modality Transfer Fida Mohammad Thoker Cees G. M. Snoek 40 2 0 06 Aug 2021
Transferring Knowledge Distillation for Multilingual Social Event Detection Jiaqian Ren Hao Peng Lei Jiang Hongzhi Zhang Yongxin Tong Lihong Wang X. Bai Bo Wang Qiang Yang 88 12 0 06 Aug 2021
Unpaired cross-modality educed distillation (CMEDL) for medical image segmentation Jue Jiang A. Rimner Joseph O. Deasy Harini Veeraraghavan 103 20 0 16 Jul 2021
What Makes Multi-modal Learning Better than Single (Provably) Yu Huang Chenzhuang Du Zihui Xue Xuanyao Chen Hang Zhao Longbo Huang 104 270 0 08 Jun 2021
Unsupervised Domain Adaptation of Object Detectors: A Survey Poojan Oza Vishwanath A. Sindagi Vibashan Vs Vishal M. Patel OOD ObjD 119 184 0 27 May 2021
Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs Mohammad Malekzadeh Anastasia Borovykh Deniz Gündüz MIACV 87 42 0 25 May 2021
SBEVNet: End-to-End Deep Stereo Layout Estimation Divam Gupta Wei Pu Trenton Tabor J. Schneider 3DPC MDE 75 5 0 25 May 2021
Joint Face Image Restoration and Frontalization for Recognition X. Tu Jian-jun Zhao Qiankun Liu W. Ai G. Guo Zhifeng Li Wei Liu Jiashi Feng CVBM 102 55 0 12 May 2021
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning Yanbei Chen Yongqin Xian A. Sophia Koepke Ying Shan Zeynep Akata 149 83 0 22 Apr 2021
Ego-Exo: Transferring Visual Representations from Third-person to First-person Videos Yanghao Li Tushar Nagarajan Bo Xiong Kristen Grauman EgoV 122 94 0 16 Apr 2021
Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillation Jae-Won Cho Dong-Jin Kim Jinsoo Choi Yunjae Jung In So Kweon VLM 57 17 0 13 Apr 2021
Learning from 2D: Contrastive Pixel-to-Point Knowledge Transfer for 3D Pretraining Yueh-Cheng Liu Yu-Kai Huang HungYueh Chiang Hung-Ting Su Zhe-Yu Liu Chin-Tang Chen Ching-Yu Tseng Winston H. Hsu 3DPC 48 35 0 10 Apr 2021
Weakly supervised segmentation with cross-modality equivariant constraints Gaurav Patel Jose Dolz SSL 90 49 0 06 Apr 2021
3D-to-2D Distillation for Indoor Scene Parsing Zhengzhe Liu Xiaojuan Qi Chi-Wing Fu 85 59 0 06 Apr 2021
A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification Jong-Chyi Su Zezhou Cheng Subhransu Maji 99 57 0 01 Apr 2021