The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation

13 June 2022

Hang Zhao

Papers citing "The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation"

21 / 21 papers shown

Title
Crossmodal Knowledge Distillation with WordNet-Relaxed Text Embeddings for Robust Image Classification Chenqi Guo Mengshuo Rong Qianli Feng Rongfan Feng Yinglong Ma VLM 68 0 0 31 Mar 2025
Towards Robust Multimodal Representation: A Unified Approach with Adaptive Experts and Alignment Nazanin Moradinasab S. Sengupta Jiebei Liu Sana Syed Donald Brown 60 0 0 12 Mar 2025
COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition Baiyu Chen Wilson Wongso Zechen Li Yonchanok Khaokaew Hao Xue Flora D. Salim 61 0 0 10 Mar 2025
X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing Xinyan Chen Jianfei Yang 45 1 0 14 Oct 2024
DisCoM-KD: Cross-Modal Knowledge Distillation via Disentanglement Representation and Adversarial Learning Dino Ienco C. Dantas 40 3 0 05 Aug 2024
Detached and Interactive Multimodal Learning Yunfeng Fan Wenchao Xu Yining Qi Junhong Liu Song Guo 46 3 0 28 Jul 2024
Learning Modality Knowledge Alignment for Cross-Modality Transfer Wenxuan Ma Shuang Li Lincan Cai Jingxuan Kang 39 1 0 27 Jun 2024
What Radio Waves Tell Us about Sleep Hao He Chao Li W. Ganglberger Kaileigh Gallagher Rumen Hristov Michail Ouroutzoglou Haoqi Sun Jimeng Sun Brandon Westover Dina Katabi 28 2 0 20 May 2024
A Generalization Theory of Cross-Modality Distillation with Contrastive Learning Hangyu Lin Chen Liu Chengming Xu Zhengqi Gao Yanwei Fu Yuan Yao VLM 38 0 0 06 May 2024
Improving Dialogue Agents by Decomposing One Global Explicit Annotation with Local Implicit Multimodal Feedback Dong Won Lee Hae Won Park Yoon Kim C. Breazeal Louis-Philippe Morency 32 0 0 17 Mar 2024
Enhancing Multimodal Unified Representations for Cross Modal Generalization Hai Huang Yan Xia Shengpeng Ji Shulei Wang Hanting Wang Minghui Fang Jieming Zhu Zhenhua Dong Sashuai Zhou Zhou Zhao 29 6 0 08 Mar 2024
TelME: Teacher-leading Multimodal Fusion Network for Emotion Recognition in Conversation Taeyang Yun Hyunkuk Lim Jeong-Hoon Lee Min Song 32 11 0 16 Jan 2024
Balanced Multi-modal Federated Learning via Cross-Modal Infiltration Yunfeng Fan Wenchao Xu Yining Qi Jiaqi Zhu Song Guo 26 0 0 31 Dec 2023
Embodied Multi-Modal Agent trained by an LLM from a Parallel TextWorld Yijun Yang Tianyi Zhou Kanxue Li Dapeng Tao Lusong Li Li Shen Xiaodong He Jing Jiang Yuhui Shi LLMAG LM&Ro 22 34 0 28 Nov 2023
Radio2Text: Streaming Speech Recognition Using mmWave Radio Signals Running Zhao Jiang-Tao Luca Yu Haiying Zhao Edith C. H. Ngai 24 4 0 16 Aug 2023
Vision-Language Dataset Distillation Xindi Wu Byron Zhang Zhiwei Deng Olga Russakovsky DD VLM 33 8 0 15 Aug 2023
Understanding and Constructing Latent Modality Structures in Multi-modal Representation Learning Qian Jiang Changyou Chen Han Zhao Liqun Chen Q. Ping S. D. Tran Yi Xu Belinda Zeng Trishul Chilimbi 49 38 0 10 Mar 2023
TinyMIM: An Empirical Study of Distilling MIM Pre-trained Models Sucheng Ren Fangyun Wei Zheng-Wei Zhang Han Hu 40 34 0 03 Jan 2023
Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions Paul Pu Liang Amir Zadeh Louis-Philippe Morency 18 60 0 07 Sep 2022
Omnivore: A Single Model for Many Visual Modalities Rohit Girdhar Mannat Singh Nikhil Ravi L. V. D. van der Maaten Armand Joulin Ishan Misra 223 225 0 20 Jan 2022
Feature Importance Ranking for Deep Learning Maksymilian Wojtas Ke Chen 139 116 0 18 Oct 2020