Deep Mutual Learning

1 June 2017

Ying Zhang

Tao Xiang

Timothy M. Hospedales

Huchuan Lu

FedML

ArXiv PDF HTML

Papers citing "Deep Mutual Learning"

50 / 710 papers shown

Title
Cross-Phase Mutual Learning Framework for Pulmonary Embolism Identification on Non-Contrast CT Scans Bizhe Bai Yan-Jie Zhou Yujian Hu Tony C. W. Mok Yi-lang Xiang Le Lu Hongkun Zhang Minfeng Xu 48 0 0 16 Jul 2024
Mutual Learning for Acoustic Matching and Dereverberation via Visual Scene-driven Diffusion Jian Ma Wenguan Wang Yi Yang Feng Zheng DiffM 62 0 0 15 Jul 2024
A Survey on Symbolic Knowledge Distillation of Large Language Models Kamal Acharya Alvaro Velasquez Haoze Song SyDa 44 5 0 12 Jul 2024
The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspective Zhen Qin Daoyuan Chen Wenhao Zhang Liuyi Yao Yilun Huang Bolin Ding Yaliang Li Shuiguang Deng 65 4 0 11 Jul 2024
Enhancing Low-Resource NMT with a Multilingual Encoder and Knowledge Distillation: A Case Study Aniruddha Roy Pretam Ray Ayush Maheshwari Sudeshna Sarkar Pawan Goyal 34 1 0 09 Jul 2024
CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community Yan Liu Bin Guo Nuo Li Yasan Ding Zhouyangzi Zhang Zhiwen Yu 50 1 0 09 Jul 2024
Federated Knowledge Transfer Fine-tuning Large Server Model with Resource-Constrained IoT Clients Shaoyuan Chen Linlin You Rui Liu Shuo Yu A. Abdelmoniem 69 0 0 07 Jul 2024
FedTSA: A Cluster-based Two-Stage Aggregation Method for Model-heterogeneous Federated Learning Boyu Fan Chenrui Wu Xiang Su Pan Hui FedML 58 2 0 06 Jul 2024
Understanding the Gains from Repeated Self-Distillation Divyansh Pareek Simon S. Du Sewoong Oh 42 4 0 05 Jul 2024
MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production Jian Ma Wenguan Wang Yi Yang Feng Zheng 45 1 0 04 Jul 2024
Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation Marco Mistretta Alberto Baldrati Marco Bertini Andrew D. Bagdanov VPVLM VLM 40 6 0 03 Jul 2024
Adaptive Modality Balanced Online Knowledge Distillation for Brain-Eye-Computer based Dim Object Detection Zixing Li Chao Yan Zhen Lan Xiaojia Xiang Han Zhou Jun Lai Dengqing Tang 46 0 0 02 Jul 2024
InFiConD: Interactive No-code Fine-tuning with Concept-based Knowledge Distillation Jinbin Huang Wenbin He Liang Gou Liu Ren Chris Bryan 55 0 0 25 Jun 2024
Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data Jiayi He Jiao Chen Qianmiao Liu Suyan Dai Jianhua Tang Dongpo Liu DiffM AI4CE 45 4 0 22 Jun 2024
Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions Laiqiao Qin Tianqing Zhu Wanlei Zhou Philip S. Yu 45 5 0 16 Jun 2024
Frequency-mix Knowledge Distillation for Fake Speech Detection Cunhang Fan Shunbo Dong Jun Xue Yujie Chen Jiangyan Yi Zhao Lv 38 0 0 14 Jun 2024
A Multi-Resolution Mutual Learning Network for Multi-Label ECG Classification Wei Huang Ning Wang Panpan Feng Haiyan Wang Zongmin Wang Bing Zhou 40 2 0 12 Jun 2024
Adaptive Teaching with Shared Classifier for Knowledge Distillation Jaeyeon Jang Young-Ik Kim Jisu Lim Hyeonseong Lee 26 0 0 12 Jun 2024
DistilDoc: Knowledge Distillation for Visually-Rich Document Applications Jordy Van Landeghem Subhajit Maity Ayan Banerjee Matthew Blaschko Marie-Francine Moens Josep Lladós Sanket Biswas 52 2 0 12 Jun 2024
Online Policy Distillation with Decision-Attention Xinqiang Yu Chuanguang Yang Chengqing Yu Libo Huang Zhulin An Yongjun Xu OffRL 44 0 0 08 Jun 2024
FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models Tao Fan Guoqiang Ma Yan Kang Hanlin Gu Yuanfeng Song Lixin Fan Kai Chen Qiang Yang 26 10 0 04 Jun 2024
Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Model Jinyin Chen Xiaoming Zhao Haibin Zheng Xiao Li Sheng Xiang Haifeng Guo AAML 30 3 0 01 Jun 2024
P4: Towards private, personalized, and Peer-to-Peer learning Mohammad Maheri S. Siby Sina Abdollahi Anastasia Borovykh Hamed Haddadi 26 0 0 27 May 2024
Rethinking Early-Fusion Strategies for Improved Multispectral Object Detection Xue Zhang Sixi Cao Fang Wang Runmin Zhang Zhe Wu Xiaohan Zhang Xiaokai Bai Hui-Liang Shen 30 1 0 25 May 2024
Recurrent Early Exits for Federated Learning with Heterogeneous Clients Royson Lee Javier Fernandez-Marques S. Hu Da Li Stefanos Laskaridis L. Dudziak Timothy M. Hospedales Ferenc Huszár Nicholas D. Lane 36 3 0 23 May 2024
Learning More Generalized Experts by Merging Experts in Mixture-of-Experts Sejik Park FedML CLL MoMe 40 5 0 19 May 2024
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors Chun-Yin Huang Kartik Srinivas Xin Zhang Xiaoxiao Li DD 65 6 0 19 May 2024
From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks Xue Geng Zhe Wang Chunyun Chen Qing Xu Kaixin Xu ... Zhenghua Chen M. Aly Jie Lin Min-man Wu Xiaoli Li 33 1 0 09 May 2024
The Curse of Diversity in Ensemble-Based Exploration Zhixuan Lin P. DÓro Evgenii Nikishin Rameswar Panda 52 1 0 07 May 2024
Robust Semi-supervised Learning via $f$ -Divergence and $α$ -Rényi Divergence Gholamali Aminian Amirhossien Bagheri Mahyar JafariNodeh Radmehr Karimian Mohammad Hossein Yassaee 40 0 0 01 May 2024
CrossMatch: Enhance Semi-Supervised Medical Image Segmentation with Perturbation Strategies and Knowledge Distillation Bin Zhao Chunshi Wang Shuxue Ding 48 2 0 01 May 2024
Deep Boosting Learning: A Brand-new Cooperative Approach for Image-Text Matching Haiwen Diao Ying Zhang Shang Gao Xiang Ruan Huchuan Lu 38 3 0 28 Apr 2024
CKD: Contrastive Knowledge Distillation from A Sample-wise Perspective Wencheng Zhu Xin Zhou Pengfei Zhu Yu Wang Qinghua Hu VLM 69 1 0 22 Apr 2024
Multi-Cell Decoder and Mutual Learning for Table Structure and Character Recognition T. Kawakatsu LMTD 35 2 0 20 Apr 2024
Dynamic Temperature Knowledge Distillation Yukang Wei Yu Bai 38 4 0 19 Apr 2024
CrimeAlarm: Towards Intensive Intent Dynamics in Fine-grained Crime Prediction Kaixi Hu Lin Li Qing Xie Xiaohui Tao Guandong Xu AI4TS 19 1 0 10 Apr 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 64 49 0 08 Apr 2024
Task Integration Distillation for Object Detectors Hai Su ZhenWen Jian Songsen Yu 46 1 0 02 Apr 2024
An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in Heterogeneous Federated Learning Jianqing Zhang Yang Liu Yang Hua Jian Cao 80 11 0 23 Mar 2024
Diversity-Aware Agnostic Ensemble of Sharpness Minimizers Anh-Vu Bui Vy Vo Tung Pham Dinh Q. Phung Trung Le FedML UQCV 37 1 0 19 Mar 2024
Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification Kaijie Ren Lei Zhang VLM 50 9 0 18 Mar 2024
PeerAiD: Improving Adversarial Distillation from a Specialized Peer Tutor Jaewon Jung Hongsun Jang Jaeyong Song Jinho Lee OOD AAML 184 4 0 11 Mar 2024
PromptKD: Unsupervised Prompt Distillation for Vision-Language Models Zheng Li Xiang Li Xinyi Fu Xing Zhang Weiqiang Wang Shuo Chen Jian Yang VLM 42 36 0 05 Mar 2024
Logit Standardization in Knowledge Distillation Shangquan Sun Wenqi Ren Jingzhi Li Rui Wang Xiaochun Cao 37 60 0 03 Mar 2024
T3DNet: Compressing Point Cloud Models for Lightweight 3D Recognition Zhiyuan Yang Yunjiao Zhou Lihua Xie Jianfei Yang 3DPC 40 1 0 29 Feb 2024
Leveraging Diverse Modeling Contexts with Collaborating Learning for Neural Machine Translation Yusheng Liao Yanfeng Wang Yu Wang AI4CE 35 0 0 28 Feb 2024
Towards Robust and Efficient Cloud-Edge Elastic Model Adaptation via Selective Entropy Distillation Yaofo Chen Shuaicheng Niu Yaowei Wang Shoukai Xu Hengjie Song Mingkui Tan 35 6 0 27 Feb 2024
Sinkhorn Distance Minimization for Knowledge Distillation Xiao Cui Yulei Qin Yuting Gao Enwei Zhang Zihan Xu Tong Wu Ke Li Xing Sun Wen-gang Zhou Houqiang Li 70 5 0 27 Feb 2024
Practical Insights into Knowledge Distillation for Pre-Trained Models Norah Alballa Marco Canini 48 2 0 22 Feb 2024
FedD2S: Personalized Data-Free Federated Knowledge Distillation Kawa Atapour S. J. Seyedmohammadi J. Abouei Arash Mohammadi Konstantinos N. Plataniotis FedML 37 2 0 16 Feb 2024