Deep Mutual Learning

1 June 2017

Ying Zhang

Tao Xiang

Timothy M. Hospedales

Huchuan Lu

FedML

ArXiv PDF HTML

Papers citing "Deep Mutual Learning"

50 / 710 papers shown

Title
Model Compression and Efficient Inference for Large Language Models: A Survey Wenxiao Wang Wei Chen Yicong Luo Yongliu Long Zhengkai Lin Liye Zhang Binbin Lin Deng Cai Xiaofei He MQ 43 48 0 15 Feb 2024
Predictive Churn with the Set of Good Models J. Watson-Daniels Flavio du Pin Calmon Alexander DÁmour Carol Xuan Long David C. Parkes Berk Ustun 88 7 0 12 Feb 2024
Two-Stage Multi-task Self-Supervised Learning for Medical Image Segmentation Binyan Hu •. A. K. Qin SSL 19 0 0 11 Feb 2024
Energy-based Domain-Adaptive Segmentation with Depth Guidance Jinjin Zhu Zhedong Hu Tae-Kyun Kim Lin Wang MDE 30 2 0 06 Feb 2024
DFML: Decentralized Federated Mutual Learning Yasser H. Khalil A. Estiri Mahdi Beitollahi Nader Asadi S. Hemati Xu Li Guojun Zhang Xi Chen 27 1 0 02 Feb 2024
Cooperative Knowledge Distillation: A Learner Agnostic Approach Michael J. Livanos Ian Davidson Stephen Wong 29 0 0 02 Feb 2024
Distillation Enhanced Time Series Forecasting Network with Momentum Contrastive Learning Haozhi Gao Qianqian Ren Jinbao Li AI4TS 29 2 0 31 Jan 2024
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts Zhitian Xie Yinger Zhang Chenyi Zhuang Qitao Shi Zhining Liu Jinjie Gu Guannan Zhang MoE 43 3 0 31 Jan 2024
Decentralized Gossip Mutual Learning (GML) for brain tumor segmentation on multi-parametric MRI Jingyun Chen Yading Yuan FedML 16 1 0 27 Jan 2024
P2Seg: Pointly-supervised Segmentation via Mutual Distillation Zipeng Wang Xuehui Yu Xumeng Han Wenwen Yu Zhixun Huang Jianbin Jiao Zhenjun Han 36 0 0 18 Jan 2024
$Multi-view Distillation based on Multi-modal Fusion for Few-shot Action Recognition(CLIP-$\mathrm{M^2}$DF)$ Multi-view Distillation based on Multi-modal Fusion for Few-shot Action Recognition(CLIP- $\mathrm{M^2}$ DF) Fei-Yu Guo YiKang Wang Han Qi WenPing Jin Li Zhu 32 2 0 16 Jan 2024
Mutual Distillation Learning For Person Re-Identification Huiyuan Fu Kuilong Cui Chuanming Wang Mengshi Qi Huadong Ma 40 0 0 12 Jan 2024
Decentralized Gossip Mutual Learning (GML) for automatic head and neck tumor segmentation Jingyun Chen Yading Yuan FedML 33 0 0 11 Jan 2024
FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heterogeneity in Federated Learning Jianqing Zhang Yang Liu Yang Hua Jian Cao FedML 68 39 0 06 Jan 2024
Semi-supervised learning via DQN for log anomaly detection Yingying He Xiaobing Pei Lihong Shen 36 1 0 06 Jan 2024
Neural Networks Against (and For) Self-Training: Classification with Small Labeled and Large Unlabeled Sets Payam Karisani 23 1 0 31 Dec 2023
One-Shot Multi-Rate Pruning of Graph Convolutional Networks H. Sahbi 33 0 0 29 Dec 2023
Convergence Visualizer of Decentralized Federated Distillation with Reduced Communication Costs Akihito Taya Yuuki Nishiyama K. Sezaki FedML 18 0 0 19 Dec 2023
Decoupled Knowledge with Ensemble Learning for Online Distillation Baitan Shao Ying Chen 26 0 0 18 Dec 2023
CR-SFP: Learning Consistent Representation for Soft Filter Pruning Jingyang Xiang Zhuangzhi Chen Jianbiao Mei Siqi Li Jun Chen Yong-Jin Liu 36 0 0 17 Dec 2023
RdimKD: Generic Distillation Paradigm by Dimensionality Reduction Yi Guo Yiqian He Xiaoyang Li Haotong Qin Van Tung Pham Yang Zhang Shouda Liu 51 1 0 14 Dec 2023
Cooperative Learning for Cost-Adaptive Inference Xingli Fang Richard M. Bradford Jung-Eun Kim 47 1 0 13 Dec 2023
ViLA: Efficient Video-Language Alignment for Video Question Answering Xijun Wang Junbang Liang Chun-Kai Wang Kenan Deng Yu Lou Ming-Chyuan Lin Shan Yang 40 13 0 13 Dec 2023
Dynamic Weighted Combiner for Mixed-Modal Image Retrieval Fuxiang Huang Lei Zhang Xiaowei Fu Suqi Song 39 9 0 11 Dec 2023
Improving Plasticity in Online Continual Learning via Collaborative Learning Maorong Wang Nicolas Michel Ling Xiao Toshihiko Yamasaki CLL 30 8 0 01 Dec 2023
SpliceMix: A Cross-scale and Semantic Blending Augmentation Strategy for Multi-label Image Classification Lei Wang Yibing Zhan Leilei Ma Dapeng Tao Liang Ding Chen Gong 34 1 0 26 Nov 2023
Choosing Wisely and Learning Deeply: Selective Cross-Modality Distillation via CLIP for Domain Generalization Jixuan Leng Yijiang Li Haohan Wang VLM 37 0 0 26 Nov 2023
Maximizing Discrimination Capability of Knowledge Distillation with Energy Function Seonghak Kim Gyeongdo Ham Suin Lee Donggon Jang Daeshik Kim 34 4 0 24 Nov 2023
Robustness-Reinforced Knowledge Distillation with Correlation Distance and Network Pruning Seonghak Kim Gyeongdo Ham Yucheol Cho Daeshik Kim 30 3 0 23 Nov 2023
ML-LMCL: Mutual Learning and Large-Margin Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding Xuxin Cheng Bowen Cao Qichen Ye Zhihong Zhu Hongxiang Li Yuexian Zou 32 26 0 19 Nov 2023
Robust Contrastive Learning With Theory Guarantee Ngoc N. Tran Lam C. Tran Hoang Phan Anh-Vu Bui Tung Pham Toan M. Tran Dinh Q. Phung Trung Le SSL NoLa 34 0 0 16 Nov 2023
Leveraging Foundation Models to Improve Lightweight Clients in Federated Learning Xidong Wu Wan-Yi Lin Devin Willmott Filipe Condessa Yufei Huang Zhenzhen Li Madan Ravi Ganesh FedML 47 4 0 14 Nov 2023
NDDepth: Normal-Distance Assisted Monocular Depth Estimation and Completion Shuwei Shao Zhongcai Pei Weihai Chen Peter C. Y. Chen Zhengguo Li 30 5 0 13 Nov 2023
SSL-DG: Rethinking and Fusing Semi-supervised Learning and Domain Generalization in Medical Image Segmentation Zanting Ye 24 2 0 05 Nov 2023
A Transformer-Based Model With Self-Distillation for Multimodal Emotion Recognition in Conversations Hui Ma Jian Wang Hongfei Lin Bo Zhang Yijia Zhang Bo Xu 28 40 0 31 Oct 2023
AMLNet: Adversarial Mutual Learning Neural Network for Non-AutoRegressive Multi-Horizon Time Series Forecasting Yang Lin AI4TS 28 0 0 30 Oct 2023
Understanding the Effects of Projectors in Knowledge Distillation Yudong Chen Sen Wang Jiajun Liu Xuwei Xu Frank de Hoog Brano Kusy Zi Huang 26 0 0 26 Oct 2023
Expression Syntax Information Bottleneck for Math Word Problems Jing Xiong Chengming Li Min Yang Xiping Hu Bin Hu 35 5 0 24 Oct 2023
Vision-Enhanced Semantic Entity Recognition in Document Images via Visually-Asymmetric Consistency Learning Hao Wang Xiahua Chen Rui-cang Wang Chenhui Chu 27 0 0 23 Oct 2023
Boosting Generalization with Adaptive Style Techniques for Fingerprint Liveness Detection Kexin Zhu Bo Lin Yang Qiu Adam Yule Yao Tang Jiajun Liang 21 0 0 20 Oct 2023
Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective Ming Zhong Chenxin An Weizhu Chen Jiawei Han Pengcheng He 31 9 0 17 Oct 2023
Bounding and Filling: A Fast and Flexible Framework for Image Captioning Zheng Ma Changxin Wang Bo Huang Zi-Yue Zhu Jianbing Zhang 31 1 0 15 Oct 2023
SiamAF: Learning Shared Information from ECG and PPG Signals for Robust Atrial Fibrillation Detection Zhicheng Guo C. Ding Duc H. Do Amit Shah Randall J Lee Xiao Hu Cynthia Rudin 13 2 0 13 Oct 2023
Distilling Efficient Vision Transformers from CNNs for Semantic Segmentation Xueye Zheng Yunhao Luo Pengyuan Zhou Lin Wang 35 14 0 11 Oct 2023
LumiNet: The Bright Side of Perceptual Knowledge Distillation Md. Ismail Hossain M. M. L. Elahi Sameera Ramasinghe A. Cheraghian Fuad Rahman Nabeel Mohammed Shafin Rahman 39 1 0 05 Oct 2023
Improving Knowledge Distillation with Teacher's Explanation S. Chowdhury Ben Liang A. Tizghadam Ilijc Albanese FAtt 19 0 0 04 Oct 2023
Noise-Tolerant Unsupervised Adapter for Vision-Language Models Eman Ali Dayan Guan Muhammad Haris Khan Abdulmotaleb Elsaddik VLM 24 0 0 26 Sep 2023
SPFL: A Self-purified Federated Learning Method Against Poisoning Attacks Zizhen Liu Weiyang He Chip-Hong Chang Jing Ye Huawei Li Xiaowei Li 34 4 0 19 Sep 2023
Real-Time Semantic Segmentation: A Brief Survey & Comparative Study in Remote Sensing Clifford Broni-Bediako Junshi Xia Naoto Yokoya 59 10 0 12 Sep 2023
Epi-Curriculum: Episodic Curriculum Learning for Low-Resource Domain Adaptation in Neural Machine Translation Keyu Chen Zhuang Di Mingchen Li J. M. Chang 35 3 0 06 Sep 2023