Deep Mutual Learning

1 June 2017

Ying Zhang

Tao Xiang

Timothy M. Hospedales

Huchuan Lu

FedML

ArXiv PDF HTML

Papers citing "Deep Mutual Learning"

50 / 710 papers shown

Title
Federated Learning on Non-IID Data: A Survey Hangyu Zhu Jinjin Xu Shiqing Liu Yaochu Jin OOD FedML 39 774 0 12 Jun 2021
BERT Learns to Teach: Knowledge Distillation with Meta Learning Wangchunshu Zhou Canwen Xu Julian McAuley 36 87 0 08 Jun 2021
Multi-Target Domain Adaptation with Collaborative Consistency Learning Takashi Isobe Xu Jia Shuaijun Chen Jianzhong He Yongjie Shi Jian-zhuo Liu Huchuan Lu Shengjin Wang 35 85 0 07 Jun 2021
Not All Knowledge Is Created Equal: Mutual Distillation of Confident Knowledge Ziyun Li Xinshao Wang Diane Hu N. Robertson David Clifton Christoph Meinel Haojin Yang 9 10 0 02 Jun 2021
Multi-task fully convolutional network for tree species mapping in dense forests using small training hyperspectral data L. E. L. Rosa Camile Sothe R. Feitosa C. Almeida M. B. Schimalski Dario Augusto Borges Oliveira 18 42 0 01 Jun 2021
Improving Tree-Structured Decoder Training for Code Generation via Mutual Learning Binbin Xie Jinsong Su Yubin Ge Xiang-Yang Li Jianwei Cui Junfeng Yao Bin Wang 16 27 0 31 May 2021
Deep Domain Generalization with Feature-norm Network Mohammad Mahfujur Rahman Clinton Fookes Sridha Sridharan OOD 25 3 0 28 Apr 2021
Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Network Seunghyun Lee B. Song 21 6 0 28 Apr 2021
Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification Yixiao Ge Xiao Zhang Ching Lam Choi Ka Chun Cheung Peipei Zhao Feng Zhu Xiaogang Wang Rui Zhao Hongsheng Li FedML UQCV 146 25 0 27 Apr 2021
Mutual Contrastive Learning for Visual Representation Learning Chuanguang Yang Zhulin An Linhang Cai Yongjun Xu VLM SSL 108 75 0 26 Apr 2021
Distill on the Go: Online knowledge distillation in self-supervised learning Prashant Shivaram Bhat Elahe Arani Bahram Zonooz SSL 27 28 0 20 Apr 2021
Annealing Knowledge Distillation A. Jafari Mehdi Rezagholizadeh Pranav Sharma A. Ghodsi 23 77 0 14 Apr 2021
Pose Invariant Person Re-Identification using Robust Pose-transformation GAN Arnab Karmakar Deepak Mishra 24 4 0 11 Apr 2021
Learning from 2D: Contrastive Pixel-to-Point Knowledge Transfer for 3D Pretraining Yueh-Cheng Liu Yu-Kai Huang HungYueh Chiang Hung-Ting Su Zhe-Yu Liu Chin-Tang Chen Ching-Yu Tseng Winston H. Hsu 3DPC 25 35 0 10 Apr 2021
MRI-based Alzheimer's disease prediction via distilling the knowledge in multi-modal data Hao Guan Chaoyue Wang Dacheng Tao 24 30 0 08 Apr 2021
Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification Xudong Tian Zhizhong Zhang Shaohui Lin Yanyun Qu Yuan Xie Lizhuang Ma 27 109 0 07 Apr 2021
Weakly supervised segmentation with cross-modality equivariant constraints Gaurav Patel Jose Dolz SSL 40 47 0 06 Apr 2021
SIMPLE: SIngle-network with Mimicking and Point Learning for Bottom-up Human Pose Estimation Jiabin Zhang Zheng Zhu Jiwen Lu Junjie Huang Guan Huang Jie Zhou 3DH 36 14 0 06 Apr 2021
Model Compression for Dynamic Forecast Combination Vítor Cerqueira Luís Torgo Carlos Soares Albert Bifet AI4TS AI4CE 23 4 0 05 Apr 2021
Federated Few-Shot Learning with Adversarial Learning Chenyou Fan Jianwei Huang FedML 26 29 0 01 Apr 2021
Decentralized and Model-Free Federated Learning: Consensus-Based Distillation in Function Space Akihito Taya Takayuki Nishio M. Morikura Koji Yamamoto FedML 31 20 0 01 Apr 2021
Unsupervised Domain Expansion for Visual Categorization Jie Wang Kaibin Tian Dayong Ding Gang Yang Xirong Li 12 8 0 01 Apr 2021
Adaptive Boosting for Domain Adaptation: Towards Robust Predictions in Scene Segmentation Zhedong Zheng Yi Yang 25 29 0 29 Mar 2021
Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization Xin Jin Tianyu He Kecheng Zheng Zhiheng Yin Xu Shen Zhen Huang Ruoyu Feng Jianqiang Huang Xiansheng Hua Zhibo Chen CVBM 24 126 0 29 Mar 2021
Deep Ensemble Collaborative Learning by using Knowledge-transfer Graph for Fine-grained Object Classification Naoki Okamoto Soma Minami Tsubasa Hirakawa Takayoshi Yamashita H. Fujiyoshi FedML 21 2 0 27 Mar 2021
Distilling a Powerful Student Model via Online Knowledge Distillation Shaojie Li Mingbao Lin Yan Wang Yongjian Wu Yonghong Tian Ling Shao Rongrong Ji FedML 29 47 0 26 Mar 2021
Adversarial Imitation Learning with Trajectorial Augmentation and Correction Dafni Antotsiou C. Ciliberto Tae-Kyun Kim 27 10 0 25 Mar 2021
Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution Baoli Sun Xinchen Ye Baopu Li Haojie Li Zhihui Wang Rui Xu 11 45 0 24 Mar 2021
Student Network Learning via Evolutionary Knowledge Distillation Kangkai Zhang Chunhui Zhang Shikun Li Dan Zeng Shiming Ge 24 83 0 23 Mar 2021
Intra-Inter Camera Similarity for Unsupervised Person Re-Identification Shiyu Xuan Shiliang Zhang 43 173 0 22 Mar 2021
Self-Supervised Adaptation for Video Super-Resolution Jinsu Yoo Tae Hyun Kim 22 1 0 18 Mar 2021
Modulating Localization and Classification for Harmonized Object Detection Taiheng Zhang Qiaoyong Zhong Shiliang Pu Di Xie ObjD 28 1 0 16 Mar 2021
Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation Mingi Ji Seungjae Shin Seunghyun Hwang Gibeom Park Il-Chul Moon 13 120 0 15 Mar 2021
Dual-Task Mutual Learning for Semi-Supervised Medical Image Segmentation Yichi Zhang Jicong Zhang SSL 38 38 0 08 Mar 2021
Adaptive Multi-Teacher Multi-level Knowledge Distillation Yuang Liu Wei Zhang Jun Wang 28 157 0 06 Mar 2021
Semi-supervised Left Atrium Segmentation with Mutual Consistency Training Yicheng Wu Minfeng Xu Z. Ge Jianfei Cai Lei Zhang 18 207 0 04 Mar 2021
Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths Ximeng Sun Yikang Shen Chun-Fu Chen Naigang Wang Bowen Pan Bowen Pan Kailash Gopalakrishnan A. Oliva Rogerio Feris Kate Saenko MQ 27 4 0 02 Mar 2021
Distilling Knowledge via Intermediate Classifiers Aryan Asadian Amirali Salehi-Abari 38 1 0 28 Feb 2021
Siamese Labels Auxiliary Learning Wenrui Gan Zhulin Liu Chong Chen Tong Zhang 25 1 0 27 Feb 2021
Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation Shaoxiong Feng Xuancheng Ren Kan Li Xu Sun 24 11 0 22 Feb 2021
Synthesizing Irreproducibility in Deep Networks R. Snapp G. Shamir OOD 30 10 0 21 Feb 2021
End-to-End Automatic Speech Recognition with Deep Mutual Learning Ryo Masumura Mana Ihori Akihiko Takashima Tomohiro Tanaka Takanori Ashihara 27 5 0 16 Feb 2021
Learning Student-Friendly Teacher Networks for Knowledge Distillation D. Park Moonsu Cha C. Jeong Daesin Kim Bohyung Han 121 101 0 12 Feb 2021
Locally Adaptive Label Smoothing for Predictive Churn Dara Bahri Heinrich Jiang NoLa 43 8 0 09 Feb 2021
NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application Chuhan Wu Fangzhao Wu Yang Yu Tao Qi Yongfeng Huang Qi Liu VLM 19 44 0 09 Feb 2021
On the Reproducibility of Neural Network Predictions Srinadh Bhojanapalli Kimberly Wilber Andreas Veit A. S. Rawat Seungyeon Kim A. Menon Sanjiv Kumar 29 35 0 05 Feb 2021
FedH2L: Federated Learning with Model and Statistical Heterogeneity Yiying Li Wei Zhou Huaimin Wang Haibo Mi Timothy M. Hospedales FedML 68 29 0 27 Jan 2021
Collaborative Teacher-Student Learning via Multiple Knowledge Transfer Liyuan Sun Jianping Gou Baosheng Yu Lan Du Dacheng Tao 28 11 0 21 Jan 2021
Cross-modal Learning for Domain Adaptation in 3D Semantic Segmentation M. Jaritz Tuan-Hung Vu Raoul de Charette É. Wirbel P. Pérez 3DPC 13 47 0 18 Jan 2021
Unsupervised Noisy Tracklet Person Re-identification Minxian Li Xiatian Zhu S. Gong 21 1 0 16 Jan 2021