Deep Mutual Learning

1 June 2017

Ying Zhang

Tao Xiang

Timothy M. Hospedales

Huchuan Lu

FedML

ArXiv PDF HTML

Papers citing "Deep Mutual Learning"

50 / 710 papers shown

Title
DICE: Diversity in Deep Ensembles via Conditional Redundancy Adversarial Estimation Alexandre Ramé Matthieu Cord FedML 56 51 0 14 Jan 2021
Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals Gaole He Yunshi Lan Jing Jiang Wayne Xin Zhao Ji-Rong Wen 128 187 0 11 Jan 2021
Decentralized Federated Learning via Mutual Knowledge Transfer Chengxi Li Gang Li P. Varshney FedML 26 106 0 24 Dec 2020
Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road Ahead Maurizio Capra Beatrice Bussolino Alberto Marchisio Guido Masera Maurizio Martina Mohamed Bennai BDL 64 140 0 21 Dec 2020
Scenario-aware and Mutual-based approach for Multi-scenario Recommendation in E-Commerce Yuting Chen Yanshi Wang Yabo Ni Anxiang Zeng Lanfen Lin 52 24 0 16 Dec 2020
Unsupervised Image Segmentation using Mutual Mean-Teaching Zhichao Wu Lei Guo Hao Zhang Dan Xu 11 0 0 16 Dec 2020
Periocular Embedding Learning with Consistent Knowledge Distillation from Face Yoon Gyo Jung Jaewoo Park C. Low Jacky Chen Long Chai Leslie Ching Ow Tiong Andrew Beng Jin Teoh CVBM 21 2 0 12 Dec 2020
Robust Domain Randomised Reinforcement Learning through Peer-to-Peer Distillation Chenyang Zhao Timothy M. Hospedales OOD 33 16 0 09 Dec 2020
Cross-Layer Distillation with Semantic Calibration Defang Chen Jian-Ping Mei Yuan Zhang Can Wang Yan Feng Chun-Yen Chen FedML 45 288 0 06 Dec 2020
Data-Free Model Extraction Jean-Baptiste Truong Pratyush Maini R. Walls Nicolas Papernot MIACV 15 181 0 30 Nov 2020
KD-Lib: A PyTorch library for Knowledge Distillation, Pruning and Quantization Het Shah Avishree Khare Neelay Shah Khizir Siddiqui MQ 18 6 0 30 Nov 2020
Towards Better Accuracy-efficiency Trade-offs: Divide and Co-training Shuai Zhao Liguang Zhou Wenxiao Wang D. Cai Tin Lun Lam Yangsheng Xu 32 31 0 30 Nov 2020
A Selective Survey on Versatile Knowledge Distillation Paradigm for Neural Network Models J. Ku Jihun Oh Youngyoon Lee Gaurav Pooniwala Sangjeong Lee 23 3 0 30 Nov 2020
Channel-wise Knowledge Distillation for Dense Prediction Changyong Shu Yifan Liu Jianfei Gao Zheng Yan Chunhua Shen 33 257 0 26 Nov 2020
Digging Deeper into CRNN Model in Chinese Text Images Recognition Kunhong Yu Yuze Zhang 14 1 0 17 Nov 2020
Online Ensemble Model Compression using Knowledge Distillation Devesh Walawalkar Zhiqiang Shen Marios Savvides 19 51 0 15 Nov 2020
Improving RNN Transducer Based ASR with Auxiliary Tasks Chunxi Liu Frank Zhang Duc Le Suyoun Kim Yatharth Saraf Geoffrey Zweig 31 49 0 05 Nov 2020
Mutual Modality Learning for Video Action Classification Stepan Alekseevich Komkov Maksim Dzabraev Aleksandr Petiushko 27 9 0 04 Nov 2020
Channel Planting for Deep Neural Networks using Knowledge Distillation Kakeru Mitsuno Yuichiro Nomura Takio Kurita 36 2 0 04 Nov 2020
Layer-Wise Multi-View Learning for Neural Machine Translation Qiang Wang Changliang Li Yue Zhang Tong Xiao Jingbo Zhu 6 3 0 03 Nov 2020
Smooth activations and reproducibility in deep networks G. Shamir Dong Lin Lorenzo Coviello 22 22 0 20 Oct 2020
Anti-Distillation: Improving reproducibility of deep networks G. Shamir Lorenzo Coviello 48 20 0 19 Oct 2020
Locally Linear Region Knowledge Distillation Xiang Deng Zhongfei Zhang Zhang 25 0 0 09 Oct 2020
Be Your Own Best Competitor! Multi-Branched Adversarial Knowledge Transfer Mahdi Ghorbani Fahimeh Fooladgar S. Kasaei AAML 39 0 0 09 Oct 2020
A Closer Look at Codistillation for Distributed Training Shagun Sodhani Olivier Delalleau Mahmoud Assran Koustuv Sinha Nicolas Ballas Michael G. Rabbat 27 8 0 06 Oct 2020
Towards Cross-modality Medical Image Segmentation with Online Mutual Knowledge Distillation Kang Li Lequan Yu Shujun Wang Pheng-Ann Heng 36 103 0 04 Oct 2020
Unsupervised Shadow Removal Using Target Consistency Generative Adversarial Network Chao Tan Xin Feng GAN 19 9 0 03 Oct 2020
Online Knowledge Distillation via Multi-branch Diversity Enhancement Zheng Li Ying Huang Defang Chen Tianren Luo Ning Cai Zhigeng Pan 19 27 0 02 Oct 2020
Introspective Learning by Distilling Knowledge from Online Self-explanation Jindong Gu Zhiliang Wu Volker Tresp 25 3 0 19 Sep 2020
Densely Guided Knowledge Distillation using Multiple Teacher Assistants Wonchul Son Jaemin Na Junyong Choi Wonjun Hwang 27 111 0 18 Sep 2020
S2SD: Simultaneous Similarity-based Self-Distillation for Deep Metric Learning Karsten Roth Timo Milbich Bjorn Ommer Joseph Paul Cohen Marzyeh Ghassemi FedML 28 17 0 17 Sep 2020
Noisy Concurrent Training for Efficient Learning under Label Noise F. Sarfraz Elahe Arani Bahram Zonooz NoLa 17 21 0 17 Sep 2020
Collaborative Group Learning Shaoxiong Feng Hongshen Chen Xuancheng Ren Zhuoye Ding Kan Li Xu Sun 20 7 0 16 Sep 2020
SSKD: Self-Supervised Knowledge Distillation for Cross Domain Adaptive Person Re-Identification Junhui Yin Jiayan Qiu Siqing Zhang Zhanyu Ma Jun Guo 21 5 0 13 Sep 2020
Extending Label Smoothing Regularization with Self-Knowledge Distillation Jiyue Wang Pei Zhang Wenjie Pang Jie Li 14 0 0 11 Sep 2020
Diversified Mutual Learning for Deep Metric Learning Wonpyo Park Wonjae Kim Kihyun You Minsu Cho FedML 36 6 0 09 Sep 2020
On the Orthogonality of Knowledge Distillation with Other Techniques: From an Ensemble Perspective Seonguk Park Kiyoon Yoo Nojun Kwak FedML 26 3 0 09 Sep 2020
Mutual Teaching for Graph Convolutional Networks Kun Zhan Chaoxi Niu SSL 30 32 0 02 Sep 2020
Imitation Privacy Xun Xian Xinran Wang Mingyi Hong Jie Ding R. Ghanadan 30 3 0 30 Aug 2020
MetaDistiller: Network Self-Boosting via Meta-Learned Top-Down Distillation Benlin Liu Yongming Rao Jiwen Lu Jie Zhou Cho-Jui Hsieh 22 37 0 27 Aug 2020
Learning to Learn in a Semi-Supervised Fashion Yun-Chun Chen Chao-Te Chou Y. Wang SSL 30 6 0 25 Aug 2020
Global-local Enhancement Network for NMFs-aware Sign Language Recognition Hezhen Hu Wen-gang Zhou Junfu Pu Houqiang Li SLR 27 51 0 24 Aug 2020
A Single Frame and Multi-Frame Joint Network for 360-degree Panorama Video Super-Resolution Hongying Liu Zhubo Ruan Chaowei Fang Peng Zhao Fanhua Shang Yuanyuan Liu Lijun Wang 24 17 0 24 Aug 2020
Knowledge Transfer via Dense Cross-Layer Mutual-Distillation Anbang Yao Dawei Sun 12 55 0 18 Aug 2020
Multi-organ Segmentation via Co-training Weight-averaged Models from Few-organ Datasets Rui Huang Yuanjie Zheng Zhiqiang Hu Shaoting Zhang Hongsheng Li 31 50 0 17 Aug 2020
Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Data Sohei Itahara Takayuki Nishio Yusuke Koda M. Morikura Koji Yamamoto FedML 25 251 0 14 Aug 2020
Compression of Deep Learning Models for Text: A Survey Manish Gupta Puneet Agrawal VLM MedIm AI4CE 22 115 0 12 Aug 2020
Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge Chaoyang He M. Annavaram A. Avestimehr FedML 35 23 0 28 Jul 2020
Resolution Switchable Networks for Runtime Efficient Image Recognition Yikai Wang F. Sun Duo Li Anbang Yao 36 25 0 19 Jul 2020
Multi-scale Interactive Network for Salient Object Detection Youwei Pang Xiaoqi Zhao Lihe Zhang Huchuan Lu ObjD 25 591 0 17 Jul 2020