Deep Mutual Learning

1 June 2017

Ying Zhang

Tao Xiang

Timothy M. Hospedales

Huchuan Lu

FedML

ArXiv PDF HTML

Papers citing "Deep Mutual Learning"

50 / 710 papers shown

Title
Filter Grafting for Deep Neural Networks Fanxu Meng Hao Cheng Ke Li Zhixin Xu Rongrong Ji Xing Sun Guangming Lu 30 33 0 15 Jan 2020
Lightweight 3D Human Pose Estimation Network Training Using Teacher-Student Learning D. Hwang Suntae Kim Nicolas Monet Hideki Koike Soonmin Bae 3DH 30 39 0 15 Jan 2020
Hydra: Preserving Ensemble Diversity for Model Distillation Linh-Tam Tran Bastiaan S. Veeling Kevin Roth J. Swiatkowski Joshua V. Dillon Jasper Snoek Stephan Mandt Tim Salimans Sebastian Nowozin Rodolphe Jenatton 29 58 0 14 Jan 2020
Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification Yixiao Ge Dapeng Chen Hongsheng Li 33 557 0 06 Jan 2020
Unsupervised Scene Adaptation with Memory Regularization in vivo Zhedong Zheng Yi Yang CLL 19 117 0 24 Dec 2019
DMCL: Distillation Multiple Choice Learning for Multimodal Action Recognition Nuno C. Garcia Sarah Adel Bargal Vitaly Ablavsky Pietro Morerio Vittorio Murino Stan Sclaroff 27 48 0 23 Dec 2019
Online Knowledge Distillation with Diverse Peers Defang Chen Jian-Ping Mei Can Wang Yan Feng Chun-Yen Chen FedML 36 297 0 01 Dec 2019
Towards Oracle Knowledge Distillation with Neural Architecture Search Minsoo Kang Jonghwan Mun Bohyung Han FedML 46 44 0 29 Nov 2019
xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentation M. Jaritz Tuan-Hung Vu Raoul de Charette É. Wirbel P. Pérez 3DPC 19 196 0 28 Nov 2019
QKD: Quantization-aware Knowledge Distillation Jangho Kim Yash Bhalgat Jinwon Lee Chirag I. Patel Nojun Kwak MQ 29 64 0 28 Nov 2019
MSD: Multi-Self-Distillation Learning via Multi-classifiers within Deep Neural Networks Yunteng Luan Hanyu Zhao Zhi-Xin Yang Yafei Dai 14 22 0 21 Nov 2019
Search to Distill: Pearls are Everywhere but not the Eyes Yu Liu Xuhui Jia Mingxing Tan Raviteja Vemulapalli Yukun Zhu Bradley Green Xiaogang Wang 30 68 0 20 Nov 2019
Label-similarity Curriculum Learning Ürün Dogan A. Deshmukh Marcin Machura Christian Igel 23 21 0 15 Nov 2019
Weakly Supervised Tracklet Person Re-Identification by Deep Feature-wise Mutual Learning Zhirui Chen Jianheng Li Weishi Zheng 19 2 0 31 Oct 2019
MOD: A Deep Mixture Model with Online Knowledge Distillation for Large Scale Video Temporal Concept Localization Rongcheng Lin Jing Xiao Jianping Fan 13 4 0 27 Oct 2019
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 52 1,035 0 23 Oct 2019
Domain Bridge for Unpaired Image-to-Image Translation and Unsupervised Domain Adaptation Fabio Pizzati Raoul de Charette Michela Zaccaria Pietro Cerri 29 74 0 23 Oct 2019
Exchangeable deep neural networks for set-to-set matching and learning Yuki Saito Takuma Nakamura Hirotaka Hachiya Kenji Fukumizu 16 2 0 22 Oct 2019
Cross-modal knowledge distillation for action recognition Fida Mohammad Thoker Juergen Gall 31 84 0 10 Oct 2019
On the Efficacy of Knowledge Distillation Ligang He Rui Mao 57 600 0 03 Oct 2019
Training convolutional neural networks with cheap convolutions and online distillation Jiao Xie Shaohui Lin Yichen Zhang Linkai Luo 27 12 0 28 Sep 2019
MutualNet: Adaptive ConvNet via Mutual Learning from Network Width and Resolution Taojiannan Yang Sijie Zhu Chong Chen Shen Yan Mi Zhang Andrew Willis OOD 25 74 0 27 Sep 2019
Revisiting Knowledge Distillation via Label Smoothing Regularization Li-xin Yuan Francis E. H. Tay Guilin Li Tao Wang Jiashi Feng 25 90 0 25 Sep 2019
FEED: Feature-level Ensemble for Knowledge Distillation Seonguk Park Nojun Kwak FedML 31 41 0 24 Sep 2019
Ensemble Knowledge Distillation for Learning Improved and Efficient Networks Umar Asif Jianbin Tang S. Harrer FedML 27 75 0 17 Sep 2019
Knowledge Transfer Graph for Deep Collaborative Learning Soma Minami Tsubasa Hirakawa Takayoshi Yamashita H. Fujiyoshi 30 9 0 10 Sep 2019
Extreme Low Resolution Activity Recognition with Confident Spatial-Temporal Attention Transfer Yucai Bai Qinglong Zou Xieyuanli Chen Lingxi Li Zhengming Ding Long Chen 30 3 0 09 Sep 2019
The Disruptions of 5G on Data-driven Technologies and Applications Dumitrel Loghin Shaofeng Cai Gang Chen Tien Tuan Anh Dinh Feiyi Fan ... Wei Wang Xiaokui Xiao Yang Yang Meihui Zhang Zhonghua Zhang 28 64 0 06 Sep 2019
Second-order Non-local Attention Networks for Person Re-identification Bryan (Ning) Xia Xia Yuan Gong Yizhe Zhang C. Poellabauer 3DPC 25 180 0 31 Aug 2019
Intra-Camera Supervised Person Re-Identification: A New Benchmark Xiangping Zhu Xiatian Zhu Minxian Li Vittorio Murino S. Gong 30 32 0 27 Aug 2019
Adaptive Regularization of Labels Qianggang Ding Sifan Wu Hao Sun Jiadong Guo Shutao Xia ODL 24 29 0 15 Aug 2019
Temporal Knowledge Propagation for Image-to-Video Person Re-identification Xinqian Gu Bingpeng Ma Hong Chang Shiguang Shan Xilin Chen 12 55 0 11 Aug 2019
Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations Bohan Zhuang Jing Liu Mingkui Tan Lingqiao Liu Ian Reid Chunhua Shen MQ 34 45 0 10 Aug 2019
Progressive Transfer Learning Zhengxu Yu Long Wei Zhongming Jin Jianqiang Huang Deng Cai Xiansheng Hua VLM 24 10 0 07 Aug 2019
Distilled Siamese Networks for Visual Tracking Jianbing Shen Yuanpei Liu Xingping Dong Xiankai Lu Fahad Shahbaz Khan Guosheng Lin 24 101 0 24 Jul 2019
Highlight Every Step: Knowledge Distillation via Collaborative Teaching Haoran Zhao Xin Sun Junyu Dong Changrui Chen Zihe Dong 27 57 0 23 Jul 2019
Universal Person Re-Identification Xu Lan Xiatian Zhu S. Gong OOD 16 3 0 22 Jul 2019
EnSyth: A Pruning Approach to Synthesis of Deep Learning Ensembles Besher Alhalabi M. Gaber S. Basurra 19 3 0 22 Jul 2019
Privileged Features Distillation at Taobao Recommendations Chen Xu Quan Li Junfeng Ge Jinyang Gao Xiaoyong Yang Changhua Pei Fei Sun Jian Wu Hanxiao Sun Wenwu Ou 21 67 0 11 Jul 2019
Wireless Federated Distillation for Distributed Edge Learning with Heterogeneous Data Jinhyun Ahn Osvaldo Simeone Joonhyuk Kang FedML 17 108 0 05 Jul 2019
Weight Normalization based Quantization for Deep Neural Network Compression Wenhong Cai Wu-Jun Li 24 14 0 01 Jul 2019
Cross-View Policy Learning for Street Navigation Ang Li Huiyi Hu Piotr Wojciech Mirowski Mehrdad Farajtabar 32 27 0 13 Jun 2019
Deeply-supervised Knowledge Synergy Dawei Sun Anbang Yao Aojun Zhou Hao Zhao 12 63 0 03 Jun 2019
Attention: A Big Surprise for Cross-Domain Person Re-Identification Haijun Liu Jian Cheng Shiguang Wang Wen Wang OOD 27 9 0 30 May 2019
Progressive Learning of Low-Precision Networks Zhengguang Zhou Wen-gang Zhou Xutao Lv Xuan Huang Xiaoyu Wang Houqiang Li MQ 44 11 0 28 May 2019
SCAN: A Scalable Neural Networks Framework Towards Compact and Efficient Models Linfeng Zhang Zhanhong Tan Jiebo Song Jingwei Chen Chenglong Bao Kaisheng Ma 24 71 0 27 May 2019
ShrinkTeaNet: Million-scale Lightweight Face Recognition via Shrinking Teacher-Student Networks C. Duong Khoa Luu Kha Gia Quach Ngan Le CVBM 23 39 0 25 May 2019
EnsembleNet: End-to-End Optimization of Multi-headed Models Hanhan Li Joe Yue-Hei Ng Apostol Natsev 20 16 0 24 May 2019
Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation Linfeng Zhang Jiebo Song Anni Gao Jingwei Chen Chenglong Bao Kaisheng Ma FedML 27 847 0 17 May 2019
Information asymmetry in KL-regularized RL Alexandre Galashov Siddhant M. Jayakumar Leonard Hasenclever Dhruva Tirumala Jonathan Richard Schwarz Guillaume Desjardins Wojciech M. Czarnecki Yee Whye Teh Razvan Pascanu N. Heess OffRL 25 102 0 03 May 2019