Deep Mutual Learning

1 June 2017

Ying Zhang

Tao Xiang

Timothy M. Hospedales

Huchuan Lu

FedML

ArXiv PDF HTML

Papers citing "Deep Mutual Learning"

50 / 710 papers shown

Title
Multi scale Feature Extraction and Fusion for Online Knowledge Distillation Panpan Zou Yinglei Teng Tao Niu 37 3 0 16 Jun 2022
PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR System Chenxia Li Weiwei Liu Ruoyu Guo Xiaoyue Yin Kaitao Jiang ... Lingfeng Zhu Baohua Lai Xiaoguang Hu Dianhai Yu Yanjun Ma 19 105 0 07 Jun 2022
Distilling Knowledge from Object Classification to Aesthetics Assessment Jingwen Hou Henghui Ding Weisi Lin Weide Liu Yuming Fang 24 36 0 02 Jun 2022
ORC: Network Group-based Knowledge Distillation using Online Role Change Jun-woo Choi Hyeon Cho Seockhwa Jeong Wonjun Hwang 27 3 0 01 Jun 2022
What Knowledge Gets Distilled in Knowledge Distillation? Utkarsh Ojha Yuheng Li Anirudh Sundara Rajan Yingyu Liang Yong Jae Lee FedML 29 18 0 31 May 2022
Parameter-Efficient and Student-Friendly Knowledge Distillation Jun Rao Xv Meng Liang Ding Shuhan Qi Dacheng Tao 42 46 0 28 May 2022
Region-aware Knowledge Distillation for Efficient Image-to-Image Translation Linfeng Zhang Xin Chen Runpei Dong Kaisheng Ma VLM 48 10 0 25 May 2022
StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learning Yihua Huang Yue He Yu-Jie Yuan Yu-Kun Lai Lin Gao 184 149 0 24 May 2022
PointDistiller: Structured Knowledge Distillation Towards Efficient and Compact 3D Detection Linfeng Zhang Runpei Dong Hung-Shuo Tai Kaisheng Ma 3DPC 72 47 0 23 May 2022
Learning Feature Fusion for Unsupervised Domain Adaptive Person Re-identification Jin Ding Xue Zhou 27 5 0 19 May 2022
Knowledge Distillation Meets Open-Set Semi-Supervised Learning Jing Yang Xiatian Zhu Adrian Bulat Brais Martínez Georgios Tzimiropoulos 40 8 0 13 May 2022
Spatial-Temporal Space Hand-in-Hand: Spatial-Temporal Video Super-Resolution via Cycle-Projected Mutual Learning Mengshun Hu Kui Jiang Liang Liao Jing Xiao Junjun Jiang Zheng Wang SupR 22 33 0 11 May 2022
DcnnGrasp: Towards Accurate Grasp Pattern Recognition with Adaptive Regularizer Learning Xiaoqin Zhang Ziwei Huang Jingjing Zheng Shuo Wang Xianta Jiang 21 2 0 11 May 2022
A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challenges Zhenghua Chen Min-man Wu Alvin Chan Xiaoli Li Yew-Soon Ong 24 6 0 08 May 2022
Automatic Block-wise Pruning with Auxiliary Gating Structures for Deep Convolutional Neural Networks Zhaofeng Si H. Qi Xiaoyu Song CVBM 22 0 0 07 May 2022
A High-Accuracy Unsupervised Person Re-identification Method Using Auxiliary Information Mined from Datasets Hehan Teng Tao He Yuchen Guo Guiguang Ding 30 3 0 06 May 2022
Alignahead: Online Cross-Layer Knowledge Extraction on Graph Neural Networks Jiongyu Guo Defang Chen Can Wang FedML 21 4 0 05 May 2022
Spot-adaptive Knowledge Distillation Mingli Song Ying Chen Jingwen Ye Mingli Song 28 72 0 05 May 2022
Generalized Knowledge Distillation via Relationship Matching Han-Jia Ye Su Lu De-Chuan Zhan FedML 22 20 0 04 May 2022
Multiple Degradation and Reconstruction Network for Single Image Denoising via Knowledge Distillation Juncheng Li Hanhui Yang Qiaosi Yi Faming Fang Guangwei Gao T. Zeng Guixu Zhang 30 7 0 29 Apr 2022
Selective Cross-Task Distillation Su Lu Han-Jia Ye De-Chuan Zhan 36 0 0 25 Apr 2022
CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing Chen Liang Pengcheng He Yelong Shen Weizhu Chen T. Zhao FedML 17 6 0 13 Apr 2022
HFT: Lifting Perspective Representations via Hybrid Feature Transformation Jiayu Zou Jun Xiao Zheng Hua Zhu Junjie Huang Guan Huang Dalong Du Xingang Wang 47 18 0 11 Apr 2022
Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection Jihwan Park Seungjun Lee Hwan Heo Hyeong Kyu Choi Hyunwoo J. Kim 19 23 0 11 Apr 2022
CDKT-FL: Cross-Device Knowledge Transfer using Proxy Dataset in Federated Learning Huy Q. Le Minh N. H. Nguyen Shashi Raj Pandey Chaoning Zhang Choong Seon Hong FedML 39 10 0 04 Apr 2022
A Free Lunch to Person Re-identification: Learning from Automatically Generated Noisy Tracklets Hehan Teng Tao He Yuchen Guo Zhenhua Guo Guiguang Ding VOT 11 3 0 02 Apr 2022
Self-Distillation from the Last Mini-Batch for Consistency Regularization Yiqing Shen Liwu Xu Yuzhe Yang Yaqian Li Yandong Guo 27 62 0 30 Mar 2022
Nested Collaborative Learning for Long-Tailed Visual Recognition Jun Li Zichang Tan Jun Wan Zhen Lei Guodong Guo 36 85 0 29 Mar 2022
AnyFace: Free-style Text-to-Face Synthesis and Manipulation Jianxin Sun Qiyao Deng Qi Li Muyi Sun Min Ren Zhen Sun CVBM 32 41 0 29 Mar 2022
Lightweight Graph Convolutional Networks with Topologically Consistent Magnitude Pruning H. Sahbi GNN 23 1 0 25 Mar 2022
Scale-Equivalent Distillation for Semi-Supervised Object Detection Qiushan Guo Yao Mu Jianyu Chen Tianqi Wang Yizhou Yu Ping Luo 23 28 0 23 Mar 2022
Channel Self-Supervision for Online Knowledge Distillation Shixi Fan Xuan Cheng Xiaomin Wang Chun Yang Pan Deng Minghui Liu Jiali Deng Meilin Liu 18 1 0 22 Mar 2022
Learning Affordance Grounding from Exocentric Images Hongcheng Luo Wei Zhai Jing Zhang Yang Cao Dacheng Tao 24 61 0 18 Mar 2022
Delta Distillation for Efficient Video Processing A. Habibian H. Yahia Davide Abati E. Gavves Fatih Porikli 11 11 0 17 Mar 2022
Decoupled Knowledge Distillation Borui Zhao Quan Cui Renjie Song Yiyu Qiu Jiajun Liang 19 526 0 16 Mar 2022
Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation Linfeng Zhang Xin Chen Xiaobing Tu Pengfei Wan N. Xu Kaisheng Ma 23 63 0 12 Mar 2022
LoopITR: Combining Dual and Cross Encoder Architectures for Image-Text Retrieval Jie Lei Xinlei Chen Ning Zhang Meng-xing Wang Joey Tianyi Zhou Tamara L. Berg Licheng Yu 39 12 0 10 Mar 2022
Online Deep Metric Learning via Mutual Distillation Gaowen Liu Wanqing Zhao Jie Zhao FedML CLL 11 1 0 10 Mar 2022
Generative Cooperative Learning for Unsupervised Video Anomaly Detection M. Zaheer Arif Mahmood M. H. Khan Mattia Segu Feng Yu Seung-Ik Lee AI4TS 32 130 0 08 Mar 2022
Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translation Chenze Shao Yang Feng CLL 23 32 0 08 Mar 2022
MSDN: Mutually Semantic Distillation Network for Zero-Shot Learning Shiming Chen Ziming Hong Guosen Xie Wenhan Wang Qinmu Peng Kai Wang Jian-jun Zhao Xinge You VLM 28 100 0 07 Mar 2022
Colar: Effective and Efficient Online Action Detection by Consulting Exemplars Le Yang Junwei Han Dingwen Zhang 27 35 0 02 Mar 2022
SEA: Bridging the Gap Between One- and Two-stage Detector Distillation via SEmantic-aware Alignment Yixin Chen Zhuotao Tian Pengguang Chen Shu Liu Jiaya Jia ObjD 14 1 0 02 Mar 2022
Synergistic Network Learning and Label Correction for Noise-robust Image Classification Chen Gong K. Bin E. Seibel Xin Wang Youbing Yin Qi Song NoLa 33 2 0 27 Feb 2022
Consensus Learning from Heterogeneous Objectives for One-Class Collaborative Filtering SeongKu Kang Dongha Lee Wonbin Kweon Junyoung Hwang Hwanjo Yu 19 12 0 26 Feb 2022
Extracting Effective Subnetworks with Gumbel-Softmax Robin Dupont M. Alaoui H. Sahbi A. Lebois 22 6 0 25 Feb 2022
Bridging the Gap Between Patient-specific and Patient-independent Seizure Prediction via Knowledge Distillation Di Wu Jie Yang Mohamad Sawan FedML 45 21 0 25 Feb 2022
Learn From the Past: Experience Ensemble Knowledge Distillation Chaofei Wang Shaowei Zhang S. Song Gao Huang 35 4 0 25 Feb 2022
Collaborative Training of Heterogeneous Reinforcement Learning Agents in Environments with Sparse Rewards: What and When to Share? Alain Andres Esther Villar-Rodriguez Javier Del Ser 22 9 0 24 Feb 2022
Debiased Self-Training for Semi-Supervised Learning Baixu Chen Junguang Jiang Ximei Wang Pengfei Wan Jianmin Wang Mingsheng Long 32 86 0 15 Feb 2022