Decoupled Knowledge Distillation

v1v2 (latest)

Decoupled Knowledge Distillation

16 March 2022

Jiajun Liang

ArXiv (abs)PDF HTML Github (855★)

Papers citing "Decoupled Knowledge Distillation"

12 / 262 papers shown

Title
Masked Autoencoders Enable Efficient Knowledge Distillers Yutong Bai Zeyu Wang Junfei Xiao Chen Wei Huiyu Wang Alan Yuille Yuyin Zhou Cihang Xie CLL 100 44 0 25 Aug 2022
Rethinking Knowledge Distillation via Cross-Entropy Zhendong Yang Zhe Li Yuan Gong Tianke Zhang Shanshan Lao Chun Yuan Yu Li 71 14 0 22 Aug 2022
I Know What You Do Not Know: Knowledge Graph Embedding via Co-distillation Learning Yang Liu Zequn Sun Guang-pu Li Wei Hu 78 21 0 21 Aug 2022
PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient Weihan Cao Yifan Zhang Jianfei Gao Anda Cheng Ke Cheng Jian Cheng 94 69 0 05 Jul 2022
ORC: Network Group-based Knowledge Distillation using Online Role Change Jun-woo Choi Hyeon Cho Seockhwa Jeong Wonjun Hwang 29 3 0 01 Jun 2022
Aligning Logits Generatively for Principled Black-Box Knowledge Distillation Jing Ma Xiang Xiang Ke Wang Yuchuan Wu Yongbin Li 80 2 0 21 May 2022
Localization Distillation for Object Detection Zhaohui Zheng Rongguang Ye Ping Wang Dongwei Ren Jun Wang W. Zuo Ming-Ming Cheng 110 66 0 12 Apr 2022
Discriminability-Transferability Trade-Off: An Information-Theoretic Perspective Quan Cui Bingchen Zhao Zhao-Min Chen Borui Zhao Renjie Song Jiajun Liang Boyan Zhou Osamu Yoshie 92 18 0 08 Mar 2022
Contrastive Vision-Language Pre-training with Limited Resources Quan Cui Boyan Zhou Yu Guo Weidong Yin Hao Wu Osamu Yoshie Yubo Chen VLM CLIP 53 34 0 17 Dec 2021
Optimizing for In-memory Deep Learning with Emerging Memory Technology Zhehui Wang Yaoyu Zhang Rick Siow Mong Goh Wei Zhang Weng-Fai Wong 48 1 0 01 Dec 2021
PURSUhInT: In Search of Informative Hint Points Based on Layer Clustering for Knowledge Distillation Reyhan Kevser Keser Aydin Ayanzadeh O. A. Aghdam Çaglar Kilcioglu B. U. Toreyin N. K. Üre 53 7 0 26 Feb 2021
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 233 1,057 0 23 Oct 2019