Rethinking Centered Kernel Alignment in Knowledge Distillation

22 January 2024

Papers citing "Rethinking Centered Kernel Alignment in Knowledge Distillation"

32 / 32 papers shown

Title
AFN: Adaptive Fusion Normalization via an Encoder-Decoder Framework Zikai Zhou Shuo Zhang Ziruo Wang Huanran Chen AI4CE 68 3 0 07 Aug 2023
Catch-Up Distillation: You Only Need to Train Once for Accelerating Sampling Shitong Shao Xu Dai Shouyi Yin Lujun Li Huanran Chen Yang Hu 45 17 0 18 May 2023
Similarity of Neural Network Models: A Survey of Functional and Representational Measures Max Klabunde Tobias Schumacher M. Strohmaier Florian Lemmerich 119 73 0 10 May 2023
Dual Relation Knowledge Distillation for Object Detection Zhenliang Ni Fu-Han Yang Shengzhao Wen Gang Zhang ObjD 62 13 0 11 Feb 2023
ViTKD: Practical Guidelines for ViT feature knowledge distillation Zhendong Yang Zhe Li Ailing Zeng Zexian Li Chun Yuan Yu Li 109 42 0 06 Sep 2022
Masked Generative Distillation Zhendong Yang Zhe Li Mingqi Shao Dachuan Shi Zehuan Yuan Chun Yuan FedML 66 174 0 03 May 2022
Decoupled Knowledge Distillation Borui Zhao Quan Cui Renjie Song Yiyu Qiu Jiajun Liang 56 539 0 16 Mar 2022
Exploring Inter-Channel Correlation for Diversity-preserved KnowledgeDistillation Li Liu Qingle Huang Sihao Lin Hongwei Xie Bing Wang Xiaojun Chang Xiao-Xue Liang 72 103 0 08 Feb 2022
Paint Transformer: Feed Forward Neural Painting with Stroke Prediction Songhua Liu Tianwei Lin Dongliang He Fu Li Rui Deng Xin Li Errui Ding Hao Wang ViT 54 78 0 09 Aug 2021
Distilling Knowledge via Knowledge Review Pengguang Chen Shu Liu Hengshuang Zhao Jiaya Jia 181 434 0 19 Apr 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 355 6,731 0 23 Dec 2020
Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection Xiang Li Wenhai Wang Lijun Wu Shuo Chen Xiaolin Hu Jun Li Jinhui Tang Jian Yang ObjD 69 1,191 0 08 Jun 2020
A unifying mutual information view of metric learning: cross-entropy vs. pairwise losses Malik Boudiaf Jérôme Rony Imtiaz Masud Ziko Eric Granger M. Pedersoli Pablo Piantanida Ismail Ben Ayed SSL 77 159 0 19 Mar 2020
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 141 1,045 0 23 Oct 2019
Similarity-Preserving Knowledge Distillation Frederick Tung Greg Mori 113 973 0 23 Jul 2019
MMDetection: Open MMLab Detection Toolbox and Benchmark Kai-xiang Chen Jiaqi Wang Jiangmiao Pang Yuhang Cao Yu Xiong ... Jingdong Wang Jianping Shi Wanli Ouyang Chen Change Loy Dahua Lin VOS 130 2,858 0 17 Jun 2019
Distilling Object Detectors with Fine-grained Feature Imitation Tao Wang Li-xin Yuan Xiaopeng Zhang Jiashi Feng ObjD 51 381 0 09 Jun 2019
RepPoints: Point Set Representation for Object Detection Ze Yang Shaohui Liu Han Hu Liwei Wang Stephen Lin 3DPC 95 866 0 25 Apr 2019
Relational Knowledge Distillation Wonpyo Park Dongju Kim Yan Lu Minsu Cho 63 1,405 0 10 Apr 2019
A Comprehensive Overhaul of Feature Distillation Byeongho Heo Jeesoo Kim Sangdoo Yun Hyojin Park Nojun Kwak J. Choi 76 574 0 03 Apr 2019
Correlation Congruence for Knowledge Distillation Baoyun Peng Xiao Jin Jiaheng Liu Shunfeng Zhou Yichao Wu Yu Liu Dongsheng Li Zhaoning Zhang 86 510 0 03 Apr 2019
FCOS: Fully Convolutional One-Stage Object Detection Zhi Tian Chunhua Shen Hao Chen Tong He ObjD 117 4,997 0 02 Apr 2019
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 214 3,457 0 09 Mar 2018
Cascade R-CNN: Delving into High Quality Object Detection Zhaowei Cai Nuno Vasconcelos ObjD 134 4,920 0 03 Dec 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 113 2,569 0 12 Dec 2016
Pyramid Scene Parsing Network Hengshuang Zhao Jianping Shi Xiaojuan Qi Xiaogang Wang Jiaya Jia VOS SSeg 605 11,984 0 04 Dec 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 322 7,971 0 23 May 2016
The Cityscapes Dataset for Semantic Urban Scene Understanding Marius Cordts Mohamed Omran Sebastian Ramos Timo Rehfeld Markus Enzweiler Rodrigo Benenson Uwe Franke Stefan Roth Bernt Schiele 1.0K 11,587 0 06 Apr 2016
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 475 62,122 0 04 Jun 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 286 3,870 0 19 Dec 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.6K 39,472 0 01 Sep 2014
Microsoft COCO: Common Objects in Context Nayeon Lee Michael Maire Serge J. Belongie Lubomir Bourdev Ross B. Girshick James Hays Pietro Perona Deva Ramanan C. L. Zitnick Piotr Dollár ObjD 381 43,524 0 01 May 2014