FiGKD: Fine-Grained Knowledge Distillation via High-Frequency Detail Transfer

17 May 2025

Papers citing "FiGKD: Fine-Grained Knowledge Distillation via High-Frequency Detail Transfer"

44 / 44 papers shown

Title
Maximizing Discrimination Capability of Knowledge Distillation with Energy Function Seonghak Kim Gyeongdo Ham Suin Lee Donggon Jang Daeshik Kim 171 4 0 24 Nov 2023
Robustness-Reinforced Knowledge Distillation with Correlation Distance and Network Pruning Seonghak Kim Gyeongdo Ham Yucheol Cho Daeshik Kim 82 4 0 23 Nov 2023
FreeKD: Knowledge Distillation via Semantic Frequency Prompt Yuan Zhang Tao Huang Jiaming Liu Tao Jiang Kuan Cheng Shanghang Zhang AAML 53 14 0 20 Nov 2023
What do neural networks learn in image classification? A frequency shortcut perspective Shunxin Wang Raymond N. J. Veldhuis Christoph Brune N. Strisciuglio 47 24 0 19 Jul 2023
Knowledge Diffusion for Distillation Tao Huang Yuan Zhang Mingkai Zheng Shan You Fei Wang Chao Qian Chang Xu 66 51 0 25 May 2023
Class Attention Transfer Based Knowledge Distillation Ziyao Guo Haonan Yan Hui Li Xiao-La Lin 45 66 0 25 Apr 2023
YOLOPv2: Better, Faster, Stronger for Panoptic Driving Perception Cheng Han Qichao Zhao Shuyi Zhang Yinzi Chen Zhenlin Zhang Jinwei Yuan 66 71 0 24 Aug 2022
Knowledge Distillation from A Stronger Teacher Tao Huang Shan You Fei Wang Chao Qian Chang Xu 65 245 0 21 May 2022
Decoupled Knowledge Distillation Borui Zhao Quan Cui Renjie Song Yiyu Qiu Jiajun Liang 56 538 0 16 Mar 2022
Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation Linfeng Zhang Xin Chen Xiaobing Tu Pengfei Wan N. Xu Kaisheng Ma 55 63 0 12 Mar 2022
YOLOP: You Only Look Once for Panoptic Driving Perception Dongsheng Wu Man-Wen Liao Wei-Tian Zhang Xinggang Wang X. Bai Wenqing Cheng Wen-Yu Liu 101 307 0 25 Aug 2021
Multi-Modal Fusion Transformer for End-to-End Autonomous Driving Aditya Prakash Kashyap Chitta Andreas Geiger ViT 103 523 0 19 Apr 2021
Distilling Knowledge via Knowledge Review Pengguang Chen Shu Liu Hengshuang Zhao Jiaya Jia 181 434 0 19 Apr 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 538 40,739 0 22 Oct 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 62 2,932 0 09 Jun 2020
Learning in the Frequency Domain Kai Xu Minghai Qin Fei Sun Yuhao Wang Yen-kuang Chen Fengbo Ren 86 403 0 27 Feb 2020
Discrimination-aware Network Pruning for Deep Model Compression Jing Liu Bohan Zhuang Zhuangwei Zhuang Yong Guo Junzhou Huang Jin-Hui Zhu Mingkui Tan CVBM 53 120 0 04 Jan 2020
Contrastive Representation Distillation Yonglong Tian Dilip Krishnan Phillip Isola 141 1,045 0 23 Oct 2019
Similarity-Preserving Knowledge Distillation Frederick Tung Greg Mori 113 973 0 23 Jul 2019
A Fourier Perspective on Model Robustness in Computer Vision Dong Yin Raphael Gontijo-Lopes Jonathon Shlens E. D. Cubuk Justin Gilmer OOD 79 496 0 21 Jun 2019
Multimodal End-to-End Autonomous Driving Yi Xiao Felipe Codevilla A. Gurram O. Urfalioglu Antonio M. López 41 243 0 07 Jun 2019
Variational Information Distillation for Knowledge Transfer SungSoo Ahn S. Hu Andreas C. Damianou Neil D. Lawrence Zhenwen Dai 87 616 0 11 Apr 2019
Relational Knowledge Distillation Wonpyo Park Dongju Kim Yan Lu Minsu Cho 63 1,405 0 10 Apr 2019
A Comprehensive Overhaul of Feature Distillation Byeongho Heo Jeesoo Kim Sangdoo Yun Hyojin Park Nojun Kwak J. Choi 76 574 0 03 Apr 2019
Improved Knowledge Distillation via Teacher Assistant Seyed Iman Mirzadeh Mehrdad Farajtabar Ang Li Nir Levine Akihiro Matsukawa H. Ghasemzadeh 92 1,074 0 09 Feb 2019
ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design Ningning Ma Xiangyu Zhang Haitao Zheng Jian Sun 159 4,970 0 30 Jul 2018
Training behavior of deep neural network in frequency domain Zhi-Qin John Xu Yaoyu Zhang Yan Xiao AI4CE 63 319 0 03 Jul 2018
MobileNetV2: Inverted Residuals and Linear Bottlenecks Mark Sandler Andrew G. Howard Menglong Zhu A. Zhmoginov Liang-Chieh Chen 169 19,204 0 13 Jan 2018
A Frequency Domain Neural Network for Fast Image Super-resolution Junxuan Li Shaodi You A. Robles-Kelly SupR 66 34 0 08 Dec 2017
Adaptive Quantization for Deep Neural Network Yiren Zhou Seyed-Mohsen Moosavi-Dezfooli Ngai-Man Cheung P. Frossard MQ 62 182 0 04 Dec 2017
ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices Xiangyu Zhang Xinyu Zhou Mengxiao Lin Jian Sun AI4TS 132 6,850 0 04 Jul 2017
Deep Mutual Learning Ying Zhang Tao Xiang Timothy M. Hospedales Huchuan Lu FedML 143 1,650 0 01 Jun 2017
Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer Sergey Zagoruyko N. Komodakis 113 2,569 0 12 Dec 2016
Pyramid Scene Parsing Network Hengshuang Zhao Jianping Shi Xiaojuan Qi Xiaogang Wang Jiaya Jia VOS SSeg 594 11,984 0 04 Dec 2016
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs Liang-Chieh Chen George Papandreou Iasonas Kokkinos Kevin Patrick Murphy Alan Yuille SSeg 227 18,195 0 02 Jun 2016
Wide Residual Networks Sergey Zagoruyko N. Komodakis 320 7,971 0 23 May 2016
Fully Convolutional Networks for Semantic Segmentation Evan Shelhamer Jonathan Long Trevor Darrell VOS SSeg 632 37,806 0 20 May 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.0K 193,426 0 10 Dec 2015
You Only Look Once: Unified, Real-Time Object Detection Joseph Redmon S. Divvala Ross B. Girshick Ali Farhadi ObjD 660 36,801 0 08 Jun 2015
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 473 62,122 0 04 Jun 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 318 19,609 0 09 Mar 2015
FitNets: Hints for Thin Deep Nets Adriana Romero Nicolas Ballas Samira Ebrahimi Kahou Antoine Chassang C. Gatta Yoshua Bengio FedML 284 3,870 0 19 Dec 2014
Very Deep Convolutional Networks for Large-Scale Image Recognition Karen Simonyan Andrew Zisserman FAtt MDE 1.5K 100,213 0 04 Sep 2014
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 1.5K 39,472 0 01 Sep 2014