Differentiable Feature Aggregation Search for Knowledge Distillation

2 August 2020

Jian Tang

Papers citing "Differentiable Feature Aggregation Search for Knowledge Distillation"

25 / 25 papers shown

Title
Efficient Knowledge Distillation of SAM for Medical Image Segmentation K. D. Patil Gowthamaan Palani Ganapathy Krishnamurthi VLM 50 0 0 28 Jan 2025
Central limit theorems for vector-valued composite functionals with smoothing and applications Huhui Chen Darinka Dentcheva Yang Lin Gregory J. Stock 48 0 0 26 Dec 2024
SimVG: A Simple Framework for Visual Grounding with Decoupled Multi-modal Fusion Ming Dai Lingfeng Yang Yihao Xu Zhenhua Feng Wankou Yang ObjD 35 9 0 26 Sep 2024
VLM-KD: Knowledge Distillation from VLM for Long-Tail Visual Recognition Zaiwei Zhang Gregory P. Meyer Zhichao Lu Ashish Shrivastava Avinash Ravichandran Eric M. Wolff VLM 44 2 0 29 Aug 2024
LLAVADI: What Matters For Multimodal Large Language Models Distillation Shilin Xu Xiangtai Li Haobo Yuan Lu Qi Yunhai Tong Ming-Hsuan Yang 36 3 0 28 Jul 2024
Federated Distillation: A Survey Lin Li Jianping Gou Baosheng Yu Lan Du Zhang Yiand Dacheng Tao DD FedML 59 4 0 02 Apr 2024
Group-Mix SAM: Lightweight Solution for Industrial Assembly Line Applications Wu Liang X.-G. Ma 36 0 0 15 Mar 2024
StableKD: Breaking Inter-block Optimization Entanglement for Stable Knowledge Distillation Shiu-hong Kao Jierun Chen S.-H. Gary Chan 27 0 0 20 Dec 2023
EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM Chong Zhou Xiangtai Li Chen Change Loy Bo Dai VLM 30 44 0 11 Dec 2023
A Sentence Speaks a Thousand Images: Domain Generalization through Distilling CLIP with Language Guidance Zeyi Huang Andy Zhou Zijian Lin Mu Cai Haohan Wang Yong Jae Lee VLM OOD 32 28 0 21 Sep 2023
Teach model to answer questions after comprehending the document Ruiqing Sun Ping Jian FaML 43 0 0 18 Jul 2023
Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation Chuanguang Yang Xinqiang Yu Zhulin An Yongjun Xu VLM OffRL 86 22 0 19 Jun 2023
When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario Chengcheng Han Liqing Cui Renyu Zhu Jie Wang Nuo Chen Qiushi Sun Xiang Li Ming Gao 36 7 0 17 May 2023
Visual Tuning Bruce X. B. Yu Jianlong Chang Haixin Wang Lin Liu Shijie Wang ... Lingxi Xie Haojie Li Zhouchen Lin Qi Tian Chang Wen Chen VLM 54 38 0 10 May 2023
Binarizing Sparse Convolutional Networks for Efficient Point Cloud Analysis Xiuwei Xu Ziwei Wang Jie Zhou Jiwen Lu 3DPC MQ 35 6 0 27 Mar 2023
Audio Representation Learning by Distilling Video as Privileged Information Amirhossein Hajavi Ali Etemad 21 4 0 06 Feb 2023
Design Automation for Fast, Lightweight, and Effective Deep Learning Models: A Survey Dalin Zhang Kaixuan Chen Yan Zhao B. Yang Li-Ping Yao Christian S. Jensen 48 3 0 22 Aug 2022
Attention-based Knowledge Distillation in Multi-attention Tasks: The Impact of a DCT-driven Loss Alejandro López-Cifuentes Marcos Escudero-Viñolo Jesús Bescós Juan C. Sanmiguel 23 1 0 04 May 2022
Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition Guangyu Guo Dingwen Zhang Longfei Han Nian Liu Ming-Ming Cheng Junwei Han 26 2 0 17 Dec 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 59 223 0 27 Jan 2021
Collaborative Teacher-Student Learning via Multiple Knowledge Transfer Liyuan Sun Jianping Gou Baosheng Yu Lan Du Dacheng Tao 28 11 0 21 Jan 2021
Cross-Layer Distillation with Semantic Calibration Defang Chen Jian-Ping Mei Yuan Zhang Can Wang Yan Feng Chun-Yen Chen FedML 45 286 0 06 Dec 2020
Channel-wise Knowledge Distillation for Dense Prediction Changyong Shu Yifan Liu Jianfei Gao Zheng Yan Chunhua Shen 17 257 0 26 Nov 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 19 2,843 0 09 Jun 2020
Neural Architecture Search with Reinforcement Learning Barret Zoph Quoc V. Le 271 5,327 0 05 Nov 2016