Data-Free Adversarial Distillation

23 December 2019

Papers citing "Data-Free Adversarial Distillation"

35 / 35 papers shown

Title
Forget the Data and Fine-Tuning! Just Fold the Network to Compress Dong Wang Haris Šikić Lothar Thiele O. Saukh 65 0 0 17 Feb 2025
Distilling Vision-Language Foundation Models: A Data-Free Approach via Prompt Diversification Yunyi Xuan Weijie Chen Shicai Yang Di Xie Luojun Lin Yueting Zhuang VLM 40 4 0 21 Jul 2024
Data-free Knowledge Distillation for Fine-grained Visual Categorization Renrong Shao Wei Zhang Jianhua Yin Jun Wang 39 2 0 18 Apr 2024
FedDistill: Global Model Distillation for Local Model De-Biasing in Non-IID Federated Learning Changlin Song Divya Saxena Jiannong Cao Yuqing Zhao FedML 42 3 0 14 Apr 2024
Sampling to Distill: Knowledge Transfer from Open-World Data Yuzheng Wang Zhaoyu Chen Jie M. Zhang Dingkang Yang Zuhao Ge Yang Liu Siao Liu Yunquan Sun Wenqiang Zhang Lizhe Qi 34 9 0 31 Jul 2023
Image Captions are Natural Prompts for Text-to-Image Models Shiye Lei Hao Chen Senyang Zhang Bo Zhao Dacheng Tao VLM 32 19 0 17 Jul 2023
DHBE: Data-free Holistic Backdoor Erasing in Deep Neural Networks via Restricted Adversarial Distillation Zhicong Yan Shenghong Li Ruijie Zhao Yuan Tian Yuanyuan Zhao AAML 39 11 0 13 Jun 2023
Lion: Adversarial Distillation of Proprietary Large Language Models Yuxin Jiang Chunkit Chan Mingyang Chen Wei Wang ALM 33 23 0 22 May 2023
Self-discipline on multiple channels Jiutian Zhao Liangchen Luo Hao Wang 32 0 0 27 Apr 2023
Feature-Rich Audio Model Inversion for Data-Free Knowledge Distillation Towards General Sound Classification Zuheng Kang Yayun He Jianzong Wang Junqing Peng Xiaoyang Qu Jing Xiao 16 2 0 14 Mar 2023
AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation Hyungmin Kim Sungho Suh Sunghyun Baek Daehwan Kim Daun Jeong Hansang Cho Junmo Kim 30 5 0 20 Nov 2022
Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation Kien Do Hung Le D. Nguyen Dang Nguyen Haripriya Harikumar T. Tran Santu Rana Svetha Venkatesh 18 32 0 21 Sep 2022
Dynamic Data-Free Knowledge Distillation by Easy-to-Hard Learning Strategy Jingru Li Sheng Zhou Liangcheng Li Haishuai Wang Zhi Yu Jiajun Bu 39 14 0 29 Aug 2022
Dense Depth Distillation with Out-of-Distribution Simulated Images Junjie Hu Chenyou Fan Mete Ozay Hualie Jiang Tin Lun Lam 24 4 0 26 Aug 2022
MOVE: Effective and Harmless Ownership Verification via Embedded External Features Yiming Li Linghui Zhu Xiaojun Jia Yang Bai Yong Jiang Shutao Xia Xiaochun Cao Kui Ren AAML 46 12 0 04 Aug 2022
Self-distilled Knowledge Delegator for Exemplar-free Class Incremental Learning Fanfan Ye Liang Ma Qiaoyong Zhong Di Xie Shiliang Pu BDL CLL 21 2 0 23 May 2022
Data-Free Adversarial Knowledge Distillation for Graph Neural Networks Yu-Lin Zhuang Lingjuan Lyu Chuan Shi Carl Yang Lichao Sun 40 16 0 08 May 2022
Spot-adaptive Knowledge Distillation Mingli Song Ying Chen Jingwen Ye Mingli Song 25 72 0 05 May 2022
Synthesizing Informative Training Samples with GAN Bo Zhao Hakan Bilen DD 37 75 0 15 Apr 2022
Knowledge-Free Black-Box Watermark and Ownership Proof for Image Classification Neural Networks Fangqi Li Shilin Wang 16 1 0 09 Apr 2022
Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning Lin Zhang Li Shen Liang Ding Dacheng Tao Ling-Yu Duan FedML 28 254 0 17 Mar 2022
MEGA: Model Stealing via Collaborative Generator-Substitute Networks Chi Hong Jiyue Huang L. Chen 27 2 0 31 Jan 2022
Data-Free Knowledge Transfer: A Survey Yuang Liu Wei Zhang Jun Wang Jianyong Wang 37 48 0 31 Dec 2021
Defending against Model Stealing via Verifying Embedded External Features Yiming Li Linghui Zhu Xiaojun Jia Yong Jiang Shutao Xia Xiaochun Cao AAML 43 61 0 07 Dec 2021
Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentation Jin Hong Yudong Zhang Weitian Chen OOD MedIm 32 82 0 24 Nov 2021
Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples Kanghyun Choi Deokki Hong Noseong Park Youngsok Kim Jinho Lee MQ 24 64 0 04 Nov 2021
FedZKT: Zero-Shot Knowledge Transfer towards Resource-Constrained Federated Learning with Heterogeneous On-Device Models Lan Zhang Dapeng Wu Xiaoyong Yuan FedML 38 48 0 08 Sep 2021
Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data Kuluhan Binici N. Pham T. Mitra K. Leman 30 40 0 11 Aug 2021
MEGEX: Data-Free Model Extraction Attack against Gradient-Based Explainable AI T. Miura Satoshi Hasegawa Toshiki Shibahara SILM MIACV 24 37 0 19 Jul 2021
AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compression Baozhou Zhu P. Hofstee J. Peltenburg Jinho Lee Zaid Al-Ars 24 22 0 25 May 2021
Distilling Object Detectors via Decoupled Features Jianyuan Guo Kai Han Yunhe Wang Han Wu Xinghao Chen Chunjing Xu Chang Xu 43 199 0 26 Mar 2021
Training Generative Adversarial Networks in One Stage Chengchao Shen Youtan Yin Xinchao Wang Xubin Li Mingli Song Xiuming Zhang GAN 23 14 0 28 Feb 2021
Enhancing Data-Free Adversarial Distillation with Activation Regularization and Virtual Interpolation Xiaoyang Qu Jianzong Wang Jing Xiao 18 14 0 23 Feb 2021
Data-Free Model Extraction Jean-Baptiste Truong Pratyush Maini R. Walls Nicolas Papernot MIACV 15 181 0 30 Nov 2020
MAZE: Data-Free Model Stealing Attack Using Zeroth-Order Gradient Estimation Sanjay Kariyappa A. Prakash Moinuddin K. Qureshi AAML 32 146 0 06 May 2020