Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion

18 December 2019

Papers citing "Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion"

50 / 112 papers shown

Title
Dense Depth Distillation with Out-of-Distribution Simulated Images Junjie Hu Chenyou Fan Mete Ozay Hualie Jiang Tin Lun Lam 24 4 0 26 Aug 2022
FS-BAN: Born-Again Networks for Domain Generalization Few-Shot Classification Yunqing Zhao Ngai-man Cheung BDL 25 12 0 23 Aug 2022
RAIN: RegulArization on Input and Network for Black-Box Domain Adaptation Qucheng Peng Zhengming Ding Lingjuan Lyu Lichao Sun Chen Chen OOD MLAU 31 18 0 22 Aug 2022
Mixed-Precision Neural Networks: A Survey M. Rakka M. Fouda Pramod P. Khargonekar Fadi J. Kurdahi MQ 27 11 0 11 Aug 2022
Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay Huan Liu Li Gu Zhixiang Chi Yang Wang Yuanhao Yu Jun Chen Jingshan Tang 33 82 0 22 Jul 2022
Generative Domain Adaptation for Face Anti-Spoofing Qianyu Zhou Ke-Yue Zhang Taiping Yao Ran Yi Kekai Sheng Shouhong Ding Lizhuang Ma CVBM 34 48 0 20 Jul 2022
Knowledge Condensation Distillation Chenxin Li Mingbao Lin Zhiyuan Ding Nie Lin Yihong Zhuang Yue Huang Xinghao Ding Liujuan Cao 42 28 0 12 Jul 2022
Reconstructing Training Data from Trained Neural Networks Niv Haim Gal Vardi Gilad Yehudai Ohad Shamir Michal Irani 40 132 0 15 Jun 2022
Few-Shot Unlearning by Model Inversion Youngsik Yoon Jinhwan Nam Hyojeong Yun Jaeho Lee Dongwoo Kim Jungseul Ok MU 30 17 0 31 May 2022
IDEAL: Query-Efficient Data-Free Learning from Black-box Models Jie M. Zhang Chen Chen Lingjuan Lyu 55 14 0 23 May 2022
Self-distilled Knowledge Delegator for Exemplar-free Class Incremental Learning Fanfan Ye Liang Ma Qiaoyong Zhong Di Xie Shiliang Pu BDL CLL 21 2 0 23 May 2022
Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt Xinyin Ma Xinchao Wang Gongfan Fang Yongliang Shen Weiming Lu 24 11 0 16 May 2022
DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers Xianing Chen Qiong Cao Yujie Zhong Jing Zhang Shenghua Gao Dacheng Tao ViT 40 76 0 27 Apr 2022
A Closer Look at Rehearsal-Free Continual Learning James Smith Junjiao Tian Shaunak Halbe Yen-Chang Hsu Z. Kira VLM CLL 26 60 0 31 Mar 2022
R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learning Qiankun Gao Chen Zhao Guohao Li Jian Zhang CLL 28 61 0 24 Mar 2022
The Dark Side: Security Concerns in Machine Learning for EDA Zhiyao Xie Jingyu Pan Chen-Chia Chang Yiran Chen 16 4 0 20 Mar 2022
Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning Lin Zhang Li Shen Liang Ding Dacheng Tao Ling-Yu Duan FedML 28 254 0 17 Mar 2022
Structured Pruning is All You Need for Pruning CNNs at Initialization Yaohui Cai Weizhe Hua Hongzheng Chen G. E. Suh Christopher De Sa Zhiru Zhang CVBM 49 14 0 04 Mar 2022
Patch Similarity Aware Data-Free Quantization for Vision Transformers Zhikai Li Liping Ma Mengjuan Chen Junrui Xiao Qingyi Gu MQ ViT 21 44 0 04 Mar 2022
Plug-In Inversion: Model-Agnostic Inversion for Vision with Data Augmentations Amin Ghiasi Hamid Kazemi Steven Reich Chen Zhu Micah Goldblum Tom Goldstein 48 15 0 31 Jan 2022
Variational Model Inversion Attacks Kuan-Chieh Jackson Wang Yanzhe Fu Ke Li Ashish Khisti R. Zemel Alireza Makhzani MIACV 25 95 0 26 Jan 2022
Data-Free Knowledge Transfer: A Survey Yuang Liu Wei Zhang Jun Wang Jianyong Wang 37 48 0 31 Dec 2021
TAGPerson: A Target-Aware Generation Pipeline for Person Re-identification Kai Chen Weihua Chen Tao He Rong Du Fan Wang Xiuyu Sun Yuchen Guo Guiguang Ding 32 8 0 28 Dec 2021
Federated Learning for Face Recognition with Gradient Correction Yifan Niu Weihong Deng FedML 32 57 0 14 Dec 2021
Ex-Model: Continual Learning from a Stream of Trained Models Antonio Carta Andrea Cossu Vincenzo Lomonaco D. Bacciu CLL 19 11 0 13 Dec 2021
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image Yuki M. Asano Aaqib Saeed 45 7 0 01 Dec 2021
Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentation Jin Hong Yudong Zhang Weitian Chen OOD MedIm 32 82 0 24 Nov 2021
IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantization Mingliang Xu Mingbao Lin Gongrui Nan Jianzhuang Liu Baochang Zhang Yonghong Tian Rongrong Ji MQ 48 71 0 17 Nov 2021
Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples Kanghyun Choi Deokki Hong Noseong Park Youngsok Kim Jinho Lee MQ 27 64 0 04 Nov 2021
Semantic Host-free Trojan Attack Haripriya Harikumar Kien Do Santu Rana Sunil R. Gupta Svetha Venkatesh 25 1 0 26 Oct 2021
When to Prune? A Policy towards Early Structural Pruning Maying Shen Pavlo Molchanov Hongxu Yin J. Álvarez VLM 28 53 0 22 Oct 2021
HALP: Hardware-Aware Latency Pruning Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez VLM 46 13 0 20 Oct 2021
Global Vision Transformer Pruning with Hessian-Aware Saliency Huanrui Yang Hongxu Yin Maying Shen Pavlo Molchanov Hai Helen Li Jan Kautz ViT 30 39 0 10 Oct 2021
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly 28 15 0 30 Sep 2021
Designing Counterfactual Generators using Deep Model Inversion Jayaraman J. Thiagarajan V. Narayanaswamy Deepta Rajan J. Liang Akshay S. Chaudhari A. Spanias DiffM 20 22 0 29 Sep 2021
Fine-grained Data Distribution Alignment for Post-Training Quantization Mingliang Xu Mingbao Lin Yonghong Tian Ke Li Yunhang Shen Rongrong Ji Yongjian Wu Rongrong Ji MQ 84 19 0 09 Sep 2021
Memory-Free Generative Replay For Class-Incremental Learning Xiaomeng Xin Yiran Zhong Yunzhong Hou Jinjun Wang Liang Zheng 24 8 0 01 Sep 2021
Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data Kuluhan Binici N. Pham T. Mitra K. Leman 30 40 0 11 Aug 2021
DeepScale: Online Frame Size Adaptation for Multi-object Tracking on Smart Cameras and Edge Servers Keivan Nalaie Renjie Xu Rong Zheng VOT 27 9 0 22 Jul 2021
On The Distribution of Penultimate Activations of Classification Networks Minkyo Seo Yoonho Lee Suha Kwak UQCV 18 4 0 05 Jul 2021
Incremental Deep Neural Network Learning using Classification Confidence Thresholding Justin Leo Jugal Kalita CLL 24 15 0 21 Jun 2021
Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning James Smith Yen-Chang Hsu John C. Balloch Yilin Shen Hongxia Jin Z. Kira CLL 65 162 0 17 Jun 2021
AutoReCon: Neural Architecture Search-based Reconstruction for Data-free Compression Baozhou Zhu P. Hofstee J. Peltenburg Jinho Lee Zaid Al-Ars 24 22 0 25 May 2021
Graph-Free Knowledge Distillation for Graph Neural Networks Xiang Deng Zhongfei Zhang 34 65 0 16 May 2021
Delving into Data: Effectively Substitute Training for Black-box Attack Wenxuan Wang Bangjie Yin Taiping Yao Li Zhang Yanwei Fu Shouhong Ding Jilin Li Feiyue Huang Xiangyang Xue AAML 60 63 0 26 Apr 2021
Visualizing Adapted Knowledge in Domain Transfer Yunzhong Hou Liang Zheng 126 54 0 20 Apr 2021
See through Gradients: Image Batch Recovery via GradInversion Hongxu Yin Arun Mallya Arash Vahdat J. Álvarez Jan Kautz Pavlo Molchanov FedML 25 462 0 15 Apr 2021
Post-Hoc Domain Adaptation via Guided Data Homogenization Kurt Willis Luis Oala 21 4 0 08 Apr 2021
Distilling and Transferring Knowledge via cGAN-generated Samples for Image Classification and Regression Xin Ding Z. J. Wang Zuheng Xu Z. Jane Wang William J. Welch 41 22 0 07 Apr 2021
Diversifying Sample Generation for Accurate Data-Free Quantization Xiangguo Zhang Haotong Qin Yifu Ding Ruihao Gong Qing Yan Renshuai Tao Yuhang Li F. Yu Xianglong Liu MQ 56 94 0 01 Mar 2021