v1v2 (latest)

Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion

18 December 2019

ArXiv (abs)PDF HTML Github (504★)

Papers citing "Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion"

50 / 354 papers shown

Title
Soft Masking for Cost-Constrained Channel Pruning Ryan Humble Maying Shen J. Latorre Eric Darve1 J. Álvarez 47 14 0 04 Nov 2022
Generative Negative Text Replay for Continual Vision-Language Pretraining Shipeng Yan Lanqing Hong Hang Xu Jianhua Han Tinne Tuytelaars Zhenguo Li Xuming He VLM CLL CLIP 77 18 0 31 Oct 2022
Zero-Shot Learning of a Conditional Generative Adversarial Network for Data-Free Network Quantization Yoojin Choi Mostafa El-Khamy Jungwon Lee GAN 49 1 0 26 Oct 2022
Distilling the Undistillable: Learning from a Nasty Teacher Surgan Jandial Yash Khasbage Arghya Pal V. Balasubramanian Balaji Krishnamurthy 119 7 0 21 Oct 2022
Handling Label Uncertainty for Camera Incremental Person Re-Identification Zexi Yang Dayan Wu Wanqian Zhang Bo Li Weiping Wang 64 7 0 17 Oct 2022
Structural Pruning via Latency-Saliency Knapsack Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez 100 50 0 13 Oct 2022
Synthetic Dataset Generation for Privacy-Preserving Machine Learning Efstathia Soufleri Gobinda Saha Kaushik Roy DD 92 2 0 06 Oct 2022
Domain Discrepancy Aware Distillation for Model Aggregation in Federated Learning Shangchao Su Bin Li Xiangyang Xue FedML 69 1 0 04 Oct 2022
Decompiling x86 Deep Neural Network Executables Zhibo Liu Yuanyuan Yuan Shuai Wang Xiaofei Xie Lei Ma AAML 71 15 0 03 Oct 2022
MAGIC: Mask-Guided Image Synthesis by Inverting a Quasi-Robust Classifier Mozhdeh Rouhsedaghat Masoud Monajatipoor C.-C. Jay Kuo I. Masi 62 7 0 23 Sep 2022
Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation Kien Do Hung Le D. Nguyen Dang Nguyen Haripriya Harikumar T. Tran Santu Rana Svetha Venkatesh 66 33 0 21 Sep 2022
PSAQ-ViT V2: Towards Accurate and General Data-Free Quantization for Vision Transformers Zhikai Li Mengjuan Chen Junrui Xiao Qingyi Gu ViT MQ 123 35 0 13 Sep 2022
Cocktail Party Attack: Breaking Aggregation-Based Privacy in Federated Learning using Independent Component Analysis Sanjay Kariyappa Chuan Guo Kiwan Maeng Wenjie Xiong G. E. Suh Moinuddin K. Qureshi Hsien-Hsin S. Lee FedML 86 30 0 12 Sep 2022
Dynamic Data-Free Knowledge Distillation by Easy-to-Hard Learning Strategy Jingru Li Sheng Zhou Liangcheng Li Haishuai Wang Zhi Yu Jiajun Bu 77 14 0 29 Aug 2022
Dense Depth Distillation with Out-of-Distribution Simulated Images Junjie Hu Chenyou Fan Mete Ozay Hualie Jiang Tin Lun Lam 67 4 0 26 Aug 2022
Towards Federated Learning against Noisy Labels via Local Self-Regularization Xue Jiang Sheng Sun Yuwei Wang Min Liu 66 39 0 25 Aug 2022
FS-BAN: Born-Again Networks for Domain Generalization Few-Shot Classification Yunqing Zhao Ngai-Man Cheung BDL 51 12 0 23 Aug 2022
RAIN: RegulArization on Input and Network for Black-Box Domain Adaptation Qucheng Peng Zhengming Ding Lingjuan Lyu Lichao Sun Chen Chen OOD MLAU 78 21 0 22 Aug 2022
Unsupervised Domain Adaptation for Segmentation with Black-box Source Model Xiaofeng Liu Chaehwa Yoo Fangxu Xing C.-C. Jay Kuo Xiaofeng Liu Jonghye Woo 95 17 0 16 Aug 2022
Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives Xiaofeng Liu Chaehwa Yoo Fangxu Xing Hyejin Oh Xiaofeng Liu Je-Won Kang Jonghye Woo OOD 110 207 0 15 Aug 2022
Mixed-Precision Neural Networks: A Survey M. Rakka M. Fouda Pramod P. Khargonekar Fadi J. Kurdahi MQ 86 12 0 11 Aug 2022
Class-Incremental Learning with Cross-Space Clustering and Controlled Transfer Arjun Ashok K. J. Joseph V. Balasubramanian CLL 61 29 0 07 Aug 2022
Black-box Few-shot Knowledge Distillation Dang Nguyen Sunil R. Gupta Kien Do Svetha Venkatesh 79 17 0 25 Jul 2022
Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay Huan Liu Li Gu Zhixiang Chi Yang Wang Yuanhao Yu Jun Chen Jingshan Tang 96 87 0 22 Jul 2022
Generative Domain Adaptation for Face Anti-Spoofing Qianyu Zhou Ke-Yue Zhang Taiping Yao Ran Yi Kekai Sheng Shouhong Ding Lizhuang Ma CVBM 85 53 0 20 Jul 2022
Learning with Recoverable Forgetting Jingwen Ye Yifang Fu Mingli Song Xingyi Yang Songhua Liu Xin Jin Mingli Song Xinchao Wang CLL KELM 102 42 0 17 Jul 2022
Knowledge Condensation Distillation Chenxin Li Mingbao Lin Zhiyuan Ding Nie Lin Yihong Zhuang Yue Huang Xinghao Ding Liujuan Cao 83 28 0 12 Jul 2022
Domain Alignment Meets Fully Test-Time Adaptation Kowshik Thopalli Pavan Turaga Jayaraman J. Thiagarajan OOD TTA 52 4 0 09 Jul 2022
Cross-domain Federated Object Detection Shangchao Su Bin Li Chengzhi Zhang Min Yang Xiangyang Xue FedML 75 8 0 30 Jun 2022
Class Impression for Data-free Incremental Learning Sana Ayromlou Purang Abolmaesumi Teresa S. M. Tsang Xiaoxiao Li 39 4 0 26 Jun 2022
Revisiting Self-Distillation M. Pham Minsu Cho Ameya Joshi Chinmay Hegde 101 23 0 17 Jun 2022
Reconstructing Training Data from Trained Neural Networks Niv Haim Gal Vardi Gilad Yehudai Ohad Shamir Michal Irani 116 141 0 15 Jun 2022
Few-Shot Unlearning by Model Inversion Youngsik Yoon Jinhwan Nam Hyojeong Yun Jaeho Lee Dongwoo Kim Jungseul Ok MU 56 18 0 31 May 2022
CDFKD-MFS: Collaborative Data-free Knowledge Distillation via Multi-level Feature Sharing Zhiwei Hao Yong Luo Zhi Wang Han Hu J. An 97 28 0 24 May 2022
IDEAL: Query-Efficient Data-Free Learning from Black-box Models Jie M. Zhang Chen Chen Lingjuan Lyu 105 14 0 23 May 2022
Self-distilled Knowledge Delegator for Exemplar-free Class Incremental Learning Fanfan Ye Liang Ma Qiaoyong Zhong Di Xie Shiliang Pu BDL CLL 43 2 0 23 May 2022
Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt Xinyin Ma Xinchao Wang Gongfan Fang Yongliang Shen Weiming Lu 32 11 0 16 May 2022
DearKD: Data-Efficient Early Knowledge Distillation for Vision Transformers Xianing Chen Qiong Cao Yujie Zhong Jing Zhang Shenghua Gao Dacheng Tao ViT 100 80 0 27 Apr 2022
Towards Data-Free Model Stealing in a Hard Label Setting Sunandini Sanyal Sravanti Addepalli R. Venkatesh Babu AAML 110 90 0 23 Apr 2022
A Closer Look at Rehearsal-Free Continual Learning James Smith Junjiao Tian Shaunak Halbe Yen-Chang Hsu Z. Kira VLM CLL 116 67 0 31 Mar 2022
It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher Kanghyun Choi Hye Yoon Lee Deokki Hong Joonsang Yu Noseong Park Youngsok Kim Jinho Lee MQ 101 33 0 31 Mar 2022
MKQ-BERT: Quantized BERT with 4-bits Weights and Activations Hanlin Tang Xipeng Zhang Kai Liu Jianchen Zhu Zhanhui Kang VLM MQ 51 15 0 25 Mar 2022
R-DFCIL: Relation-Guided Representation Learning for Data-Free Class Incremental Learning Qiankun Gao Chen Zhao Guohao Li Jian Zhang CLL 65 70 0 24 Mar 2022
GradViT: Gradient Inversion of Vision Transformers Ali Hatamizadeh Hongxu Yin H. Roth Wenqi Li Jan Kautz Daguang Xu Pavlo Molchanov ViT 177 65 0 22 Mar 2022
The Dark Side: Security Concerns in Machine Learning for EDA Zhiyao Xie Jingyu Pan Chen-Chia Chang Yiran Chen 29 4 0 20 Mar 2022
Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning Lin Zhang Li Shen Liang Ding Dacheng Tao Ling-Yu Duan FedML 90 267 0 17 Mar 2022
Federated and Generalized Person Re-identification through Domain and Feature Hallucinating Fengxiang Yang Zhun Zhong Zhiming Luo Shaozi Li N. Sebe FedML OOD 84 7 0 05 Mar 2022
Structured Pruning is All You Need for Pruning CNNs at Initialization Yaohui Cai Weizhe Hua Hongzheng Chen G. E. Suh Christopher De Sa Zhiru Zhang CVBM 93 15 0 04 Mar 2022
Patch Similarity Aware Data-Free Quantization for Vision Transformers Zhikai Li Liping Ma Mengjuan Chen Junrui Xiao Qingyi Gu MQ ViT 102 46 0 04 Mar 2022
Practical Network Acceleration with Tiny Sets G. Wang Jianxin Wu 92 11 0 16 Feb 2022