v1v2 (latest)

Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion

18 December 2019

ArXiv (abs)PDF HTML Github (504★)

Papers citing "Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion"

50 / 354 papers shown

Title
Do Gradient Inversion Attacks Make Federated Learning Unsafe? Ali Hatamizadeh Hongxu Yin Pavlo Molchanov Andriy Myronenko Wenqi Li ... Andrew Feng Mona G. Flores Jan Kautz Daguang Xu H. Roth FedML 87 68 0 14 Feb 2022
Submodularity In Machine Learning and Artificial Intelligence J. Bilmes 74 57 0 31 Jan 2022
Plug-In Inversion: Model-Agnostic Inversion for Vision with Data Augmentations Amin Ghiasi Hamid Kazemi Steven Reich Chen Zhu Micah Goldblum Tom Goldstein 88 16 0 31 Jan 2022
Plug & Play Attacks: Towards Robust and Flexible Model Inversion Attacks Lukas Struppek Dominik Hintersdorf Antonio De Almeida Correia Antonia Adler Kristian Kersting MIACV 132 65 0 28 Jan 2022
Variational Model Inversion Attacks Kuan-Chieh Wang Yanzhe Fu Ke Li Ashish Khisti R. Zemel Alireza Makhzani MIACV 88 97 0 26 Jan 2022
Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay Kuluhan Binici Shivam Aggarwal N. Pham K. Leman T. Mitra TTA 108 48 0 09 Jan 2022
Conditional Generative Data-free Knowledge Distillation Xinyi Yu Ling Yan Yang Yang Libo Zhou Linlin Ou 49 8 0 31 Dec 2021
Data-Free Knowledge Transfer: A Survey Yuang Liu Wei Zhang Jun Wang Jianyong Wang 114 48 0 31 Dec 2021
Improving the Behaviour of Vision Transformers with Token-consistent Stochastic Layers Nikola Popovic D. Paudel Thomas Probst Luc Van Gool 69 1 0 30 Dec 2021
Few-shot Backdoor Defense Using Shapley Estimation Jiyang Guan Zhuozhuo Tu Ran He Dacheng Tao AAML 90 54 0 30 Dec 2021
TAGPerson: A Target-Aware Generation Pipeline for Person Re-identification Kai Chen Weihua Chen Tao He Rong Du Fan Wang Xiuyu Sun Yuchen Guo Guiguang Ding 64 8 0 28 Dec 2021
DENSE: Data-Free One-Shot Federated Learning Jie M. Zhang Chen Chen Yue Liu Lingjuan Lyu Shuang Wu Shouhong Ding Chunhua Shen Chao Wu FedML DD 124 113 0 23 Dec 2021
Federated Learning for Face Recognition with Gradient Correction Yifan Niu Weihong Deng FedML 100 57 0 14 Dec 2021
Ex-Model: Continual Learning from a Stream of Trained Models Antonio Carta Andrea Cossu Vincenzo Lomonaco D. Bacciu CLL 40 12 0 13 Dec 2021
$Up to 100$\times$ Faster Data-free Knowledge Distillation$ Up to 100 $\times$ Faster Data-free Knowledge Distillation Gongfan Fang Kanya Mo Xinchao Wang Mingli Song Shitao Bei Haofei Zhang Xiuming Zhang DD 89 4 0 12 Dec 2021
A Generalized Zero-Shot Quantization of Deep Convolutional Neural Networks via Learned Weights Statistics Prasen Kumar Sharma Arun Abraham V. N. Rajendiran MQ 98 8 0 06 Dec 2021
Data-Free Neural Architecture Search via Recursive Label Calibration Zechun Liu Zhiqiang Shen Yun Long Eric P. Xing Kwang-Ting Cheng Chas Leichner 43 7 0 03 Dec 2021
A Fast Knowledge Distillation Framework for Visual Recognition Zhiqiang Shen Eric P. Xing VLM 106 49 0 02 Dec 2021
The Augmented Image Prior: Distilling 1000 Classes by Extrapolating from a Single Image Yuki M. Asano Aaqib Saeed 92 7 0 01 Dec 2021
One to Transfer All: A Universal Transfer Framework for Vision Foundation Model with Few Data Yujie Wang Junqin Huang Mengya Gao Yichao Wu Zhen-fei Yin Ding Liang Junjie Yan 59 0 0 24 Nov 2021
Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentation Jin Hong Yudong Zhang Weitian Chen OOD MedIm 107 86 0 24 Nov 2021
IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantization Mingliang Xu Mingbao Lin Gongrui Nan Jianzhuang Liu Baochang Zhang Yonghong Tian Rongrong Ji MQ 113 73 0 17 Nov 2021
Qimera: Data-free Quantization with Synthetic Boundary Supporting Samples Kanghyun Choi Deokki Hong Noseong Park Youngsok Kim Jinho Lee MQ 66 65 0 04 Nov 2021
Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data Gongfan Fang Yifan Bao Mingli Song Xinchao Wang Don Xie Chengchao Shen Xiuming Zhang 95 44 0 27 Oct 2021
Beyond Classification: Knowledge Distillation using Multi-Object Impressions Gaurav Kumar Nayak Monish Keswani Sharan Seshadri Anirban Chakraborty 45 2 0 27 Oct 2021
Semantic Host-free Trojan Attack Haripriya Harikumar Kien Do Santu Rana Sunil R. Gupta Svetha Venkatesh 51 1 0 26 Oct 2021
Applications and Techniques for Fast Machine Learning in Science A. Deiana Nhan Tran Joshua C. Agar Michaela Blott G. D. Guglielmo ... Ashish Sharma S. Summers Pietro Vischia J. Vlimant Olivia Weng 73 72 0 25 Oct 2021
When to Prune? A Policy towards Early Structural Pruning Maying Shen Pavlo Molchanov Hongxu Yin J. Álvarez VLM 77 56 0 22 Oct 2021
DistFL: Distribution-aware Federated Learning for Mobile Scenarios Bingyan Liu Y. Cai Ziqi Zhang Yan Liang Leye Wang Ding Li Yao Guo Xiangqun Chen OOD FedML 45 8 0 22 Oct 2021
HALP: Hardware-Aware Latency Pruning Maying Shen Hongxu Yin Pavlo Molchanov Lei Mao Jianna Liu J. Álvarez VLM 71 14 0 20 Oct 2021
Global Vision Transformer Pruning with Hessian-Aware Saliency Huanrui Yang Hongxu Yin Maying Shen Pavlo Molchanov Hai Helen Li Jan Kautz ViT 86 45 0 10 Oct 2021
Towards Data-Free Domain Generalization A. Frikha Haokun Chen Denis Krompass Thomas Runkler Volker Tresp OOD 140 14 0 09 Oct 2021
RED++ : Data-Free Pruning of Deep Neural Networks via Input Splitting and Output Merging Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly 113 17 0 30 Sep 2021
Designing Counterfactual Generators using Deep Model Inversion Jayaraman J. Thiagarajan V. Narayanaswamy Deepta Rajan J. Liang Akshay S. Chaudhari A. Spanias DiffM 58 22 0 29 Sep 2021
Unsolved Problems in ML Safety Dan Hendrycks Nicholas Carlini John Schulman Jacob Steinhardt 264 294 0 28 Sep 2021
Fine-grained Data Distribution Alignment for Post-Training Quantization Mingliang Xu Mingbao Lin Mengzhao Chen Ke Li Yunhang Shen Chia-Wen Lin Yongjian Wu Rongrong Ji MQ 127 20 0 09 Sep 2021
Memory-Free Generative Replay For Class-Incremental Learning Xiaomeng Xin Yiran Zhong Yunzhong Hou Jinjun Wang Liang Zheng 71 8 0 01 Sep 2021
Diverse Sample Generation: Pushing the Limit of Generative Data-free Quantization Haotong Qin Yifu Ding Xiangguo Zhang Jiakai Wang Xianglong Liu Jiwen Lu DiffM MQ 45 57 0 01 Sep 2021
On the Importance of Encrypting Deep Features Xingyang Ni H. Huttunen Esa Rahtu MIACV 59 0 0 16 Aug 2021
Preventing Catastrophic Forgetting and Distribution Mismatch in Knowledge Distillation via Synthetic Data Kuluhan Binici N. Pham T. Mitra K. Leman 84 41 0 11 Aug 2021
DeepScale: Online Frame Size Adaptation for Multi-object Tracking on Smart Cameras and Edge Servers Keivan Nalaie Renjie Xu Rong Zheng VOT 52 9 0 22 Jul 2021
Representation Consolidation for Training Expert Students Zhizhong Li Avinash Ravichandran Charless C. Fowlkes M. Polito Rahul Bhotika Stefano Soatto 54 6 0 16 Jul 2021
Privacy Vulnerability of Split Computing to Data-Free Model Inversion Attacks Xin Dong Hongxu Yin J. Álvarez Jan Kautz Pavlo Molchanov H. T. Kung MIACV 81 8 0 13 Jul 2021
LANA: Latency Aware Network Acceleration Pavlo Molchanov Jimmy Hall Hongxu Yin Jan Kautz Nicolò Fusi Arash Vahdat 124 10 0 12 Jul 2021
On The Distribution of Penultimate Activations of Classification Networks Minkyo Seo Yoonho Lee Suha Kwak UQCV 49 4 0 05 Jul 2021
Tackling Catastrophic Forgetting and Background Shift in Continual Semantic Segmentation Arthur Douillard Yifu Chen Arnaud Dapogny Matthieu Cord CLL 61 21 0 29 Jun 2021
Incremental Deep Neural Network Learning using Classification Confidence Thresholding Justin Leo Jugal Kalita CLL 60 18 0 21 Jun 2021
Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning James Smith Yen-Chang Hsu John C. Balloch Yilin Shen Hongxia Jin Z. Kira CLL 106 169 0 17 Jun 2021
Zero-Shot Knowledge Distillation from a Decision-Based Black-Box Model Zehao Wang 62 45 0 07 Jun 2021
RED : Looking for Redundancies for Data-Free Structured Compression of Deep Neural Networks Edouard Yvinec Arnaud Dapogny Matthieu Cord Kévin Bailly CVBM 70 23 0 31 May 2021