v1v2 (latest)

Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion

18 December 2019

ArXiv (abs)PDF HTML Github (504★)

Papers citing "Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion"

50 / 354 papers shown

Title
Few-shot Image Generation via Information Transfer from the Built Geodesic Surface Yuexing Han Liheng Ruan Bing Wang 63 1 0 03 Jan 2024
Lightweight Adaptive Feature De-drifting for Compressed Image Classification Long Peng Yang Cao Yuejin Sun Yang Wang 96 18 0 03 Jan 2024
Federated Learning via Input-Output Collaborative Distillation Xuan Gong Shanglin Li Yuxiang Bao Barry Yao Yawen Huang Ziyan Wu Baochang Zhang Yefeng Zheng David Doermann FedML 71 6 0 22 Dec 2023
Fine-Grained Knowledge Selection and Restoration for Non-Exemplar Class Incremental Learning Jiang-Tian Zhai Xialei Liu Lu Yu Ming-Ming Cheng CLL 115 10 0 20 Dec 2023
Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomy Everton L. Aleixo J. Colonna Marco Cristo Everlandio Fernandes CLL 114 26 0 16 Dec 2023
Dataset Distillation via Adversarial Prediction Matching Yin Hua Bo Huang Junda Lu Bing Li Yi Wang Minhao Cheng Wei Wang DD 49 5 0 14 Dec 2023
Continual Learning through Networks Splitting and Merging with Dreaming-Meta-Weighted Model Fusion Yi Sun Xin Xu Jian Li Guanglei Xie Yifei Shi Qiang Fang CLL MoMe 94 1 0 12 Dec 2023
Fake It Till Make It: Federated Learning with Consensus-Oriented Generation Rui Ye Yaxin Du Zhenyang Ni Siheng Chen Yanfeng Wang FedML 77 5 0 10 Dec 2023
GenQ: Quantization in Low Data Regimes with Generative Synthetic Data Yuhang Li Youngeun Kim Donghyun Lee Souvik Kundu Priyadarshini Panda MQ 84 2 0 07 Dec 2023
On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm Peng Sun Bei Shi Daiwei Yu Tao Lin DD 93 51 0 06 Dec 2023
Generator Born from Classifier Runpeng Yu Xinchao Wang 61 4 0 05 Dec 2023
Dataset Distillation via the Wasserstein Metric Haoyang Liu Yijiang Li Tiancheng Xing Vibhu Dalal Luwei Li Jingrui He Haohan Wang DD 121 14 0 30 Nov 2023
Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching Shitong Shao Zeyuan Yin Muxin Zhou Xindong Zhang Zhiqiang Shen DD 111 30 0 29 Nov 2023
Task-Distributionally Robust Data-Free Meta-Learning Zixuan Hu Li Shen Zhenyi Wang Yongxian Wei Baoyuan Wu Chun Yuan Dacheng Tao OOD 63 0 0 23 Nov 2023
CovarNav: Machine Unlearning via Model Inversion and Covariance Navigation Ali Abbasi Chayne Thrash Elaheh Akbari Daniel Zhang Soheil Kolouri MU 58 4 0 21 Nov 2023
BrainWash: A Poisoning Attack to Forget in Continual Learning Ali Abbasi Parsa Nooralinejad Hamed Pirsiavash Soheil Kolouri CLL KELM AAML 108 6 0 20 Nov 2023
A Data-Free Approach to Mitigate Catastrophic Forgetting in Federated Class Incremental Learning for Vision Tasks Sara Babakniya Zalan Fabian Chaoyang He Mahdi Soltanolkotabi Salman Avestimehr FedML CLL 74 32 0 13 Nov 2023
Expanding Expressiveness of Diffusion Models with Limited Data via Self-Distillation based Fine-Tuning Jiwan Hur Jaehyun Choi Gyojin Han Dong-Jae Lee Junmo Kim 82 5 0 02 Nov 2023
Towards Plastic and Stable Exemplar-Free Incremental Learning: A Dual-Learner Framework with Cumulative Parameter Averaging Wenju Sun Qingyong Li Wen Wang Yangli-ao Geng CLL MoMe 68 3 0 28 Oct 2023
Data-Free Knowledge Distillation Using Adversarially Perturbed OpenGL Shader Images Logan Frank Jim Davis 74 1 0 20 Oct 2023
Towards the Fundamental Limits of Knowledge Transfer over Finite Domains Qingyue Zhao Banghua Zhu 84 4 0 11 Oct 2023
NeuroInspect: Interpretable Neuron-based Debugging Framework through Class-conditional Visualizations Yeong-Joon Ju Ji-Hoon Park Seong-Whan Lee AAML 37 0 0 11 Oct 2023
Self-Supervised Dataset Distillation for Transfer Learning Dong Bok Lee Seanie Lee Joonho Ko Kenji Kawaguchi Juho Lee Sung Ju Hwang DD 88 3 0 10 Oct 2023
Robustness-Guided Image Synthesis for Data-Free Quantization Jianhong Bai Yuchen Yang Huanpeng Chu Hualiang Wang Zuo-Qiang Liu Ruizhe Chen Xiaoxuan He Lianrui Mu Chengfei Cai Haoji Hu DiffM MQ 134 5 0 05 Oct 2023
FedLPA: One-shot Federated Learning with Layer-Wise Posterior Aggregation Xiang Liu Liangxi Liu Feiyang Ye Yunheng Shen Xia Li Linshan Jiang Jialin Li 97 5 0 30 Sep 2023
NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation Minh-Tuan Tran Trung Le Xuan-May Le Mehrtash Harandi Quan Hung Tran Dinh Q. Phung 72 13 0 30 Sep 2023
Towards Few-Call Model Stealing via Active Self-Paced Knowledge Distillation and Diffusion-Based Image Generation Vlad Hondru Radu Tudor Ionescu DiffM 97 2 0 29 Sep 2023
Causal-DFQ: Causality Guided Data-free Network Quantization Yuzhang Shang Bingxin Xu Gaowen Liu Ramana Rao Kompella Yan Yan MQ CML 88 8 0 24 Sep 2023
DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning Kangyang Luo Shuai Wang Y. Fu Xiang Li Yunshi Lan Minghui Gao FedML 86 28 0 24 Sep 2023
Dual Student Networks for Data-Free Model Stealing James Beetham Navid Kardan Ajmal Mian M. Shah 114 18 0 18 Sep 2023
Client-side Gradient Inversion Against Federated Learning from Poisoning Jiaheng Wei Yanjun Zhang Leo Yu Zhang Chao Chen Shirui Pan Kok-Leong Ong Jinchao Zhang Yang Xiang AAML 67 3 0 14 Sep 2023
A survey on efficient vision transformers: algorithms, techniques, and performance benchmarking Lorenzo Papa Paolo Russo Irene Amerini Luping Zhou 98 45 0 05 Sep 2023
Probabilistic Precision and Recall Towards Reliable Evaluation of Generative Models Dogyun Park Suhyun Kim EGVM 31 4 0 04 Sep 2023
SynthDistill: Face Recognition with Knowledge Distillation from Synthetic Data Hatef Otroshi Anjith George S´ebastien Marcel 69 11 0 28 Aug 2023
Masked Autoencoders are Efficient Class Incremental Learners Jiang-Tian Zhai Xialei Liu Andrew D. Bagdanov Ke Li Mingg-Ming Cheng CLL 63 15 0 24 Aug 2023
QD-BEV : Quantization-aware View-guided Distillation for Multi-view 3D Object Detection Yifan Zhang Zhen Dong Huanrui Yang Ming Lu Cheng-Ching Tseng Yuan Du Kurt Keutzer Li Du Shanghang Zhang MQ 70 9 0 21 Aug 2023
Gradient-Based Post-Training Quantization: Challenging the Status Quo Edouard Yvinec Arnaud Dapogny Kévin Bailly MQ 84 0 0 15 Aug 2023
Unified Data-Free Compression: Pruning and Quantization without Fine-Tuning Shipeng Bai Jun Chen Xintian Shen Yixuan Qian Yong Liu MQ 90 15 0 14 Aug 2023
Feature Matching Data Synthesis for Non-IID Federated Learning Zijian Li Yuchang Sun Jiawei Shao Yuyi Mao Jessie Hui Wang Jun Zhang 60 21 0 09 Aug 2023
Incorporating Pre-training Data Matters in Unsupervised Domain Adaptation Yinsong Xu Aidong Men Yang Liu Xiahai Zhuang Qingchao Chen 56 0 0 06 Aug 2023
Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants Yibo Yang Haobo Yuan Hefei Ling Jianlong Wu Lefei Zhang Zhouchen Lin Philip Torr Dacheng Tao Guohao Li CLL 89 11 0 03 Aug 2023
Sampling to Distill: Knowledge Transfer from Open-World Data Yuzheng Wang Zhaoyu Chen Jie M. Zhang Dingkang Yang Zuhao Ge Yang Liu Siao Liu Yunquan Sun Wenqiang Zhang Lizhe Qi 85 9 0 31 Jul 2023
f-Divergence Minimization for Sequence-Level Knowledge Distillation Yuqiao Wen Zichao Li Wenyu Du Lili Mou 79 61 0 27 Jul 2023
Distribution Shift Matters for Knowledge Distillation with Webly Collected Images Jialiang Tang Shuo Chen Gang Niu Masashi Sugiyama Chenggui Gong 69 14 0 21 Jul 2023
Customizing Synthetic Data for Data-Free Student Learning Shiya Luo Defang Chen Can Wang 40 2 0 10 Jul 2023
Deconstructing Data Reconstruction: Multiclass, Weight Decay and General Losses G. Buzaglo Niv Haim Gilad Yehudai Gal Vardi Yakir Oz Yaniv Nikankin Michal Irani 104 15 0 04 Jul 2023
Don't Memorize; Mimic The Past: Federated Class Incremental Learning Without Episodic Memory Sara Babakniya Zalan Fabian Chaoyang He Mahdi Soltanolkotabi Salman Avestimehr FedML 61 2 0 02 Jul 2023
Class-Incremental Learning using Diffusion Model for Distillation and Replay Quentin Jodelet Xin Liu Yin Jun Phua T. Murata DiffM 78 31 0 30 Jun 2023
NaturalInversion: Data-Free Image Synthesis Improving Real-World Consistency Yujin Kim Do-Young Park Dohee Kim Suhyun Kim DiffM 85 9 0 29 Jun 2023
Adaptive Sharpness-Aware Pruning for Robust Sparse Networks Anna Bair Hongxu Yin Maying Shen Pavlo Molchanov J. Álvarez 90 12 0 25 Jun 2023