v1v2 (latest)

Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion

18 December 2019

ArXiv (abs)PDF HTML Github (504★)

Papers citing "Dreaming to Distill: Data-free Knowledge Transfer via DeepInversion"

50 / 354 papers shown

Title
Squeeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New Perspective Zeyuan Yin Eric P. Xing Zhiqiang Shen DD 101 83 0 22 Jun 2023
Data-Free Backbone Fine-Tuning for Pruned Neural Networks Adrian Holzbock Achyut Hegde Klaus C. J. Dietmayer Vasileios Belagiannis 52 0 0 22 Jun 2023
Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation Chuanguang Yang Xinqiang Yu Zhulin An Yongjun Xu VLM OffRL 179 26 0 19 Jun 2023
Your Room is not Private: Gradient Inversion Attack on Reinforcement Learning Miao Li Wenhao Ding Ding Zhao AAML 55 0 0 15 Jun 2023
Heterogeneous Continual Learning Divyam Madaan Hongxu Yin Wonmin Byeon Jan Kautz Pavlo Molchanov CLL 58 5 0 14 Jun 2023
DHBE: Data-free Holistic Backdoor Erasing in Deep Neural Networks via Restricted Adversarial Distillation Zhicong Yan Shenghong Li Ruijie Zhao Yuan Tian Yuanyuan Zhao AAML 69 12 0 13 Jun 2023
Deep Classifier Mimicry without Data Access Steven Braun Martin Mundt Kristian Kersting DiffM 50 4 0 03 Jun 2023
Incremental Learning for Heterogeneous Structure Segmentation in Brain Tumor MRI Xiaofeng Liu Helen A. Shih Fangxu Xing E. Santarnecchi Xiaofeng Liu Jonghye Woo CLL 84 5 0 30 May 2023
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models Zechun Liu Barlas Oğuz Changsheng Zhao Ernie Chang Pierre Stock Yashar Mehdad Yangyang Shi Raghuraman Krishnamoorthi Vikas Chandra MQ 111 208 0 29 May 2023
Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation? Zheng Li Yuxuan Li Penghai Zhao Renjie Song Xiang Li Jian Yang 92 20 0 22 May 2023
Lion: Adversarial Distillation of Proprietary Large Language Models Yuxin Jiang Chunkit Chan Yin Hua Wei Wang ALM 103 25 0 22 May 2023
Collaborative Chinese Text Recognition with Personalized Federated Learning Shangchao Su Haiyang Yu Bin Li Xiangyang Xue FedML 53 0 0 09 May 2023
BiRT: Bio-inspired Replay in Vision Transformers for Continual Learning Kishaan Jeeveswaran Prashant Shivaram Bhat Bahram Zonooz Elahe Arani CLL 84 22 0 08 May 2023
Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehicles Xiaoliang Ju Yiyang Sun Yiming Hao Yikang Li Yu Qiao Hongsheng Li 49 1 0 19 Apr 2023
ID2image: Leakage of non-ID information into face descriptors and inversion from descriptors to images Mingrui Li W. Smith P. Huber CVBM GAN 35 2 0 15 Apr 2023
Continual Source-Free Unsupervised Domain Adaptation Waqar Ahmed Pietro Morerio Vittorio Murino TTA CLL 83 2 0 14 Apr 2023
MASIL: Towards Maximum Separable Class Representation for Few Shot Class Incremental Learning Anant Khandelwal CLL 64 0 0 08 Apr 2023
Projected Latent Distillation for Data-Agnostic Consolidation in Distributed Continual Learning Antonio Carta Andrea Cossu Vincenzo Lomonaco D. Bacciu Joost van de Weijer FedML 52 5 0 28 Mar 2023
A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts Jian Liang Ran He Tien-Ping Tan OOD VLM TTA 138 242 0 27 Mar 2023
Remind of the Past: Incremental Learning with Analogical Prompts Zhiheng Ma Xiaopeng Hong Beinan Liu Yabin Wang Pinyue Guo Huiyun Li CLL 84 1 0 24 Mar 2023
Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation Yuzheng Wang Zhaoyu Chen Dingkang Yang Pinxue Guo Kaixun Jiang Wenqiang Zhang Lizhe Qi AAML 60 6 0 21 Mar 2023
Non-Exemplar Online Class-incremental Continual Learning via Dual-prototype Self-augment and Refinement Fushuo Huo Wenchao Xu Jingcai Guo Yining Qi Yunfeng Fan Song Guo CLL 132 16 0 20 Mar 2023
Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learning Zixuan Hu Li Shen Zhenyi Wang Tongliang Liu Chun Yuan Dacheng Tao 129 4 0 20 Mar 2023
A Unified Continual Learning Framework with General Parameter-Efficient Tuning Qiankun Gao Chen Zhao Yifan Sun Teng Xi Gang Zhang Guohao Li Shuai Liu CLL 114 98 0 17 Mar 2023
Leaping Into Memories: Space-Time Deep Feature Synthesis Alexandros Stergiou Nikos Deligiannis 36 0 0 17 Mar 2023
Detecting Out-of-distribution Examples via Class-conditional Impressions Reappearing Jinggang Chen Xiaoyang Qu Junjie Li Jianzong Wang Ji-guang Wan Jing Xiao OODD 50 4 0 17 Mar 2023
Rethinking White-Box Watermarks on Deep Learning Models under Neural Structural Obfuscation Yifan Yan Xudong Pan Mi Zhang Min Yang AAML 150 16 0 17 Mar 2023
Data-Free Sketch-Based Image Retrieval Abhra Chaudhuri A. Bhunia Yi-Zhe Song Anjan Dutta 75 7 0 14 Mar 2023
Feature-Rich Audio Model Inversion for Data-Free Knowledge Distillation Towards General Sound Classification Zuheng Kang Yayun He Jianzong Wang Junqing Peng Xiaoyang Qu Jing Xiao 38 2 0 14 Mar 2023
TARGET: Federated Class-Continual Learning via Exemplar-Free Distillation Jie M. Zhang Chen Chen Weiming Zhuang Lingjuan Lv CLL FedML 82 54 0 13 Mar 2023
NIFF: Alleviating Forgetting in Generalized Few-Shot Object Detection via Neural Instance Feature Forging Karim Guirguis Johannes Meier George Eskandar Matthias Kayser B. Yang Juergen Beyerer 111 9 0 09 Mar 2023
Learning to Retain while Acquiring: Combating Distribution-Shift in Adversarial Data-Free Knowledge Distillation Gaurav Patel Konda Reddy Mopuri Qiang Qiu 71 28 0 28 Feb 2023
A Comprehensive Survey on Source-free Domain Adaptation Zhiqi Yu Jingjing Li Zhekai Du Lei Zhu Jikang Cheng TTA 129 109 0 23 Feb 2023
Explicit and Implicit Knowledge Distillation via Unlabeled Data Yuzheng Wang Zuhao Ge Zhaoyu Chen Xiangjian Liu Chuang Ma Yunquan Sun Lizhe Qi 110 10 0 17 Feb 2023
Fuzzy Knowledge Distillation from High-Order TSK to Low-Order TSK Xiongtao Zhang Zezong Yin Yunliang Jiang Yizhang Jiang Da-Song Sun Yong-Jin Liu 53 1 0 16 Feb 2023
CodeLMSec Benchmark: Systematically Evaluating and Finding Security Vulnerabilities in Black-Box Code Language Models Hossein Hajipour Keno Hassler Thorsten Holz Lea Schonherr Mario Fritz ELM 99 22 0 08 Feb 2023
Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class Incremental Learning Yibo Yang Haobo Yuan Hefei Ling Zhouchen Lin Philip Torr Dacheng Tao CLL 111 106 0 06 Feb 2023
A Comprehensive Survey of Continual Learning: Theory, Method and Application Liyuan Wang Xingxing Zhang Hang Su Jun Zhu KELM CLL 217 708 0 31 Jan 2023
Learning to Linearize Deep Neural Networks for Secure and Efficient Private Inference Souvik Kundu Shun Lu Yuke Zhang Jacqueline Liu Peter A. Beerel 40 29 0 23 Jan 2023
Source-Free Unsupervised Domain Adaptation: A Survey Yuqi Fang P. Yap W. Lin Hongtu Zhu Mingxia Liu 209 98 0 31 Dec 2022
Fake it till you make it: Learning transferable representations from synthetic ImageNet clones Mert Bulent Sariyildiz Alahari Karteek Diane Larlus Yannis Kalantidis DiffM VLM 100 161 0 16 Dec 2022
Task-Adaptive Saliency Guidance for Exemplar-free Class Incremental Learning Xialei Liu Jiang-Tian Zhai Andrew D. Bagdanov Ke Li Mingg-Ming Cheng CLL 47 5 0 16 Dec 2022
What do Vision Transformers Learn? A Visual Exploration Amin Ghiasi Hamid Kazemi Eitan Borgnia Steven Reich Manli Shu Micah Goldblum A. Wilson Tom Goldstein ViT 88 64 0 13 Dec 2022
DISCO: Adversarial Defense with Local Implicit Functions Chih-Hui Ho Nuno Vasconcelos AAML 125 39 0 11 Dec 2022
Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models Gowthami Somepalli Vasu Singla Micah Goldblum Jonas Geiping Tom Goldstein 92 330 0 07 Dec 2022
Expanding Small-Scale Datasets with Guided Imagination Yifan Zhang Daquan Zhou Bryan Hooi Kaixin Wang Jiashi Feng 152 48 0 25 Nov 2022
Video Test-Time Adaptation for Action Recognition Wei Lin M. Jehanzeb Mirza Mateusz Koziñski Horst Possegger Hilde Kuehne Horst Bischof TTA 84 32 0 24 Nov 2022
CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learning James Smith Leonid Karlinsky V. Gutta Paola Cascante-Bonilla Donghyun Kim Assaf Arbelle Yikang Shen Rogerio Feris Z. Kira CLL VPVLM VLM 98 299 0 23 Nov 2022
ConStruct-VL: Data-Free Continual Structured VL Concepts Learning James Smith Paola Cascante-Bonilla Assaf Arbelle Donghyun Kim Yikang Shen David D. Cox Diyi Yang Z. Kira Rogerio Feris Leonid Karlinsky VLM 141 23 0 17 Nov 2022
A Survey on Computer Vision based Human Analysis in the COVID-19 Era Fevziye Irem Eyiokur Alperen Kantarci M. Erakin Naser Damer Ferda Ofli ... Janez Križaj A. Salah Alexander Waibel Vitomir Štruc H. K. Ekenel 77 21 0 07 Nov 2022