Accelerating Dataset Distillation via Model Augmentation

12 December 2022

Lei Zhang

Caiwen Ding

Dongkuan Xu

Papers citing "Accelerating Dataset Distillation via Model Augmentation"

50 / 60 papers shown

Title
Leveraging Multi-Modal Information to Enhance Dataset Distillation Zhe Li Hadrien Reynaud Bernhard Kainz DD 84 0 0 13 May 2025
Towards Efficient Deep Hashing Retrieval: Condensing Your Data via Feature-Embedding Matching Tao Feng Jie Zhang Peizheng Wang Zhijie Wang Shengyuan Pang DD 108 0 0 29 May 2023
Delving into the Adversarial Robustness of Federated Learning Jie M. Zhang Yue Liu Chen Chen Lingjuan Lyu Shuang Wu Shouhong Ding Chao Wu FedML 66 37 0 19 Feb 2023
Compressed Gastric Image Generation Based on Soft-Label Dataset Distillation for Medical Data Sharing Guang Li Ren Togo Takahiro Ogawa Miki Haseyama DD 58 42 0 29 Sep 2022
Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environments Rui Song Dai Liu Da Chen Andreas Festag Carsten Trinitis Martin Schulz Alois C. Knoll DD FedML 82 64 0 24 Aug 2022
Delving into Effective Gradient Matching for Dataset Condensation Zixuan Jiang Jiaqi Gu Mingjie Liu David Z. Pan DD 57 41 0 30 Jul 2022
FedDM: Iterative Distribution Matching for Communication-Efficient Federated Learning Yuanhao Xiong Ruochen Wang Minhao Cheng Felix X. Yu Cho-Jui Hsieh FedML DD 72 84 0 20 Jul 2022
DC-BENCH: Dataset Condensation Benchmark Justin Cui Ruochen Wang Si Si Cho-Jui Hsieh DD 75 75 0 20 Jul 2022
Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation G. Nam Hyungi Lee Byeongho Heo Juho Lee UQCV FedML 50 7 0 30 Jun 2022
Graph Condensation via Receptive Field Distribution Matching Mengyang Liu Shanchuan Li Xinshi Chen Le Song DD 115 51 0 28 Jun 2022
Sample Condensation in Online Continual Learning Mattia Sangermano Antonio Carta Andrea Cossu D. Bacciu DD 60 43 0 23 Jun 2022
Condensing Graphs via One-Step Gradient Matching Wei Jin Xianfeng Tang Haoming Jiang Zheng Li Danqing Zhang Jiliang Tang Bin Ying DD 81 110 0 15 Jun 2022
Privacy for Free: How does Dataset Condensation Help Privacy? Tian Dong Bo Zhao Lingjuan Lyu DD 78 116 0 01 Jun 2022
Dataset Condensation via Efficient Synthetic-Data Parameterization Jang-Hyun Kim Jinuk Kim Seong Joon Oh Sangdoo Yun Hwanjun Song Joonhyun Jeong Jung-Woo Ha Hyun Oh Song DD 472 168 0 30 May 2022
FedSynth: Gradient Compression via Synthetic Data in Federated Learning Shengyuan Hu Jack Goetz Kshitiz Malik Hongyuan Zhan Zhe Liu Yue Liu DD FedML 67 39 0 04 Apr 2022
Dataset Distillation by Matching Training Trajectories George Cazenavette Tongzhou Wang Antonio Torralba Alexei A. Efros Jun-Yan Zhu FedML DD 172 388 0 22 Mar 2022
Federated Class-Incremental Learning Jiahua Dong Lixu Wang Zhen Fang Gan Sun Shichao Xu Tianlin Li Qi Zhu CLL FedML 96 181 0 22 Mar 2022
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time Mitchell Wortsman Gabriel Ilharco S. Gadre Rebecca Roelofs Raphael Gontijo-Lopes ... Hongseok Namkoong Ali Farhadi Y. Carmon Simon Kornblith Ludwig Schmidt MoMe 122 981 1 10 Mar 2022
Dataset Condensation with Contrastive Signals Saehyung Lee Sanghyuk Chun Sangwon Jung Sangdoo Yun Sung-Hoon Yoon DD 44 99 0 07 Feb 2022
When less is more: Simplifying inputs aids neural network understanding R. Schirrmeister Rosanne Liu Sara Hooker T. Ball 94 5 0 14 Jan 2022
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 451 7,739 0 11 Nov 2021
Diversity Matters When Learning From Ensembles G. Nam Jongmin Yoon Yoonho Lee Juho Lee UQCV FedML VLM 81 36 0 27 Oct 2021
No One Representation to Rule Them All: Overlapping Features of Training Methods Raphael Gontijo-Lopes Yann N. Dauphin E. D. Cubuk 69 64 0 20 Oct 2021
Graph Condensation for Graph Neural Networks Wei Jin Lingxiao Zhao Shichang Zhang Yozen Liu Jiliang Tang Neil Shah DD AI4CE 85 158 0 14 Oct 2021
Dataset Condensation with Distribution Matching Bo Zhao Hakan Bilen DD 75 304 0 08 Oct 2021
Dataset Distillation with Infinitely Wide Convolutional Networks Timothy Nguyen Roman Novak Lechao Xiao Jaehoon Lee DD 90 234 0 27 Jul 2021
Data Distillation for Text Classification Chak Tou Leong Wenjie Li DD 140 30 0 17 Apr 2021
Soft-Label Anonymous Gastric X-ray Image Distillation Guang Li Ren Togo Takahiro Ogawa Miki Haseyama DD 142 54 0 07 Apr 2021
Distilled Replay: Overcoming Forgetting through Synthetic Samples Andrea Rosasco Antonio Carta Andrea Cossu Vincenzo Lomonaco D. Bacciu DD 49 49 0 29 Mar 2021
Dataset Condensation with Differentiable Siamese Augmentation Bo Zhao Hakan Bilen DD 260 300 0 16 Feb 2021
Dataset Meta-Learning from Kernel Ridge-Regression Timothy Nguyen Zhourung Chen Jaehoon Lee DD 129 244 0 30 Oct 2020
Federated Learning via Synthetic Data Jack Goetz Ambuj Tewari FedML DD 52 72 0 11 Aug 2020
Flexible Dataset Distillation: Learn Labels Instead of Images Ondrej Bohdal Yongxin Yang Timothy M. Hospedales DD 78 110 0 15 Jun 2020
Dataset Condensation with Gradient Matching Bo Zhao Konda Reddy Mopuri Hakan Bilen DD 111 497 0 10 Jun 2020
On the Generalization Effects of Linear Transformations in Data Augmentation Sen Wu Hongyang R. Zhang Gregory Valiant Christopher Ré 54 77 0 02 May 2020
Reducing catastrophic forgetting with learning on synthetic data Wojciech Masarczyk Ivona Tautkute DD 53 36 0 29 Apr 2020
What Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions Segmentation Jiahua Dong Yang Cong Gan Sun Bineng Zhong Xiaowei Xu 55 139 0 24 Apr 2020
Meta-Learning in Neural Networks: A Survey Timothy M. Hospedales Antreas Antoniou P. Micaelli Amos Storkey OOD 386 1,977 0 11 Apr 2020
Time Series Data Augmentation for Deep Learning: A Survey Qingsong Wen Liang Sun Fan Yang Xiaomin Song Jing Gao Xue Wang Huan Xu AI4TS 58 641 0 27 Feb 2020
The Early Phase of Neural Network Training Jonathan Frankle D. Schwab Ari S. Morcos 82 172 0 24 Feb 2020
A study of local optima for learning feature interactions using neural networks Yangzi Guo Adrian Barbu 106 1 0 11 Feb 2020
Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training Data F. Such Aditya Rawal Joel Lehman Kenneth O. Stanley Jeff Clune DD 64 156 0 17 Dec 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 196 12,074 0 13 Nov 2019
Soft-Label Dataset Distillation and Text Dataset Distillation Ilia Sucholutsky Matthias Schonlau DD 126 135 0 06 Oct 2019
Similarity-Preserving Knowledge Distillation Frederick Tung Greg Mori 118 976 0 23 Jul 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 155 2,399 0 13 Jun 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks Mingxing Tan Quoc V. Le 3DV MedIm 137 18,115 0 28 May 2019
Gradient Descent Happens in a Tiny Subspace Guy Gur-Ari Daniel A. Roberts Ethan Dyer 93 233 0 12 Dec 2018
Dataset Distillation Tongzhou Wang Jun-Yan Zhu Antonio Torralba Alexei A. Efros DD 78 295 0 27 Nov 2018
Dynamic Few-Shot Visual Learning without Forgetting Spyros Gidaris N. Komodakis VLM 59 1,130 0 25 Apr 2018