Scaling Up Dataset Distillation to ImageNet-1K with Constant Memory

19 November 2022

Papers citing "Scaling Up Dataset Distillation to ImageNet-1K with Constant Memory"

50 / 101 papers shown

Title
SelMatch: Effectively Scaling Up Dataset Distillation via Selection-Based Initialization and Partial Updates by Trajectory Matching Yongmin Lee Hye Won Chung 31 7 0 28 May 2024
Efficiency for Free: Ideal Data Are Transportable Representations Peng Sun Yi Jiang Tao Lin DD 44 0 0 23 May 2024
GIFT: Unlocking Full Potential of Labels in Distilled Dataset at Near-zero Cost Xinyi Shang Peng Sun Tao Lin 53 2 0 23 May 2024
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors Chun-Yin Huang Kartik Srinivas Xin Zhang Xiaoxiao Li DD 58 6 0 19 May 2024
ATOM: Attention Mixer for Efficient Dataset Distillation Samir Khaki A. Sajedi Kai Wang Lucy Z. Liu Y. Lawryshyn Konstantinos N. Plataniotis 50 3 0 02 May 2024
DiLM: Distilling Dataset into Language Model for Text-level Dataset Distillation Aru Maekawa Satoshi Kosugi Kotaro Funakoshi Manabu Okumura DD 49 10 0 30 Mar 2024
Exploring the Impact of Dataset Bias on Dataset Distillation Yao Lu Jianyang Gu Xuguang Chen Saeed Vahidian Qi Xuan DD 43 3 0 24 Mar 2024
DD-RobustBench: An Adversarial Robustness Benchmark for Dataset Distillation Yifan Wu Jiawei Du Ping Liu Yuewei Lin Wenqing Cheng Wei-ping Xu DD AAML 40 5 0 20 Mar 2024
Distilling Datasets Into Less Than One Image Asaf Shul Eliahu Horwitz Yedid Hoshen DD 37 2 0 18 Mar 2024
Towards Adversarially Robust Dataset Distillation by Curvature Regularization Eric Xue Yijiang Li Haoyang Liu Yifan Shen Haohan Wang Haohan Wang DD 61 8 0 15 Mar 2024
Distilling the Knowledge in Data Pruning Emanuel Ben-Baruch Adam Botach Igor Kviatkovsky Manoj Aggarwal Gérard Medioni 38 1 0 12 Mar 2024
One Category One Prompt: Dataset Distillation using Diffusion Models Ali Abbasi Ashkan Shahbazi Hamed Pirsiavash Soheil Kolouri DiffM DD 40 3 0 11 Mar 2024
Multisize Dataset Condensation Yang He Lingao Xiao Qiufeng Wang Ivor Tsang AI4CE DD 39 11 0 10 Mar 2024
Latent Dataset Distillation with Diffusion Models Brian B. Moser Federico Raue Sebastián M. Palacio Stanislav Frolov Andreas Dengel DD 54 13 0 06 Mar 2024
Distributional Dataset Distillation with Subtask Decomposition Tian Qin Zhiwei Deng David Alvarez-Melis DD 98 4 0 01 Mar 2024
Improve Cross-Architecture Generalization on Dataset Distillation Binglin Zhou Linhao Zhong Wentao Chen DD 39 4 0 20 Feb 2024
Data-Driven Estimation of the False Positive Rate of the Bayes Binary Classifier via Soft Labels Minoh Jeong Martina Cardone Alex Dytso 31 0 0 27 Jan 2024
MIM4DD: Mutual Information Maximization for Dataset Distillation Yuzhang Shang Zhihang Yuan Yan Yan DD 40 14 0 27 Dec 2023
Dataset Distillation via Adversarial Prediction Matching Mingyang Chen Bo Huang Junda Lu Bing Li Yi Wang Minhao Cheng Wei Wang DD 18 5 0 14 Dec 2023
Boosting the Cross-Architecture Generalization of Dataset Distillation through an Empirical Study Lirui Zhao Yuxin Zhang Rongrong Ji Rongrong Ji 32 1 0 09 Dec 2023
On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm Peng Sun Bei Shi Daiwei Yu Tao Lin DD 25 37 0 06 Dec 2023
Dancing with Still Images: Video Distillation via Static-Dynamic Disentanglement Ziyu Wang Yue Xu Cewu Lu Yong-Lu Li DD 41 8 0 01 Dec 2023
Dataset Distillation via the Wasserstein Metric Haoyang Liu Yijiang Li Tiancheng Xing Vibhu Dalal Luwei Li Jingrui He Haohan Wang DD 51 12 0 30 Nov 2023
Discovering Galaxy Features via Dataset Distillation Haowen Guan Xuan Zhao Zishi Wang Zhiyang Li Julia Kempe DD 26 2 0 29 Nov 2023
Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching Shitong Shao Zeyuan Yin Muxin Zhou Xindong Zhang Zhiqiang Shen DD 31 21 0 29 Nov 2023
Dataset Distillation in Latent Space Yuxuan Duan Jianfu Zhang Liqing Zhang DD 45 6 0 27 Nov 2023
Embarassingly Simple Dataset Distillation Yunzhen Feng Ramakrishna Vedantam Julia Kempe DD 36 5 0 13 Nov 2023
Sequential Subset Matching for Dataset Distillation Jiawei Du Qin Shi Qiufeng Wang DD 36 27 0 02 Nov 2023
Data Optimization in Deep Learning: A Survey Ou Wu Rujing Yao 38 1 0 25 Oct 2023
You Only Condense Once: Two Rules for Pruning Condensed Datasets Yang He Lingao Xiao Qiufeng Wang 37 14 0 21 Oct 2023
IDEAL: Influence-Driven Selective Annotations Empower In-Context Learners in Large Language Models Shaokun Zhang Xiaobo Xia Zhaoqing Wang Ling-Hao Chen Jiale Liu Qingyun Wu Tongliang Liu 42 20 0 16 Oct 2023
AST: Effective Dataset Distillation through Alignment with Smooth and High-Quality Expert Trajectories Jiyuan Shen Wenzhuo Yang Kwok-Yan Lam DD 33 1 0 16 Oct 2023
Leveraging Hierarchical Feature Sharing for Efficient Dataset Condensation Haizhong Zheng Jiachen Sun Shutong Wu B. Kailkhura Zhuoqing Mao Chaowei Xiao Atul Prakash DD 27 2 0 11 Oct 2023
Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching Ziyao Guo Kai Wang George Cazenavette Hui Li Kaipeng Zhang Yang You DD 32 64 0 09 Oct 2023
Dataset Condensation via Generative Model David Junhao Zhang Heng Wang Chuhui Xue Rui Yan Wenqing Zhang Song Bai Mike Zheng Shou DD 26 11 0 14 Sep 2023
Vision-Language Dataset Distillation Xindi Wu Byron Zhang Zhiwei Deng Olga Russakovsky DD VLM 33 9 0 15 Aug 2023
Towards Trustworthy Dataset Distillation Shijie Ma Fei Zhu Zhen Cheng Xu-Yao Zhang DD 37 14 0 18 Jul 2023
Image Captions are Natural Prompts for Text-to-Image Models Shiye Lei Hao Chen Senyang Zhang Bo Zhao Dacheng Tao VLM 32 19 0 17 Jul 2023
Squeeze, Recover and Relabel: Dataset Condensation at ImageNet Scale From A New Perspective Zeyuan Yin Eric P. Xing Zhiqiang Shen DD 22 65 0 22 Jun 2023
Large-scale Dataset Pruning with Dynamic Uncertainty Muyang He Shuo Yang Tiejun Huang Bo Zhao 36 25 0 08 Jun 2023
Too Large; Data Reduction for Vision-Language Pre-Training Alex Jinpeng Wang Kevin Qinghong Lin David Junhao Zhang Stan Weixian Lei Mike Zheng Shou VLM 33 24 0 31 May 2023
Distill Gold from Massive Ores: Efficient Dataset Distillation via Critical Samples Selection Yue Xu Yong-Lu Li Kaitong Cui Ziyu Wang Cewu Lu Yu-Wing Tai Chi-Keung Tang DD 35 8 0 28 May 2023
Generalizing Dataset Distillation via Deep Generative Prior George Cazenavette Tongzhou Wang Antonio Torralba Alexei A. Efros Jun-Yan Zhu DD 96 84 0 02 May 2023
InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning Ziheng Qin Kaidi Wang Zangwei Zheng Jianyang Gu Xiang Peng ... Daquan Zhou Lei Shang Baigui Sun Xuansong Xie Yang You 127 47 0 08 Mar 2023
DREAM: Efficient Dataset Distillation by Representative Matching Yanqing Liu Jianyang Gu Kai Wang Zheng Hua Zhu Wei Jiang Yang You DD 39 77 0 28 Feb 2023
Dataset Distillation: A Comprehensive Review Ruonan Yu Songhua Liu Xinchao Wang DD 53 121 0 17 Jan 2023
A Comprehensive Survey of Dataset Distillation Shiye Lei Dacheng Tao DD 31 88 0 13 Jan 2023
Data Distillation: A Survey Noveen Sachdeva Julian McAuley DD 45 73 0 11 Jan 2023
Dataset Condensation via Efficient Synthetic-Data Parameterization Jang-Hyun Kim Jinuk Kim Seong Joon Oh Sangdoo Yun Hwanjun Song Joonhyun Jeong Jung-Woo Ha Hyun Oh Song DD 404 158 0 30 May 2022
Dataset Condensation with Differentiable Siamese Augmentation Bo Zhao Hakan Bilen DD 205 288 0 16 Feb 2021