Data Distillation: A Survey

11 January 2023

Papers citing "Data Distillation: A Survey"

50 / 67 papers shown

Title
Transferable text data distillation by trajectory matching Rong Yao Hailin Hu Yifei Fu Hanting Chen Wenyi Fang Fanyi Du Kai Han Yunhe Wang 26 0 0 14 Apr 2025
Identifying Key Challenges of Hardness-Based Resampling Pawel Pukowski Venet Osmani 33 0 0 09 Apr 2025
scDD: Latent Codes Based scRNA-seq Dataset Distillation with Foundation Model Knowledge Zhen Yu Jianan Han Yang Liu Qingchao Chen 62 0 0 06 Mar 2025
Distilling Dataset into Neural Field DongHyeok Shin Heesun Bae Gyuwon Sim Wanmo Kang Il-Chul Moon DD 68 1 0 05 Mar 2025
Understanding Dataset Distillation via Spectral Filtering Deyu Bo Songhua Liu Xinchao Wang DD 75 0 0 03 Mar 2025
Graph Condensation: A Survey Xin Gao Junliang Yu Wei Jiang Tong Chen Wentao Zhang Hongzhi Yin DD 83 19 0 28 Jan 2025
Offline Behavior Distillation Shiye Lei Sen Zhang Dacheng Tao OffRL 36 0 0 30 Oct 2024
Federated Time Series Generation on Feature and Temporally Misaligned Data Chenrui Fan Zhi Wen Soi Aditya Shankar Abele Malan Lydia Y. Chen FedML AI4TS 28 0 0 28 Oct 2024
What's New in My Data? Novelty Exploration via Contrastive Generation Masaru Isonuma Ivan Titov 28 0 0 18 Oct 2024
Diversity-Driven Synthesis: Enhancing Dataset Distillation through Directed Weight Adjustment Jiawei Du Xin Zhang Juncheng Hu Wenxin Huang Joey Tianyi Zhou DD 31 6 0 26 Sep 2024
Label-Augmented Dataset Distillation Seoungyoon Kang Youngsun Lim Hyunjung Shim DD 30 2 0 24 Sep 2024
Data Pruning via Separability, Integrity, and Model Uncertainty-Aware Importance Sampling Steven Grosz Rui Zhao Rajeev Ranjan Hongcheng Wang Manoj Aggarwal Gérard Medioni Anil Jain VLM 24 0 0 20 Sep 2024
Applications of Knowledge Distillation in Remote Sensing: A Survey Yassine Himeur N. Aburaed O. Elharrouss Iraklis Varlamis Shadi Atalla W. Mansoor Hussain Al Ahmad 42 4 0 18 Sep 2024
Data-Efficient Generation for Dataset Distillation Zhe Li Weitong Zhang Sarah Cechnicka Bernhard Kainz DD 36 0 0 05 Sep 2024
Dataset Distillation from First Principles: Integrating Core Information Extraction and Purposeful Learning Vyacheslav Kungurtsev Yuanfang Peng Jianyang Gu Saeed Vahidian Anthony Quinn Fadwa Idlahcen Yiran Chen FedML DD 35 2 0 02 Sep 2024
Distilling Long-tailed Datasets Zhenghao Zhao Haoxuan Wang Yuzhang Shang Kai Wang Yan Yan DD 46 2 0 24 Aug 2024
Not All Samples Should Be Utilized Equally: Towards Understanding and Improving Dataset Distillation Shaobo Wang Yantai Yang Qilong Wang Kaixin Li Linfeng Zhang Junchi Yan DD 48 4 0 22 Aug 2024
Generative Dataset Distillation Based on Diffusion Model Duo Su Junjie Hou Guang Li Ren Togo Rui Song Takahiro Ogawa Miki Haseyama VGen DD 30 4 0 16 Aug 2024
Breaking Class Barriers: Efficient Dataset Distillation via Inter-Class Feature Compensator Xin Zhang Jiawei Du Ping Liu Joey Tianyi Zhou DD 44 2 0 13 Aug 2024
One-Shot Collaborative Data Distillation William Holland Chandra Thapa Sarah Ali Siddiqui Wei Shao S. Çamtepe DD FedML 32 0 0 05 Aug 2024
D $^4$ M: Dataset Distillation via Disentangled Diffusion Model Duo Su Junjie Hou Weizhi Gao Yingjie Tian Bowen Tang DD 41 18 0 21 Jul 2024
Dataset Dictionary Learning in a Wasserstein Space for Federated Domain Adaptation Eduardo Fernandes Montesuma F. E. Castellon Fred-Maurice Ngole-Mboula Aurélien Mayoue Antoine Souloumiac Cédric Gouy-Pailler 39 1 0 16 Jul 2024
Speech Emotion Recognition under Resource Constraints with Data Distillation Yi Chang Zhao Ren Zhonghao Zhao Thanh Tam Nguyen Kun Qian Tanja Schultz Björn W. Schuller 24 0 0 21 Jun 2024
Behaviour Distillation Andrei Lupu Chris Xiaoxuan Lu Jarek Liesen R. T. Lange Jakob Foerster DD 39 4 0 21 Jun 2024
A Label is Worth a Thousand Images in Dataset Distillation Tian Qin Zhiwei Deng David Alvarez-Melis DD 86 10 0 15 Jun 2024
Dataset Condensation with Latent Quantile Matching Wei Wei Tom De Schepper Kevin Mets DD 29 2 0 14 Jun 2024
CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models Xuechen Liang Meiling Tao Yinghui Xia Yiting Xie Jun Wang JingSong Yang LLMAG 31 12 0 02 Apr 2024
Progressive trajectory matching for medical dataset distillation Zhennaan Yu Yang Liu Qingchao Chen DD 40 4 0 20 Mar 2024
Distilling Datasets Into Less Than One Image Asaf Shul Eliahu Horwitz Yedid Hoshen DD 34 2 0 18 Mar 2024
Towards Adversarially Robust Dataset Distillation by Curvature Regularization Eric Xue Yijiang Li Haoyang Liu Yifan Shen Haohan Wang Haohan Wang DD 61 8 0 15 Mar 2024
Distributional Dataset Distillation with Subtask Decomposition Tian Qin Zhiwei Deng David Alvarez-Melis DD 98 4 0 01 Mar 2024
Comparing Importance Sampling Based Methods for Mitigating the Effect of Class Imbalance Indu Panigrahi Richard Zhu 26 1 0 28 Feb 2024
Improve Cross-Architecture Generalization on Dataset Distillation Binglin Zhou Linhao Zhong Wentao Chen DD 37 4 0 20 Feb 2024
How to Train Data-Efficient LLMs Noveen Sachdeva Benjamin Coleman Wang-Cheng Kang Jianmo Ni Lichan Hong Ed H. Chi James Caverlee Julian McAuley D. Cheng 26 51 0 15 Feb 2024
Importance-Aware Adaptive Dataset Distillation Guang Li Ren Togo Takahiro Ogawa Miki Haseyama DD 26 6 0 29 Jan 2024
A Comprehensive Survey on Graph Reduction: Sparsification, Coarsening, and Condensation Mohammad Hashemi Shengbo Gong Juntong Ni Wenqi Fan B. A. Prakash Wei-dong Jin DD 64 39 0 29 Jan 2024
Towards Model-Based Data Acquisition for Subjective Multi-Task NLP Problems Kamil Kanclerz Julita Bielaniewicz Marcin Gruza Jan Kocoñ Stanislaw Wo'zniak Przemyslaw Kazienko 26 3 0 13 Dec 2023
Discovering Galaxy Features via Dataset Distillation Haowen Guan Xuan Zhao Zishi Wang Zhiyang Li Julia Kempe DD 21 2 0 29 Nov 2023
Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching Shitong Shao Zeyuan Yin Muxin Zhou Xindong Zhang Zhiqiang Shen DD 27 21 0 29 Nov 2023
Dataset Distillation in Latent Space Yuxuan Duan Jianfu Zhang Liqing Zhang DD 37 6 0 27 Nov 2023
Frequency Domain-based Dataset Distillation DongHyeok Shin Seungjae Shin Il-Chul Moon DD 35 19 0 15 Nov 2023
Embarassingly Simple Dataset Distillation Yunzhen Feng Ramakrishna Vedantam Julia Kempe DD 36 5 0 13 Nov 2023
Sequential Subset Matching for Dataset Distillation Jiawei Du Qin Shi Joey Tianyi Zhou DD 33 27 0 02 Nov 2023
Data Optimization in Deep Learning: A Survey Ou Wu Rujing Yao 32 1 0 25 Oct 2023
AST: Effective Dataset Distillation through Alignment with Smooth and High-Quality Expert Trajectories Jiyuan Shen Wenzhuo Yang Kwok-Yan Lam DD 29 1 0 16 Oct 2023
Farzi Data: Autoregressive Data Distillation Noveen Sachdeva Zexue He Wang-Cheng Kang Jianmo Ni D. Cheng Julian McAuley DD 19 3 0 15 Oct 2023
Multi-Source Domain Adaptation meets Dataset Distillation through Dataset Dictionary Learning Eduardo Fernandes Montesuma Fred-Maurice Ngole-Mboula Antoine Souloumiac DD 17 3 0 14 Sep 2023
Relax and penalize: a new bilevel approach to mixed-binary hyperparameter optimization M. D. Santis Jordan Frécon Francesco Rinaldi Saverio Salzo Martin Schmidt Martin Schmidt 53 0 0 21 Aug 2023
Vision-Language Dataset Distillation Xindi Wu Byron Zhang Zhiwei Deng Olga Russakovsky DD VLM 28 8 0 15 Aug 2023
Exploring Multilingual Text Data Distillation Shivam Sahni Harsh Patel DD 11 2 0 09 Aug 2023