Dataset Distillation by Matching Training Trajectories

22 March 2022

Antonio Torralba

Jun-Yan Zhu

Papers citing "Dataset Distillation by Matching Training Trajectories"

50 / 259 papers shown

Title
MetaDD: Boosting Dataset Distillation with Neural Network Architecture-Invariant Generalization Yunlong Zhao Xiaoheng Deng Xiu Su Hongyan Xu Xiuxing Li Yijing Liu Shan You FedML DD 31 1 0 07 Oct 2024
Towards Understanding and Enhancing Security of Proof-of-Training for DNN Model Ownership Verification Yijia Chang Hanrui Jiang Chao Lin Xinyi Huang Jian Weng AAML 34 0 0 06 Oct 2024
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks S. Joshi Jiayi Ni Baharan Mirzasoleiman DD 72 2 0 03 Oct 2024
DRUPI: Dataset Reduction Using Privileged Information Shaobo Wang Yantai Yang Shuaiyu Zhang Chenghao Sun Weiya Li Xuming Hu Linfeng Zhang 37 0 0 02 Oct 2024
Diversity-Driven Synthesis: Enhancing Dataset Distillation through Directed Weight Adjustment Jiawei Du Xin Zhang Juncheng Hu Wenxin Huang Joey Tianyi Zhou DD 33 6 0 26 Sep 2024
Dataset Distillation-based Hybrid Federated Learning on Non-IID Data Xiufang Shi Wei Zhang Mincheng Wu Guangyi Liu Z. Wen Shibo He Tejal Shah R. Ranjan DD FedML 32 1 0 26 Sep 2024
Label-Augmented Dataset Distillation Seoungyoon Kang Youngsun Lim Hyunjung Shim DD 35 2 0 24 Sep 2024
Towards Model-Agnostic Dataset Condensation by Heterogeneous Models Jun-Yeong Moon Jung Uk Kim Gyeong-Moon Park DD 33 1 0 22 Sep 2024
Data-Efficient Generation for Dataset Distillation Zhe Li Weitong Zhang Sarah Cechnicka Bernhard Kainz DD 42 0 0 05 Sep 2024
Dataset Distillation from First Principles: Integrating Core Information Extraction and Purposeful Learning Vyacheslav Kungurtsev Yuanfang Peng Jianyang Gu Saeed Vahidian Anthony Quinn Fadwa Idlahcen Yiran Chen FedML DD 47 2 0 02 Sep 2024
UDD: Dataset Distillation via Mining Underutilized Regions Shiguang Wang Zhongyu Zhang Jian Cheng DD 36 0 0 29 Aug 2024
Condensed Sample-Guided Model Inversion for Knowledge Distillation Kuluhan Binici Shivam Aggarwal Cihan Acar N. Pham K. Leman Gim Hee Lee Tulika Mitra 49 1 0 25 Aug 2024
Distilling Long-tailed Datasets Zhenghao Zhao Haoxuan Wang Yuzhang Shang Kai Wang Yan Yan DD 48 2 0 24 Aug 2024
Not All Samples Should Be Utilized Equally: Towards Understanding and Improving Dataset Distillation Shaobo Wang Yantai Yang Qilong Wang Kaixin Li Linfeng Zhang Junchi Yan DD 51 4 0 22 Aug 2024
Generative Dataset Distillation Based on Diffusion Model Duo Su Junjie Hou Guang Li Ren Togo Rui Song Takahiro Ogawa Miki Haseyama VGen DD 32 4 0 16 Aug 2024
Heavy Labels Out! Dataset Distillation with Label Space Lightening Ruonan Yu Songhua Liu Zigeng Chen Jingwen Ye Xinchao Wang DD 39 1 0 15 Aug 2024
Breaking Class Barriers: Efficient Dataset Distillation via Inter-Class Feature Compensator Xin Zhang Jiawei Du Ping Liu Joey Tianyi Zhou DD 50 2 0 13 Aug 2024
Prioritize Alignment in Dataset Distillation Zekai Li Ziyao Guo Wangbo Zhao Tianle Zhang Zhi-Qi Cheng ... Kaipeng Zhang A. Sajedi Konstantinos N Plataniotis Kai Wang Yang You DD 43 2 0 06 Aug 2024
One-Shot Collaborative Data Distillation William Holland Chandra Thapa Sarah Ali Siddiqui Wei Shao S. Çamtepe DD FedML 32 0 0 05 Aug 2024
Scaling Backwards: Minimal Synthetic Pre-training? Ryo Nakamura Ryu Tadokoro Ryosuke Yamada Tim Puhlfürß Iro Laina Christian Rupprecht Walid Maalej Rio Yokota Hirokatsu Kataoka DD 22 2 0 01 Aug 2024
Dataset Distillation for Offline Reinforcement Learning Jonathan Light Yuanzhe Liu Ziniu Hu DD 31 2 0 29 Jul 2024
Synthetic Image Learning: Preserving Performance and Preventing Membership Inference Attacks Eugenio Lomurno Matteo Matteucci MedIm 51 3 0 22 Jul 2024
D $^4$ M: Dataset Distillation via Disentangled Diffusion Model Duo Su Junjie Hou Weizhi Gao Yingjie Tian Bowen Tang DD 46 18 0 21 Jul 2024
Enhancing High-Energy Particle Physics Collision Analysis through Graph Data Attribution Techniques A. Verdone A. Devoto C. Sebastiani J. Carmignani M. D’Onofrio S. Giagu S. Scardapane M. Panella 43 0 0 20 Jul 2024
Dataset Distillation by Automatic Training Trajectories Dai Liu Jindong Gu Hu Cao Carsten Trinitis Martin Schulz DD 41 10 0 19 Jul 2024
DDFAD: Dataset Distillation Framework for Audio Data Wenbo Jiang Rui Zhang Hongwei Li Xiaoyuan Liu Haomiao Yang Shui Yu DD 40 2 0 15 Jul 2024
FYI: Flip Your Images for Dataset Distillation Byunggwan Son Youngmin Oh Donghyeon Baek Bumsub Ham DD 41 3 0 11 Jul 2024
Dataset Quantization with Active Learning based Adaptive Sampling Zhenghao Zhao Yuzhang Shang Junyi Wu Yan Yan DD 42 4 0 09 Jul 2024
Tracing Back the Malicious Clients in Poisoning Attacks to Federated Learning Yuqi Jia Minghong Fang Hongbin Liu Jinghuai Zhang Neil Zhenqiang Gong AAML 32 1 0 09 Jul 2024
Towards Stable and Storage-efficient Dataset Distillation: Matching Convexified Trajectory Wenliang Zhong Haoyu Tang Qinghai Zheng Mingzhu Xu Yupeng Hu Liqiang Nie DD 51 2 0 28 Jun 2024
Speech Emotion Recognition under Resource Constraints with Data Distillation Yi Chang Zhao Ren Zhonghao Zhao Thanh Tam Nguyen Kun Qian Tanja Schultz Björn W. Schuller 31 0 0 21 Jun 2024
Behaviour Distillation Andrei Lupu Chris Xiaoxuan Lu Jarek Liesen R. T. Lange Jakob Foerster DD 41 4 0 21 Jun 2024
A Label is Worth a Thousand Images in Dataset Distillation Tian Qin Zhiwei Deng David Alvarez-Melis DD 91 10 0 15 Jun 2024
Dataset Condensation with Latent Quantile Matching Wei Wei Tom De Schepper Kevin Mets DD 34 2 0 14 Jun 2024
Evolution-aware VAriance (EVA) Coreset Selection for Medical Image Classification Yuxin Hong Xiao Zhang Xin Zhang Joey Tianyi Zhou 45 2 0 09 Jun 2024
Hierarchical Features Matter: A Deep Exploration of Progressive Parameterization Method for Dataset Distillation Xinhao Zhong Hao Fang Bin Chen Xulin Gu Tao Dai Meikang Qiu Shu-Tao Xia DD 33 0 0 09 Jun 2024
Mitigating Bias in Dataset Distillation Justin Cui Ruochen Wang Yuanhao Xiong Cho-Jui Hsieh DD 39 1 0 06 Jun 2024
What is Dataset Distillation Learning? William Yang Ye Zhu Zhiwei Deng Olga Russakovsky DD 44 3 0 06 Jun 2024
Low-Rank Similarity Mining for Multimodal Dataset Distillation Yue Xu Zhilin Lin Yusong Qiu Cewu Lu Yong-Lu Li DD 47 4 0 06 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 33 8 0 05 Jun 2024
One-Shot Federated Learning with Bayesian Pseudocoresets Tim d'Hondt Mykola Pechenizkiy Robert Peharz FedML 37 0 0 04 Jun 2024
CondTSF: One-line Plugin of Dataset Condensation for Time Series Forecasting Jianrong Ding Zhanyu Liu Guanjie Zheng Haiming Jin Linghe Kong AI4TS DD 42 3 0 04 Jun 2024
BACON: Bayesian Optimal Condensation Framework for Dataset Distillation Zheng Zhou Hong Zhao Guangliang Cheng Xiangtai Li Shuchang Lyu Wenquan Feng Qi Zhao DD 47 0 0 03 Jun 2024
DANCE: Dual-View Distribution Alignment for Dataset Condensation Hansong Zhang Shikun Li Fanzhao Lin Weiping Wang Zhenxing Qian Shiming Ge DD 42 4 0 03 Jun 2024
SelMatch: Effectively Scaling Up Dataset Distillation via Selection-Based Initialization and Partial Updates by Trajectory Matching Yongmin Lee Hye Won Chung 31 6 0 28 May 2024
Calibrated Dataset Condensation for Faster Hyperparameter Search Mucong Ding Yuancheng Xu Tahseen Rabbani Xiaoyu Liu Brian J Gravelle Teresa M. Ranadive Tai-Ching Tuan Furong Huang DD 34 0 0 27 May 2024
Enabling On-Device Learning via Experience Replay with Efficient Dataset Condensation Gelei Xu Ningzhi Tang Jun Xia Wei Jin Yiyu Shi DD 52 0 0 25 May 2024
Efficiency for Free: Ideal Data Are Transportable Representations Peng Sun Yi Jiang Tao Lin DD 44 0 0 23 May 2024
GCondenser: Benchmarking Graph Condensation Yilun Liu Ruihong Qiu Zi Huang DD 38 8 0 23 May 2024
GIFT: Unlocking Full Potential of Labels in Distilled Dataset at Near-zero Cost Xinyi Shang Peng Sun Tao Lin 50 2 0 23 May 2024