Data Distillation Can Be Like Vodka: Distilling More Times For Better
Quality

Data Distillation Can Be Like Vodka: Distilling More Times For Better Quality

10 October 2023

Baharan Mirzasoleiman

ArXiv (abs)PDF HTML

Papers citing "Data Distillation Can Be Like Vodka: Distilling More Times For Better Quality"

14 / 14 papers shown

Title
Emphasizing Discriminative Features for Dataset Distillation in Complex Scenarios Kai Wang Zekai Li Zhi-Qi Cheng Samir Khaki A. Sajedi Ramakrishna Vedantam Konstantinos N. Plataniotis Alexander G. Hauptmann Yang You DD 128 5 0 22 Oct 2024
Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks S. Joshi Jiayi Ni Baharan Mirzasoleiman DD 169 2 0 03 Oct 2024
ATOM: Attention Mixer for Efficient Dataset Distillation Samir Khaki A. Sajedi Kai Wang Lucy Z. Liu Y. Lawryshyn Konstantinos N. Plataniotis 125 3 0 02 May 2024
Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching Ziyao Guo Kai Wang George Cazenavette Hui Li Kaipeng Zhang Yang You DD 79 74 0 09 Oct 2023
Towards Sustainable Learning: Coresets for Data-efficient Deep Learning Yu Yang Hao Kang Baharan Mirzasoleiman 76 35 0 02 Jun 2023
Adaptive Second Order Coresets for Data-efficient Machine Learning Omead Brandon Pooladzandi David Davini Baharan Mirzasoleiman 94 64 0 28 Jul 2022
Dataset Distillation using Neural Feature Regression Yongchao Zhou E. Nezhadarya Jimmy Ba DD FedML 83 157 0 01 Jun 2022
Dataset Condensation via Efficient Synthetic-Data Parameterization Jang-Hyun Kim Jinuk Kim Seong Joon Oh Sangdoo Yun Hwanjun Song Joonhyun Jeong Jung-Woo Ha Hyun Oh Song DD 486 168 0 30 May 2022
Dataset Distillation by Matching Training Trajectories George Cazenavette Tongzhou Wang Antonio Torralba Alexei A. Efros Jun-Yan Zhu FedML DD 185 393 0 22 Mar 2022
Dataset Condensation with Distribution Matching Bo Zhao Hakan Bilen DD 77 307 0 08 Oct 2021
The Pitfalls of Simplicity Bias in Neural Networks Harshay Shah Kaustav Tamuly Aditi Raghunathan Prateek Jain Praneeth Netrapalli AAML 69 361 0 13 Jun 2020
An Empirical Study of Example Forgetting during Deep Neural Network Learning Mariya Toneva Alessandro Sordoni Rémi Tachet des Combes Adam Trischler Yoshua Bengio Geoffrey J. Gordon 118 741 0 12 Dec 2018
Instance Normalization: The Missing Ingredient for Fast Stylization Dmitry Ulyanov Andrea Vedaldi Victor Lempitsky OOD 177 3,711 0 27 Jul 2016
In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning Behnam Neyshabur Ryota Tomioka Nathan Srebro AI4CE 94 660 0 20 Dec 2014

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.