GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Training

27 February 2021

Krishnateja Killamsetty

Ganesh Ramakrishnan

Papers citing "GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Training"

32 / 32 papers shown

Title
R&B: Domain Regrouping and Data Mixture Balancing for Efficient Foundation Model Training Albert Ge Tzu-Heng Huang John Cooper Avi Trost Ziyi Chu Satya Sai Srinath Namburi GNVV Ziyang Cai Kendall Park Nicholas Roberts Frederic Sala 53 0 0 01 May 2025
A Large-Scale Study on Video Action Dataset Condensation Yang Chen Sheng Guo Bo Zheng Limin Wang DD 81 2 0 13 Mar 2025
UPCORE: Utility-Preserving Coreset Selection for Balanced Unlearning Vaidehi Patil Elias Stengel-Eskin Joey Tianyi Zhou MU CLL 75 2 0 20 Feb 2025
ARISE: Iterative Rule Induction and Synthetic Data Generation for Text Classification Y. Meena Vaibhav Singh Ayush Maheshwari Amrith Krishna Ganesh Ramakrishnan AI4TS 100 0 0 09 Feb 2025
Coreset-Based Task Selection for Sample-Efficient Meta-Reinforcement Learning Donglin Zhan Leonardo F. Toso James Anderson 101 1 0 04 Feb 2025
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models Yulei Qin Yuncheng Yang Pengcheng Guo Gang Li Hang Shao Yuchen Shi Zihan Xu Yun Gu Ke Li Xing Sun ALM 90 12 0 31 Dec 2024
DELIFT: Data Efficient Language model Instruction Fine Tuning Ishika Agarwal Krishnateja Killamsetty Lucian Popa Marina Danilevksy ALM VLM 56 2 0 07 Nov 2024
Compute-Constrained Data Selection Junjie Oscar Yin Alexander M. Rush 39 0 0 21 Oct 2024
Structural-Entropy-Based Sample Selection for Efficient and Effective Learning Tianchi Xie Jiangning Zhu Guozu Ma Minzhi Lin Wei Chen Weikai Yang Shixia Liu 28 0 0 03 Oct 2024
UnifiedNN: Efficient Neural Network Training on the Cloud Xingyu Lou Arthi Padmanabhan Spyridon Mastorakis FedML 43 0 0 02 Aug 2024
CHG Shapley: Efficient Data Valuation and Selection towards Trustworthy Machine Learning Huaiguang Cai FedML TDI 56 1 0 17 Jun 2024
Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models Zachary Ankner Cody Blakeney Kartik K. Sreenivasan Max Marion Matthew L. Leavitt Mansheej Paul 43 24 0 30 May 2024
SelMatch: Effectively Scaling Up Dataset Distillation via Selection-Based Initialization and Partial Updates by Trajectory Matching Yongmin Lee Hye Won Chung 31 6 0 28 May 2024
ATOM: Attention Mixer for Efficient Dataset Distillation Samir Khaki A. Sajedi Kai Wang Lucy Z. Liu Y. Lawryshyn Konstantinos N. Plataniotis 47 3 0 02 May 2024
Is Adversarial Training with Compressed Datasets Effective? Tong Chen Raghavendra Selvan AAML 52 0 0 08 Feb 2024
A Negative Result on Gradient Matching for Selective Backprop Lukas Balles Cédric Archambeau Giovanni Zappella 29 0 0 08 Dec 2023
Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning Xin Zhang Jiawei Du Yunsong Li Weiying Xie Qiufeng Wang 37 7 0 22 Nov 2023
Soft Random Sampling: A Theoretical and Empirical Analysis Xiaodong Cui Ashish R. Mittal Songtao Lu Wei Zhang G. Saon Brian Kingsbury 48 1 0 21 Nov 2023
Anchor Points: Benchmarking Models with Much Fewer Examples Rajan Vivek Kawin Ethayarajh Diyi Yang Douwe Kiela ALM 29 22 0 14 Sep 2023
Optimal Sample Selection Through Uncertainty Estimation and Its Application in Deep Learning Yong Lin Chen Liu Chen Ye Qing Lian Yuan Yao Tong Zhang 27 4 0 05 Sep 2023
Dataset Distillation Meets Provable Subset Selection M. Tukan Alaa Maalouf Margarita Osadchy DD 37 4 0 16 Jul 2023
Repeated Random Sampling for Minimizing the Time-to-Accuracy of Learning Patrik Okanovic R. Waleffe Vasilis Mageirakos Konstantinos E. Nikolakakis Amin Karbasi Dionysis Kalogerias Nezihe Merve Gürel Theodoros Rekatsinas DD 45 12 0 28 May 2023
Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model Xiao Wang Wei Zhou Qi Zhang Jie Zhou Songyang Gao Junzhe Wang Menghan Zhang Xiang Gao Yunwen Chen Tao Gui 43 7 0 22 May 2023
DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining Sang Michael Xie Hieu H. Pham Xuanyi Dong Nan Du Hanxiao Liu Yifeng Lu Percy Liang Quoc V. Le Tengyu Ma Adams Wei Yu MoMe MoE 47 177 0 17 May 2023
Provable Data Subset Selection For Efficient Neural Network Training M. Tukan Samson Zhou Alaa Maalouf Daniela Rus Vladimir Braverman Dan Feldman MLT 25 9 0 09 Mar 2023
Less is More: Data Pruning for Faster Adversarial Training Yize Li Pu Zhao X. Lin B. Kailkhura Ryan Goldh AAML 15 9 0 23 Feb 2023
Leveraging Importance Weights in Subset Selection Gui Citovsky Giulia DeSalvo Sanjiv Kumar Srikumar Ramalingam Afshin Rostamizadeh Yunjuan Wang 37 3 0 28 Jan 2023
Data Distillation: A Survey Noveen Sachdeva Julian McAuley DD 45 73 0 11 Jan 2023
Quality Not Quantity: On the Interaction between Dataset Design and Robustness of CLIP Thao Nguyen Gabriel Ilharco Mitchell Wortsman Sewoong Oh Ludwig Schmidt CLIP VLM 42 98 0 10 Aug 2022
Condensing Graphs via One-Step Gradient Matching Wei Jin Xianfeng Tang Haoming Jiang Zheng Li Danqing Zhang Jiliang Tang Bin Ying DD 28 98 0 15 Jun 2022
CVNets: High Performance Library for Computer Vision Sachin Mehta Farzad Abdolhosseini Mohammad Rastegari 29 18 0 04 Jun 2022
Infinite Recommendation Networks: A Data-Centric Approach Noveen Sachdeva Mehak Preet Dhaliwal Carole-Jean Wu Julian McAuley DD 33 28 0 03 Jun 2022