Online Batch Selection for Faster Training of Neural Networks

19 November 2015

Papers citing "Online Batch Selection for Faster Training of Neural Networks"

50 / 139 papers shown

Title
DONOD: Robust and Generalizable Instruction Fine-Tuning for LLMs via Model-Intrinsic Dataset Pruning Jucheng Hu Steve Yang Dongzhan Zhou Lijun Wu 34 0 0 21 Apr 2025
Tokens for Learning, Tokens for Unlearning: Mitigating Membership Inference Attacks in Large Language Models via Dual-Purpose Training Toan Tran Ruixuan Liu Li Xiong MU 46 0 0 27 Feb 2025
ELIP: Enhanced Visual-Language Foundation Models for Image Retrieval Guanqi Zhan Yuanpei Liu Kai Han Weidi Xie Andrew Zisserman VLM 171 0 0 21 Feb 2025
Dynamic Loss-Based Sample Reweighting for Improved Large Language Model Pretraining Daouda Sow Herbert Woisetschläger Saikiran Bulusu Shiqiang Wang Hans-Arno Jacobsen Yingbin Liang 59 0 0 10 Feb 2025
From Prototypes to General Distributions: An Efficient Curriculum for Masked Image Modeling Jinhong Lin Cheng-En Wu Huanran Li Jifan Zhang Yu Hen Hu Pedro Morgado 41 0 0 16 Nov 2024
Not All LLM-Generated Data Are Equal: Rethinking Data Weighting in Text Classification Hsun-Yu Kuo Yin-Hsiang Liao Yu-Chieh Chao Wei-Yun Ma Pu-Jen Cheng SyDa 47 2 0 28 Oct 2024
Multiple Importance Sampling for Stochastic Gradient Estimation Corentin Salaün Xingchang Huang Iliyan Georgiev Niloy J. Mitra Gurprit Singh 32 1 0 22 Jul 2024
Data curation via joint example selection further accelerates multimodal learning Talfan Evans Nikhil Parthasarathy Hamza Merzic Olivier J. Hénaff 32 12 0 25 Jun 2024
Evolution-aware VAriance (EVA) Coreset Selection for Medical Image Classification Yuxin Hong Xiao Zhang Xin Zhang Joey Tianyi Zhou 45 2 0 09 Jun 2024
Labeled Data Selection for Category Discovery Bingchen Zhao Nico Lang Serge J. Belongie Oisin Mac Aodha 34 3 0 07 Jun 2024
Diversified Batch Selection for Training Acceleration Feng Hong Yueming Lyu Jiangchao Yao Ya Zhang Ivor W. Tsang Yanfeng Wang 42 4 0 07 Jun 2024
SAVA: Scalable Learning-Agnostic Data Valuation Samuel Kessler Tam Le Vu Nguyen TDI 56 0 0 03 Jun 2024
Nonparametric Teaching of Implicit Neural Representations Chen Zhang Steven Tin Sui Luo Jason Chun Lok Li Yik-Chung Wu Ngai Wong 40 2 0 17 May 2024
EfficientTrain++: Generalized Curriculum Learning for Efficient Visual Backbone Training Yulin Wang Yang Yue Rui Lu Yizeng Han Shiji Song Gao Huang VLM 61 12 0 14 May 2024
Data-Efficient and Robust Task Selection for Meta-Learning Donglin Zhan James Anderson OOD 34 2 0 11 May 2024
Grad Queue : A probabilistic framework to reinforce sparse gradients Irfan Mohammad Al Hasib 27 0 0 25 Apr 2024
Rho-1: Not All Tokens Are What You Need Zheng-Wen Lin Zhibin Gou Yeyun Gong Xiao Liu Yelong Shen ... Chen Lin Yujiu Yang Jian Jiao Nan Duan Weizhu Chen CLL 50 55 0 11 Apr 2024
Multi-Label Adaptive Batch Selection by Highlighting Hard and Imbalanced Samples Ao Zhou Bin Liu Jin Wang Grigorios Tsoumakas 26 2 0 27 Mar 2024
Does Negative Sampling Matter? A Review with Insights into its Theory and Applications Zhen Yang Ming Ding Tinglin Huang Yukuo Cen Junshuai Song Bin Xu Yuxiao Dong Jie Tang 33 9 0 27 Feb 2024
Efficient Backpropagation with Variance-Controlled Adaptive Sampling Ziteng Wang Jianfei Chen Jun Zhu BDL 40 2 0 27 Feb 2024
Take the Bull by the Horns: Hard Sample-Reweighted Continual Training Improves LLM Generalization Xuxi Chen Zhendong Wang Daouda Sow Junjie Yang Tianlong Chen Yingbin Liang Mingyuan Zhou Zhangyang Wang 34 5 0 22 Feb 2024
Understanding the Training Speedup from Sampling with Approximate Losses Rudrajit Das Xi Chen Bertram Ieong Parikshit Bansal Sujay Sanghavi 19 0 0 10 Feb 2024
FerKD: Surgical Label Adaptation for Efficient Distillation Zhiqiang Shen 21 3 0 29 Dec 2023
Can Active Sampling Reduce Causal Confusion in Offline Reinforcement Learning? Gunshi Gupta Tim G. J. Rudner R. McAllister Adrien Gaidon Y. Gal OffRL 48 3 0 28 Dec 2023
Mitigating Label Bias in Machine Learning: Fairness through Confident Learning Yixuan Zhang Boyu Li Zenan Ling Feng Zhou FaML 13 3 0 14 Dec 2023
Bad Students Make Great Teachers: Active Learning Accelerates Large-Scale Visual Understanding Talfan Evans Shreya Pathak Hamza Merzic Jonathan Schwarz Ryutaro Tanno Olivier J. Hénaff 18 16 0 08 Dec 2023
A Negative Result on Gradient Matching for Selective Backprop Lukas Balles Cédric Archambeau Giovanni Zappella 29 0 0 08 Dec 2023
REDUCR: Robust Data Downsampling Using Class Priority Reweighting William Bankes George Hughes Ilija Bogunovic Zi Wang 28 3 0 01 Dec 2023
Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning Xin Zhang Jiawei Du Yunsong Li Weiying Xie Qiufeng Wang 37 7 0 22 Nov 2023
Better with Less: A Data-Active Perspective on Pre-Training Graph Neural Networks Jiarong Xu Renhong Huang Xin Jiang Yuxuan Cao Carl Yang Chunping Wang Yang Yang AI4CE 31 14 0 02 Nov 2023
Bandit-Driven Batch Selection for Robust Learning under Label Noise Michal Lisicki Mihai Nica Graham W. Taylor 19 0 0 31 Oct 2023
Data Optimization in Deep Learning: A Survey Ou Wu Rujing Yao 32 1 0 25 Oct 2023
Irreducible Curriculum for Language Model Pretraining Simin Fan Martin Jaggi 22 9 0 23 Oct 2023
DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Dataset Weijie Liu Xiaoxi Zhang Jingpu Duan Carlee Joe-Wong Zhi Zhou Xu Chen 18 7 0 20 Oct 2023
Enhancing Sample Utilization through Sample Adaptive Augmentation in Semi-Supervised Learning Guan Gui Zhen Zhao Lei Qi Luping Zhou Lei Wang Yinghuan Shi AAML 35 7 0 07 Sep 2023
Towards Accelerated Model Training via Bayesian Data Selection Zhijie Deng Peng Cui Jun Zhu 16 4 0 21 Aug 2023
Differences Between Hard and Noisy-labeled Samples: An Empirical Study Mahsa Forouzesh Patrick Thiran NoLa 22 2 0 20 Jul 2023
Mini-Batch Optimization of Contrastive Loss Jaewoong Cho Kartik K. Sreenivasan Keon Lee Kyunghoo Mun Soheun Yi Jeong-Gwan Lee Anna Lee Jy-yong Sohn Dimitris Papailiopoulos Kangwook Lee SSL 40 7 0 12 Jul 2023
GaitMPL: Gait Recognition with Memory-Augmented Progressive Learning Huanzhang Dou Pengyi Zhang Yuhan Zhao Lin Dong Zequn Qin Xi Li CVBM VLM 30 24 0 06 Jun 2023
Towards Sustainable Learning: Coresets for Data-efficient Deep Learning Yu Yang Hao Kang Baharan Mirzasoleiman 36 34 0 02 Jun 2023
INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models H. S. V. N. S. K. Renduchintala Krishnateja Killamsetty S. Bhatia Milan Aggarwal Ganesh Ramakrishnan Rishabh K. Iyer Balaji Krishnamurthy AIFin 17 3 0 11 May 2023
A Curriculum View of Robust Loss Functions Zebin Ou Yue Zhang NoLa 17 0 0 03 May 2023
Importance Sampling for Stochastic Gradient Descent in Deep Neural Networks Thibault Lahire 11 2 0 29 Mar 2023
Data Selection for Language Models via Importance Resampling Sang Michael Xie Shibani Santurkar Tengyu Ma Percy Liang 35 170 0 06 Feb 2023
MILO: Model-Agnostic Subset Selection Framework for Efficient Model Training and Tuning Krishnateja Killamsetty A. Evfimievski Tejaswini Pedapati K. Kate Lucian Popa Rishabh K. Iyer 21 6 0 30 Jan 2023
Informed Down-Sampled Lexicase Selection: Identifying productive training cases for efficient problem solving Ryan Boldi Martin Briesch Dominik Sobania Alexander Lalejini Thomas Helmuth Franz Rothlauf Charles Ofria Lee Spector 38 22 0 04 Jan 2023
LOCKS: User Differentially Private and Federated Optimal Client Sampling Ajinkya Mulay FedML 21 0 0 26 Dec 2022
EfficientTrain: Exploring Generalized Curriculum Learning for Training Visual Backbones Yulin Wang Yang Yue Rui Lu Tian-De Liu Zhaobai Zhong S. Song Gao Huang 37 28 0 17 Nov 2022
A Survey of Dataset Refinement for Problems in Computer Vision Datasets Zhijing Wan Zhixiang Wang CheukTing Chung Zheng Wang 36 8 0 21 Oct 2022
Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities Brian Bartoldson B. Kailkhura Davis W. Blalock 31 47 0 13 Oct 2022