Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruning

29 May 2024

Papers citing "Critical Learning Periods: Leveraging Early Training Dynamics for Efficient Data Pruning"

7 / 7 papers shown

Title
Emergence of Computational Structure in a Neural Network Physics Simulator Rohan Hitchcock Gary W. Delaney J. Manton Richard Scalzo Jingge Zhu 29 0 0 16 Apr 2025
SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe Yuxin Xiao Shujian Zhang Wenxuan Zhou Marzyeh Ghassemi Sanqiang Zhao 109 0 0 07 Oct 2024
To Code, or Not To Code? Exploring Impact of Code in Pre-training Viraat Aryabumi Yixuan Su Raymond Ma Adrien Morisot Ivan Zhang Acyr F. Locatelli Marzieh Fadaee A. Ustun Sara Hooker SyDa AI4CE 45 18 0 20 Aug 2024
On the Limitations of Compute Thresholds as a Governance Strategy Sara Hooker 55 14 0 08 Jul 2024
The Low-Resource Double Bind: An Empirical Study of Pruning for Low-Resource Machine Translation Orevaoghene Ahia Julia Kreutzer Sara Hooker 118 51 0 06 Oct 2021
AfroMT: Pretraining Strategies and Reproducible Benchmarks for Translation of 8 African Languages Machel Reid Junjie Hu Graham Neubig Y. Matsuo 77 31 0 10 Sep 2021
Estimating Example Difficulty Using Variance of Gradients Chirag Agarwal Daniel D'souza Sara Hooker 208 107 0 26 Aug 2020