Scaling Laws for the Value of Individual Data Points in Machine Learning

Scaling Laws for the Value of Individual Data Points in Machine Learning

30 May 2024

Tatsunori Hashimoto

Papers citing "Scaling Laws for the Value of Individual Data Points in Machine Learning"

11 / 11 papers shown

Title
How to Upscale Neural Networks with Scaling Law? A Survey and Practical Guidelines Ayan Sengupta Ayan Sengupta Tanmoy Chakraborty 85 0 0 17 Feb 2025
Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance Jiasheng Ye Peiju Liu Tianxiang Sun Yunhua Zhou Jun Zhan Xipeng Qiu 68 73 0 25 Mar 2024
DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models Yongchan Kwon Eric Wu K. Wu James Zou DiffM TDI 31 61 0 02 Oct 2023
Training Compute-Optimal Large Language Models Jordan Hoffmann Sebastian Borgeaud A. Mensch Elena Buchatskaya Trevor Cai ... Karen Simonyan Erich Elsen Jack W. Rae Oriol Vinyals Laurent Sifre AI4TS 98 1,894 0 29 Mar 2022
Datamodels: Predicting Predictions from Training Data Andrew Ilyas Sung Min Park Logan Engstrom Guillaume Leclerc Aleksander Madry TDI 91 136 0 01 Feb 2022
Tutorial on amortized optimization Brandon Amos OffRL 108 45 0 01 Feb 2022
Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning Yongchan Kwon James Zou TDI 53 125 0 26 Oct 2021
A Distributional Framework for Data Valuation Amirata Ghorbani Michael P. Kim James Zou TDI 17 129 0 27 Feb 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 368 4,662 0 23 Jan 2020
A Constructive Prediction of the Generalization Error Across Scales Jonathan S. Rosenfeld Amir Rosenfeld Yonatan Belinkov Nir Shavit 56 210 0 27 Sep 2019
Understanding Black-box Predictions via Influence Functions Pang Wei Koh Percy Liang TDI 98 2,854 0 14 Mar 2017