Broken Neural Scaling Laws

Broken Neural Scaling Laws

26 October 2022

Ethan Caballero

David M. Krueger

Papers citing "Broken Neural Scaling Laws"

11 / 61 papers shown

Title
Towards the Scalable Evaluation of Cooperativeness in Language Models Alan Chan Maxime Riché Jesse Clifton LLMAG 25 6 0 16 Mar 2023
A Meta-Learning Approach to Predicting Performance and Data Requirements Achin Jain Gurumurthy Swaminathan Paolo Favaro Hao Yang Avinash Ravichandran ... Alessandro Achille O. Dabeer Bernt Schiele A. Swaminathan Stefano Soatto 37 8 0 02 Mar 2023
Exploring the Representation Manifolds of Stable Diffusion Through the Lens of Intrinsic Dimension Henry Kvinge Davis Brown Charles Godfrey DiffM 6 6 0 16 Feb 2023
Scaling laws for single-agent reinforcement learning Jacob Hilton Jie Tang John Schulman 22 20 0 31 Jan 2023
Revisiting Neural Scaling Laws in Language and Vision Ibrahim M. Alabdulmohsin Behnam Neyshabur Xiaohua Zhai 156 102 0 13 Sep 2022
Computable Artificial General Intelligence Michael Timothy Bennett 17 4 0 21 May 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 364 8,495 0 28 Jan 2022
Truthful AI: Developing and governing AI that does not lie Owain Evans Owen Cotton-Barratt Lukas Finnveden Adam Bales Avital Balwit Peter Wills Luca Righetti William Saunders HILM 236 109 0 13 Oct 2021
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 271 2,603 0 04 May 2021
E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials Simon L. Batzner Albert Musaelian Lixin Sun Mario Geiger J. Mailoa M. Kornbluth N. Molinari Tess E. Smidt Boris Kozinsky 203 1,240 0 08 Jan 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 240 4,469 0 23 Jan 2020