Progress Measures for Grokking on Real-world Tasks

21 May 2024

Papers citing "Progress Measures for Grokking on Real-world Tasks"

6 / 6 papers shown

Title
A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks William Merrill Nikolaos Tsilivis Aman Shukla 43 52 0 21 Mar 2023
Omnigrok: Grokking Beyond Algorithmic Data Ziming Liu Eric J. Michaud Max Tegmark 78 82 0 03 Oct 2022
Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit Boaz Barak Benjamin L. Edelman Surbhi Goel Sham Kakade Eran Malach Cyril Zhang 75 132 0 18 Jul 2022
Entropy-Constrained Training of Deep Neural Networks Simon Wiedemann Arturo Marbán K. Müller Wojciech Samek 46 28 0 18 Dec 2018
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks Jonathan Frankle Michael Carbin 206 3,457 0 09 Mar 2018
Improving neural networks by preventing co-adaptation of feature detectors Geoffrey E. Hinton Nitish Srivastava A. Krizhevsky Ilya Sutskever Ruslan Salakhutdinov VLM 426 7,658 0 03 Jul 2012