Understanding Grokking Through A Robustness Viewpoint

v1v2 (latest)

Understanding Grokking Through A Robustness Viewpoint

11 November 2023

ArXiv (abs)PDF HTML

Papers citing "Understanding Grokking Through A Robustness Viewpoint"

9 / 9 papers shown

Title
Predicting Grokking Long Before it Happens: A look into the loss landscape of models which grok Pascal Junior Tikeng Notsawo Hattie Zhou Mohammad Pezeshki Irina Rish G. Dumas 61 24 0 23 Jun 2023
A Tale of Two Circuits: Grokking as Competition of Sparse and Dense Subnetworks William Merrill Nikolaos Tsilivis Aman Shukla 56 54 0 21 Mar 2023
Unifying Grokking and Double Descent Peter W. Battaglia David Raposo Kelsey 71 32 0 10 Mar 2023
Grokking modular arithmetic Andrey Gromov 96 42 0 06 Jan 2023
Omnigrok: Grokking Beyond Algorithmic Data Ziming Liu Eric J. Michaud Max Tegmark 93 84 0 03 Oct 2022
Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit Boaz Barak Benjamin L. Edelman Surbhi Goel Sham Kakade Eran Malach Cyril Zhang 101 133 0 18 Jul 2022
Information Theory with Kernel Methods Francis R. Bach 56 42 0 17 Feb 2022
On Linear Stability of SGD and Input-Smoothness of Neural Networks Chao Ma Lexing Ying MLT 46 44 0 27 May 2021
Deep Learning and the Information Bottleneck Principle Naftali Tishby Noga Zaslavsky DRL 210 1,591 0 09 Mar 2015

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.