GD doesn't make the cut: Three ways that non-differentiability affects neural network training

16 January 2024

Papers citing "GD doesn't make the cut: Three ways that non-differentiability affects neural network training"

3 / 3 papers shown

Title
Understanding Gradient Descent on Edge of Stability in Deep Learning Sanjeev Arora Zhiyuan Li A. Panigrahi MLT 83 90 0 19 May 2022
What is the State of Neural Network Pruning? Davis W. Blalock Jose Javier Gonzalez Ortiz Jonathan Frankle John Guttag 191 1,027 0 06 Mar 2020
A Simple Convergence Proof of Adam and Adagrad Alexandre Défossez Léon Bottou Francis R. Bach Nicolas Usunier 56 144 0 05 Mar 2020