Luck Matters: Understanding Training Dynamics of Deep ReLU Networks

31 May 2019

Papers citing "Luck Matters: Understanding Training Dynamics of Deep ReLU Networks"

4 / 4 papers shown

Title
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks Andrew M. Saxe Shagun Sodhani Sam Lewallen AI4CE 30 34 0 21 Jul 2022
Understanding Robustness in Teacher-Student Setting: A New Perspective Zhuolin Yang Zhaoxi Chen Tiffany Cai Xinyun Chen Bo-wen Li Yuandong Tian AAML 35 2 0 25 Feb 2021
Exploring Weight Importance and Hessian Bias in Model Pruning Mingchen Li Yahya Sattar Christos Thrampoulidis Samet Oymak 28 3 0 19 Jun 2020
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,890 0 15 Sep 2016