Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections

Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections

13 February 2021

Chris Holmes

Mert Gurbuzbalaban

Papers citing "Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections"

6 / 6 papers shown

Title
Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Renyi's Entropy Perspective Yuxin Dong Tieliang Gong Hao Chen Chen Li 23 4 0 02 May 2023
Stochastic Nonsmooth Convex Optimization with Heavy-Tailed Noises: High-Probability Bound, In-Expectation Rate and Initial Distance Adaptation Zijian Liu Zhengyuan Zhou 30 10 0 22 Mar 2023
Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks Tolga Birdal Aaron Lou Leonidas J. Guibas Umut cSimcsekli 32 61 0 25 Nov 2021
On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications Ziqiao Wang Yongyi Mao FedML MLT 39 22 0 07 Oct 2021
Hausdorff Dimension, Heavy Tails, and Generalization in Neural Networks Umut Simsekli Ozan Sener George Deligiannidis Murat A. Erdogdu 44 55 0 16 Jun 2020
Noisin: Unbiased Regularization for Recurrent Neural Networks Adji Bousso Dieng Rajesh Ranganath Jaan Altosaar David M. Blei 22 22 0 03 May 2018