On the Implicit Bias of Dropout

26 June 2018

Papers citing "On the Implicit Bias of Dropout"

13 / 13 papers shown

Title
Analytic theory of dropout regularization Francesco Mori Francesca Mignacco 29 0 0 12 May 2025
Reasoning Bias of Next Token Prediction Training Pengxiao Lin Zhongwang Zhang Zhi-Qin John Xu LRM 94 2 0 21 Feb 2025
Noise Regularizes Over-parameterized Rank One Matrix Recovery, Provably Tianyi Liu Yan Li Enlu Zhou Tuo Zhao 38 1 0 07 Feb 2022
Advances in Electron Microscopy with Deep Learning Jeffrey M. Ede 32 2 0 04 Jan 2021
Review: Deep Learning in Electron Microscopy Jeffrey M. Ede 31 79 0 17 Sep 2020
Shape Matters: Understanding the Implicit Bias of the Noise Covariance Jeff Z. HaoChen Colin Wei J. Lee Tengyu Ma 29 93 0 15 Jun 2020
Dropout: Explicit Forms and Capacity Control R. Arora Peter L. Bartlett Poorya Mianjy Nathan Srebro 64 37 0 06 Mar 2020
Guided Dropout Rohit Keshari Richa Singh Mayank Vatsa BDL 26 37 0 10 Dec 2018
Implicit Regularization of Stochastic Gradient Descent in Natural Language Processing: Observations and Implications Deren Lei Zichen Sun Yijun Xiao William Yang Wang 33 14 0 01 Nov 2018
An ETF view of Dropout regularization Dor Bank Raja Giryes 8 4 0 14 Oct 2018
Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learning Charles H. Martin Michael W. Mahoney AI4CE 32 190 0 02 Oct 2018
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 285 9,138 0 06 Jun 2015
Norm-Based Capacity Control in Neural Networks Behnam Neyshabur Ryota Tomioka Nathan Srebro 119 577 0 27 Feb 2015