Explicit Regularization in Overparametrized Models via Noise Injection

Explicit Regularization in Overparametrized Models via Noise Injection

9 June 2022

Antonio Orvieto

Francis R. Bach

Papers citing "Explicit Regularization in Overparametrized Models via Noise Injection"

10 / 10 papers shown

Title
High-order Regularization for Machine Learning and Learning-based Control Xinghua Liu Ming Cao 25 0 0 13 May 2025
Beyond Self-Consistency: Loss-Balanced Perturbation-Based Regularization Improves Industrial-Scale Ads Ranking Ilqar Ramazanli Hamid Eghbalzadeh Xiaoyi Liu Yang Wang Jiaxiang Fu Kaushik Rangadurai Sem Park Bo Long Xue Feng 51 0 0 05 Feb 2025
An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes Antonio Orvieto Lin Xiao 45 3 0 05 Jul 2024
How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD Pierfrancesco Beneventano Andrea Pinto Tomaso A. Poggio MLT 32 1 0 17 Jun 2024
Demystifying SGD with Doubly Stochastic Gradients Kyurae Kim Joohwan Ko Yian Ma Jacob R. Gardner 53 0 0 03 Jun 2024
Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization Kaiyue Wen Zhiyuan Li Tengyu Ma FAtt 38 26 0 20 Jul 2023
Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent Avrajit Ghosh He Lyu Xitong Zhang Rongrong Wang 53 21 0 02 Feb 2023
Anticorrelated Noise Injection for Improved Generalization Antonio Orvieto Hans Kersting F. Proske Francis R. Bach Aurelien Lucchi 76 44 0 06 Feb 2022
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 308 2,892 0 15 Sep 2016
Tensor Decomposition for Signal Processing and Machine Learning N. Sidiropoulos L. De Lathauwer Xiao Fu Kejun Huang Evangelos E. Papalexakis Christos Faloutsos 114 1,343 0 06 Jul 2016