v1v2 (latest)

Implicit Regularization in Deep Learning

6 September 2017

Papers citing "Implicit Regularization in Deep Learning"

50 / 105 papers shown

Title
Variational Adaptive Noise and Dropout towards Stable Recurrent Neural Networks Taisuke Kobayashi Shingo Murata 47 0 0 02 Jun 2025
Identifying Key Challenges of Hardness-Based Resampling Pawel Pukowski Venet Osmani 70 0 0 09 Apr 2025
High-entropy Advantage in Neural Networks' Generalizability Entao Yang Wei Wei Yue Shang Ge Zhang AI4CE 119 0 0 17 Mar 2025
Changing Base Without Losing Pace: A GPU-Efficient Alternative to MatMul in DNNs Nir Ailon Akhiad Bercovich Omri Weinstein 136 0 0 15 Mar 2025
Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture Yikun Hou Suvrit Sra A. Yurtsever 72 0 0 28 Jan 2025
ExpTest: Automating Learning Rate Searching and Tuning with Insights from Linearized Neural Networks Zan Chaudhry Naoko Mizuno 112 0 0 25 Nov 2024
LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics Thomas Robert M. Safaryan Ionut-Vlad Modoranu Dan Alistarh ODL 70 7 0 21 Oct 2024
A Theoretical Survey on Foundation Models Shi Fu Yuzhu Chen Yingjie Wang Dacheng Tao 78 0 0 15 Oct 2024
Low-Dimension-to-High-Dimension Generalization And Its Implications for Length Generalization Yang Chen Long Yang Yitao Liang Zhouchen Lin 112 1 0 11 Oct 2024
Input Space Mode Connectivity in Deep Neural Networks Jakub Vrabel Ori Shem-Ur Yaron Oz David Krueger 110 1 0 09 Sep 2024
DNA-SE: Towards Deep Neural-Nets Assisted Semiparametric Estimation Qinshuo Liu Zixin Wang Xi-An Li Xinyao Ji Lei Zhang Lin Liu Zhonghua Liu 76 0 0 04 Aug 2024
A Margin-based Multiclass Generalization Bound via Geometric Complexity Michael Munn Benoit Dherin Javier Gonzalvo UQCV 81 2 0 28 May 2024
The Impact of Geometric Complexity on Neural Collapse in Transfer Learning Michael Munn Benoit Dherin Javier Gonzalvo AAML 75 2 0 24 May 2024
Improving Generalization of Deep Neural Networks by Optimum Shifting Yuyan Zhou Ye Li Lei Feng Sheng-Jun Huang OOD ODL 55 0 0 23 May 2024
A General Theory for Compositional Generalization Jingwen Fu Zhizheng Zhang Yan Lu Nanning Zheng AI4CE CoGe 67 2 0 20 May 2024
Development of Skip Connection in Deep Neural Networks for Computer Vision and Medical Image Analysis: A Survey Guoping Xu Xiaxia Wang Xinglong Wu Xuesong Leng Yongchao Xu 3DPC 95 11 0 02 May 2024
A Gauss-Newton Approach for Min-Max Optimization in Generative Adversarial Networks Neel Mishra Bamdev Mishra Pratik Jawanpuria Pawan Kumar GAN 63 1 0 10 Apr 2024
No Free Prune: Information-Theoretic Barriers to Pruning at Initialization Tanishq Kumar Kevin Luo Mark Sellke 78 3 0 02 Feb 2024
A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models Namjoon Suh Guang Cheng MedIm 109 14 0 14 Jan 2024
Interpretability Illusions in the Generalization of Simplified Models Dan Friedman Andrew Kyle Lampinen Lucas Dixon Danqi Chen Asma Ghandeharioun 113 15 0 06 Dec 2023
Critical Influence of Overparameterization on Sharpness-aware Minimization Sungbin Shin Dongyeop Lee Maksym Andriushchenko Namhoon Lee AAML 160 2 0 29 Nov 2023
A PAC-Bayesian Perspective on the Interpolating Information Criterion Liam Hodgkinson Christopher van der Heide Roberto Salomone Fred Roosta Michael W. Mahoney 96 2 0 13 Nov 2023
Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics Soo Min Kwon Zekai Zhang Dogyoon Song Laura Balzano Qing Qu 112 4 0 08 Nov 2023
PRIOR: Personalized Prior for Reactivating the Information Overlooked in Federated Learning Mingjia Shi Yuhao Zhou Kai Wang Huaizheng Zhang Shudong Huang Qing Ye Jiangcheng Lv 75 11 0 13 Oct 2023
A path-norm toolkit for modern networks: consequences, promises and challenges Antoine Gonon Nicolas Brisebarre E. Riccietti Rémi Gribonval 83 6 0 02 Oct 2023
Asynchronous Graph Generator Christopher P. Ley Felipe Tobar AI4TS 175 0 0 29 Sep 2023
Unveiling Invariances via Neural Network Pruning Derek Xu Yizhou Sun Wei Wang 75 0 0 15 Sep 2023
The Interpolating Information Criterion for Overparameterized Models Liam Hodgkinson Christopher van der Heide Roberto Salomone Fred Roosta Michael W. Mahoney 75 9 0 15 Jul 2023
Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows Sibylle Marcotte Rémi Gribonval Gabriel Peyré 117 19 0 30 Jun 2023
Catching Image Retrieval Generalization Maksim Zhdanov I. Karpukhin VLM 48 0 0 23 Jun 2023
Understanding and Mitigating Extrapolation Failures in Physics-Informed Neural Networks Lukas Fesser Luca DÁmico-Wong Richard Qiu 72 4 0 15 Jun 2023
The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks Can Yaras Peng Wang Wei Hu Zhihui Zhu Laura Balzano Qing Qu 89 18 0 01 Jun 2023
(Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy Elan Rosenfeld Saurabh Garg UQCV 68 7 0 01 Jun 2023
When Does Optimizing a Proper Loss Yield Calibration? Jarosław Błasiok Parikshit Gopalan Lunjia Hu Preetum Nakkiran 94 28 0 30 May 2023
Consistent Optimal Transport with Empirical Conditional Measures Piyushi Manupriya Rachit Keerti Das Sayantan Biswas S. Jagarlapudi OT 94 4 0 25 May 2023
Exploring the Complexity of Deep Neural Networks through Functional Equivalence Guohao Shen 103 4 0 19 May 2023
Adaptive Consensus Optimization Method for GANs Sachin Kumar Danisetty Santhosh Reddy Mylaram Pawan Kumar ODL 46 3 0 20 Apr 2023
Saddle-to-Saddle Dynamics in Diagonal Linear Networks Scott Pesme Nicolas Flammarion 126 39 0 02 Apr 2023
Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent Avrajit Ghosh He Lyu Xitong Zhang Rongrong Wang 86 23 0 02 Feb 2023
Why Deep Learning Generalizes Benjamin L. Badger TDI AI4CE 71 3 0 17 Nov 2022
C-Mixup: Improving Generalization in Regression Huaxiu Yao Yiping Wang Linjun Zhang James Zou Chelsea Finn UQCV OOD 93 62 0 11 Oct 2022
DeepMed: Semiparametric Causal Mediation Analysis with Debiased Deep Learning Siqi Xu Lin Liu Zhong Liu CML MedIm 67 9 0 10 Oct 2022
Learning Temporal Resolution in Spectrogram for Audio Classification Haohe Liu Xubo Liu Qiuqiang Kong Wenwu Wang Mark D. Plumbley 75 7 0 04 Oct 2022
The Dynamic of Consensus in Deep Networks and the Identification of Noisy Labels Daniel Shwartz Uri Stern D. Weinshall NoLa 98 2 0 02 Oct 2022
Why neural networks find simple solutions: the many regularizers of geometric complexity Benoit Dherin Michael Munn M. Rosca David Barrett 133 31 0 27 Sep 2022
Robust Constrained Reinforcement Learning Yue Wang Fei Miao Shaofeng Zou 65 14 0 14 Sep 2022
The BUTTER Zone: An Empirical Study of Training Dynamics in Fully Connected Neural Networks Charles Edison Tripp J. Perr-Sauer L. Hayne M. Lunacek Jamil Gafur AI4CE 95 1 0 25 Jul 2022
Discriminator-Weighted Offline Imitation Learning from Suboptimal Demonstrations Haoran Xu Xianyuan Zhan Honglei Yin Huiling Qin OffRL 95 70 0 20 Jul 2022
PAC-Bayesian Domain Adaptation Bounds for Multiclass Learners Anthony Sicilia Katherine Atwell Malihe Alikhani Seong Jae Hwang BDL 93 10 0 12 Jul 2022
Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm Lechao Xiao Jeffrey Pennington 101 10 0 11 Jul 2022