Large-time asymptotics in deep learning

6 August 2020

Papers citing "Large-time asymptotics in deep learning"

50 / 54 papers shown

Title
Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNs Michael Scholkemper Xinyi Wu Ali Jadbabaie Michael T. Schaub 122 7 0 05 Jun 2024
On Dissipativity of Cross-Entropy Loss in Training ResNets Jens Püttschneider T. Faulwasser 58 0 0 29 May 2024
Analysis of the Geometric Structure of Neural Networks and Neural ODEs via Morse Functions Christian Kuehn Sara-Viola Kuntz 41 0 0 15 May 2024
Interplay between depth and width for interpolation in neural ODEs Antonio Álvarez-López Arselane Hadj Slimane Enrique Zuazua 59 7 0 18 Jan 2024
Normalizing flows as approximations of optimal transport maps via linear-control neural ODEs A. Scagliotti Sara Farinelli 48 3 0 02 Nov 2023
From NeurODEs to AutoencODEs: a mean-field control framework for width-varying Neural Networks Cristina Cipriani M. Fornasier Alessandro Scagliotti AI4CE 36 5 0 05 Jul 2023
Learning via nonlinear conjugate gradients and depth-varying neural ODEs George Baravdish Gabriel Eilertsen Rym Jaroudi B. Johansson Lukávs Malý Jonas Unger 43 3 0 11 Feb 2022
Sparsity in long-time control of neural ODEs C. Yagüe Borjan Geshkovski 36 8 0 26 Feb 2021
On the Turnpike to Design of Deep Neural Nets: Explicit Depth Bounds T. Faulwasser Arne-Jens Hempel S. Streif 44 5 0 08 Jan 2021
Control on the Manifolds of Mappings with a View to the Deep Learning A. Agrachev A. Sarychev AI4CE 21 6 0 28 Aug 2020
The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Training Andrea Montanari Yiqiao Zhong 76 96 0 25 Jul 2020
Universal Approximation Power of Deep Residual Neural Networks via Nonlinear Control Theory Paulo Tabuada Bahman Gharesifard 44 26 0 12 Jul 2020
Structure preserving deep learning E. Celledoni Matthias Joachim Ehrhardt Christian Etmann R. McLachlan B. Owren Carola-Bibiane Schönlieb Ferdia Sherry AI4CE 34 43 0 05 Jun 2020
A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth Yiping Lu Chao Ma Yulong Lu Jianfeng Lu Lexing Ying MLT 70 78 0 11 Mar 2020
Implicit Bias of Gradient Descent for Wide Two-layer Neural Networks Trained with the Logistic Loss Lénaïc Chizat Francis R. Bach MLT 61 332 0 11 Feb 2020
Machine Learning from a Continuous Viewpoint E. Weinan Chao Ma Lei Wu 58 104 0 30 Dec 2019
Mean-Field Neural ODEs via Relaxed Optimal Control Jean-François Jabir D. vSivska Lukasz Szpruch MLT 22 39 0 11 Dec 2019
A Machine Learning Framework for Solving High-Dimensional Mean Field Game and Mean Field Control Problems Lars Ruthotto Stanley Osher Wuchen Li L. Nurbekyan Samy Wu Fung AI4CE 57 217 0 04 Dec 2019
Mean-field Langevin System, Optimal Control and Deep Neural Networks Kaitong Hu A. Kazeykina Zhenjie Ren 33 15 0 16 Sep 2019
Neural ODEs as the Deep Limit of ResNets with constant weights B. Avelin K. Nystrom ODL 59 31 0 28 Jun 2019
Residual Flows for Invertible Generative Modeling Ricky T. Q. Chen Jens Behrmann David Duvenaud J. Jacobsen BDL TPM DRL 53 375 0 06 Jun 2019
Hamiltonian Neural Networks S. Greydanus Misko Dzamba J. Yosinski PINN AI4CE 58 876 0 04 Jun 2019
Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limit Belinda Tzen Maxim Raginsky DiffM 96 207 0 23 May 2019
Universal Approximation with Deep Narrow Networks Patrick Kidger Terry Lyons 63 329 0 21 May 2019
Nonlinear Approximation and (Deep) ReLU Networks Ingrid Daubechies Ronald A. DeVore S. Foucart Boris Hanin G. Petrova 38 139 0 05 May 2019
Deep learning as optimal control problems: models and numerical methods Martin Benning E. Celledoni Matthias Joachim Ehrhardt B. Owren Carola-Bibiane Schönlieb 41 81 0 11 Apr 2019
A Selective Overview of Deep Learning Jianqing Fan Cong Ma Yiqiao Zhong BDL VLM 112 136 0 10 Apr 2019
Augmented Neural ODEs Emilien Dupont Arnaud Doucet Yee Whye Teh BDL 85 622 0 02 Apr 2019
Forward Stability of ResNet and Its Variants Linan Zhang Hayden Schaeffer 56 47 0 24 Nov 2018
Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity Chulhee Yun S. Sra Ali Jadbabaie 48 118 0 17 Oct 2018
FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Models Will Grathwohl Ricky T. Q. Chen J. Bettencourt Ilya Sutskever David Duvenaud DRL 66 861 0 02 Oct 2018
A Mean-Field Optimal Control Formulation of Deep Learning Weinan E Jiequn Han Qianxiao Li OOD 48 183 0 03 Jul 2018
A Tour of Reinforcement Learning: The View from Continuous Control Benjamin Recht 51 623 0 25 Jun 2018
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 232 5,024 0 19 Jun 2018
Implicit Bias of Gradient Descent on Linear Convolutional Networks Suriya Gunasekar Jason D. Lee Daniel Soudry Nathan Srebro MDE 52 408 0 01 Jun 2018
On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport Lénaïc Chizat Francis R. Bach OT 152 731 0 24 May 2018
Deep Neural Networks Motivated by Partial Differential Equations Lars Ruthotto E. Haber AI4CE 64 488 0 12 Apr 2018
The Implicit Bias of Gradient Descent on Separable Data Daniel Soudry Elad Hoffer Mor Shpigel Nacson Suriya Gunasekar Nathan Srebro 62 908 0 27 Oct 2017
Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations Yiping Lu Aoxiao Zhong Quanzheng Li Bin Dong 137 499 0 27 Oct 2017
Maximum Principle Based Algorithms for Deep Learning Qianxiao Li Long Chen Cheng Tai E. Weinan 45 222 0 26 Oct 2017
Stable Architectures for Deep Neural Networks E. Haber Lars Ruthotto 73 725 0 09 May 2017
Optimal Approximation with Sparsely Connected Deep Neural Networks Helmut Bölcskei Philipp Grohs Gitta Kutyniok P. Petersen 122 256 0 04 May 2017
Understanding deep learning requires rethinking generalization Chiyuan Zhang Samy Bengio Moritz Hardt Benjamin Recht Oriol Vinyals HAI 264 4,612 0 10 Nov 2016
Optimization Methods for Large-Scale Machine Learning Léon Bottou Frank E. Curtis J. Nocedal 173 3,198 0 15 Jun 2016
Understanding Deep Convolutional Networks S. Mallat FAtt AI4CE 97 639 0 19 Jan 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.4K 192,638 0 10 Dec 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 804 149,474 0 22 Dec 2014
Explaining and Harnessing Adversarial Examples Ian Goodfellow Jonathon Shlens Christian Szegedy AAML GAN 161 18,922 0 20 Dec 2014
On the Computational Efficiency of Training Neural Networks Roi Livni Shai Shalev-Shwartz Ohad Shamir 68 479 0 05 Oct 2014
Sequence to Sequence Learning with Neural Networks Ilya Sutskever Oriol Vinyals Quoc V. Le AIMat 275 20,491 0 10 Sep 2014