On Dissipativity of Cross-Entropy Loss in Training ResNets

29 May 2024

Papers citing "On Dissipativity of Cross-Entropy Loss in Training ResNets"

17 / 17 papers shown

Title
Deep Equilibrium Models are Almost Equivalent to Not-so-deep Explicit Models for High-dimensional Gaussian Mixtures Zenan Ling Longbo Li Zhanbo Feng Yixuan Zhang Feng Zhou Robert C. Qiu Zhenyu Liao 51 4 0 05 Feb 2024
Unconstrained Parametrization of Dissipative and Contracting Neural Ordinary Differential Equations D. Martinelli C. Galimberti I. Manchester Luca Furieri Giancarlo Ferrari-Trecate 43 12 0 06 Apr 2023
Hamiltonian Deep Neural Networks Guaranteeing Non-vanishing Gradients by Design C. Galimberti Luca Furieri Liang Xu Giancarlo Ferrari-Trecate 40 32 0 27 May 2021
Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustness Max Revay Ruigang Wang I. Manchester 48 58 0 13 Apr 2021
Sparsity in long-time control of neural ODEs C. Yagüe Borjan Geshkovski 29 8 0 26 Feb 2021
On the Turnpike to Design of Deep Neural Nets: Explicit Depth Bounds T. Faulwasser Arne-Jens Hempel S. Streif 34 5 0 08 Jan 2021
Large-time asymptotics in deep learning Carlos Esteve Borjan Geshkovski Dario Pighin Enrique Zuazua 47 34 0 06 Aug 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 108 42,038 0 03 Dec 2019
Deep Equilibrium Models Shaojie Bai J. Zico Kolter V. Koltun 37 663 0 03 Sep 2019
Understanding Impacts of High-Order Loss Approximations and Features in Deep Learning Interpretation Sahil Singla Eric Wallace Shi Feng Soheil Feizi FAtt 43 59 0 01 Feb 2019
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 179 5,024 0 19 Jun 2018
Large Margin Deep Networks for Classification Gamaleldin F. Elsayed Dilip Krishnan H. Mobahi Kevin Regan Samy Bengio MQ 45 282 0 15 Mar 2018
Maximum Principle Based Algorithms for Deep Learning Qianxiao Li Long Chen Cheng Tai E. Weinan 41 222 0 26 Oct 2017
Reversible Architectures for Arbitrarily Deep Residual Neural Networks B. Chang Lili Meng E. Haber Lars Ruthotto David Begert E. Holtham AI4CE 48 262 0 12 Sep 2017
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.0K 192,638 0 10 Dec 2015
Rethinking the Inception Architecture for Computer Vision Christian Szegedy Vincent Vanhoucke Sergey Ioffe Jonathon Shlens Z. Wojna 3DV BDL 353 27,231 0 02 Dec 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 450 149,474 0 22 Dec 2014