Stochastic Training of Residual Networks: a Differential Equation Viewpoint

1 December 2018

Papers citing "Stochastic Training of Residual Networks: a Differential Equation Viewpoint"

13 / 13 papers shown

Title
PDE+: Enhancing Generalization via PDE with Adaptive Distributional Diffusion Yige Yuan Bingbing Xu Bo Lin Liang Hou Fei Sun Huawei Shen Xueqi Cheng DiffM 31 4 0 25 May 2023
Neural Delay Differential Equations: System Reconstruction and Image Classification Qunxi Zhu Yao Guo Wei Lin 25 32 0 11 Apr 2023
Understanding Adversarial Robustness of Vision Transformers via Cauchy Problem Zheng Wang Wenjie Ruan ViT 42 8 0 01 Aug 2022
Do Residual Neural Networks discretize Neural Ordinary Differential Equations? Michael E. Sander Pierre Ablin Gabriel Peyré 40 25 0 29 May 2022
Sinkformers: Transformers with Doubly Stochastic Attention Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 37 77 0 22 Oct 2021
Neural Network Layer Algebra: A Framework to Measure Capacity and Compression in Deep Learning Alberto Badías A. Banerjee 25 3 0 02 Jul 2021
Momentum Residual Neural Networks Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 32 57 0 15 Feb 2021
A Differential Game Theoretic Neural Optimizer for Training Residual Networks Guan-Horng Liu T. Chen Evangelos A. Theodorou 24 2 0 17 Jul 2020
Discovery of Dynamics Using Linear Multistep Methods Rachael Keller Q. Du 31 36 0 29 Dec 2019
Deep Learning via Dynamical Systems: An Approximation Perspective Qianxiao Li Ting Lin Zuowei Shen AI4TS AI4CE 30 107 0 22 Dec 2019
A Review on Deep Learning in Medical Image Reconstruction Hai-Miao Zhang Bin Dong MedIm 35 122 0 23 Jun 2019
A cooperative game for automated learning of elasto-plasticity knowledge graphs and models with AI-guided experimentation Kun Wang WaiChing Sun Q. Du AI4CE 23 56 0 08 Mar 2019
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 312 2,896 0 15 Sep 2016