Dynamic Game Theoretic Neural Optimizer

8 May 2021

Guan-Horng Liu

T. Chen

Evangelos A. Theodorou

AI4CE

ArXiv PDF HTML

Papers citing "Dynamic Game Theoretic Neural Optimizer"

27 / 27 papers shown

Title
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 211 30,089 0 01 Mar 2022
Dissecting Hessian: Understanding Common Structure of Hessian in Neural Networks Yikai Wu Xingyu Zhu Chenwei Wu Annie Wang Rong Ge 58 45 0 08 Oct 2020
A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth Yiping Lu Chao Ma Yulong Lu Jianfeng Lu Lexing Ying MLT 92 78 0 11 Mar 2020
Neuron Shapley: Discovering the Responsible Neurons Amirata Ghorbani James Zou FAtt TDI 50 110 0 23 Feb 2020
DDPNOpt: Differential Dynamic Programming Neural Optimizer Guan-Horng Liu T. Chen Evangelos A. Theodorou 46 7 0 20 Feb 2020
Mean-field Langevin System, Optimal Control and Deep Neural Networks Kaitong Hu A. Kazeykina Zhenjie Ren 61 15 0 16 Sep 2019
Deep Learning Theory Review: An Optimal Control and Dynamical Systems Perspective Guan-Horng Liu Evangelos A. Theodorou AI4CE 48 72 0 28 Aug 2019
Hamiltonian Neural Networks S. Greydanus Misko Dzamba J. Yosinski PINN AI4CE 92 890 0 04 Jun 2019
You Only Propagate Once: Accelerating Adversarial Training via Maximal Principle Dinghuai Zhang Tianyuan Zhang Yiping Lu Zhanxing Zhu Bin Dong AAML 96 360 0 02 May 2019
Analysing Neural Network Topologies: a Game Theoretic Approach Julian Stier G. Gianini Michael Granitzer Konstantin Ziegler 32 24 0 17 Apr 2019
Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians Vardan Papyan 51 87 0 24 Jan 2019
Layer-Parallel Training of Deep Residual Neural Networks Stefanie Günther Lars Ruthotto J. Schroder E. Cyr N. Gauger 48 90 0 11 Dec 2018
A Mean-Field Optimal Control Formulation of Deep Learning Weinan E Jiequn Han Qianxiao Li OOD 71 184 0 03 Jul 2018
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 298 5,076 0 19 Jun 2018
Fast Approximate Natural Gradient Descent in a Kronecker-factored Eigenbasis Thomas George César Laurent Xavier Bouthillier Nicolas Ballas Pascal Vincent ODL 61 153 0 11 Jun 2018
An Optimal Control Approach to Deep Learning and Applications to Discrete-Weight Neural Networks Qianxiao Li Shuji Hao 52 75 0 04 Mar 2018
The Mechanics of n-Player Differentiable Games David Balduzzi S. Racanière James Martens Jakob N. Foerster K. Tuyls T. Graepel MLT 60 274 0 15 Feb 2018
Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations Yiping Lu Aoxiao Zhong Quanzheng Li Bin Dong 179 500 0 27 Oct 2017
Maximum Principle Based Algorithms for Deep Learning Qianxiao Li Long Chen Cheng Tai E. Weinan 75 222 0 26 Oct 2017
Reversible Architectures for Arbitrarily Deep Residual Neural Networks B. Chang Lili Meng E. Haber Lars Ruthotto David Begert E. Holtham AI4CE 68 262 0 12 Sep 2017
Empirical Analysis of the Hessian of Over-Parametrized Neural Networks Levent Sagun Utku Evci V. U. Güney Yann N. Dauphin Léon Bottou 54 418 0 14 Jun 2017
Reinforcement Learning with Unsupervised Auxiliary Tasks Max Jaderberg Volodymyr Mnih Wojciech M. Czarnecki Tom Schaul Joel Z Leibo David Silver Koray Kavukcuoglu SSL 70 1,228 0 16 Nov 2016
Deep Online Convex Optimization with Gated Games David Balduzzi 53 8 0 07 Apr 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.7K 193,390 0 10 Dec 2015
Stochastic modified equations and adaptive stochastic gradient algorithms Qianxiao Li Cheng Tai E. Weinan 59 284 0 19 Nov 2015
Optimizing Neural Networks with Kronecker-factored Approximate Curvature James Martens Roger C. Grosse ODL 92 1,008 0 19 Mar 2015
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 1.3K 149,820 0 22 Dec 2014