Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations

27 October 2017

Papers citing "Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations"

50 / 124 papers shown

Title
Heavy Ball Neural Ordinary Differential Equations Hedi Xia Vai Suliafu H. Ji T. Nguyen Andrea L. Bertozzi Stanley J. Osher Bao Wang 45 56 0 10 Oct 2021
Designing Rotationally Invariant Neural Networks from PDEs and Variational Methods Tobias Alt Karl Schrader Joachim Weickert Pascal Peter M. Augustin 32 4 0 31 Aug 2021
m-RevNet: Deep Reversible Neural Networks with Momentum Duo Li Shangqi Gao 36 5 0 12 Aug 2021
LightMove: A Lightweight Next-POI Recommendation for Taxicab Rooftop Advertising Jinsung Jeon Soyoung Kang Minju Jo Seunghyeon Cho Noseong Park Seonghoon Kim Chiyoung Song 36 16 0 11 Aug 2021
LT-OCF: Learnable-Time ODE-based Collaborative Filtering Jeongwhan Choi Jinsung Jeon Noseong Park 32 30 0 08 Aug 2021
PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equations Moshe Eliasof E. Haber Eran Treister GNN AI4CE 39 123 0 04 Aug 2021
ResIST: Layer-Wise Decomposition of ResNets for Distributed Training Chen Dun Cameron R. Wolfe C. Jermaine Anastasios Kyrillidis 29 21 0 02 Jul 2021
Neural ODE to model and prognose thermoacoustic instability Jayesh M. Dhadphale Vishnu R Unni A. Saha R. Sujith 25 13 0 24 Jun 2021
Machine learning structure preserving brackets for forecasting irreversible processes Kookjin Lee Nathaniel Trask P. Stinis AI4CE 44 43 0 23 Jun 2021
Stateful ODE-Nets using Basis Function Expansions A. Queiruga N. Benjamin Erichson Liam Hodgkinson Michael W. Mahoney 27 16 0 21 Jun 2021
Steerable Partial Differential Operators for Equivariant Neural Networks Erik Jenner Maurice Weiler 27 28 0 18 Jun 2021
Opening the Blackbox: Accelerating Neural Differential Equations by Regularizing Internal Solver Heuristics Avik Pal Yingbo Ma Viral B. Shah Chris Rackauckas 28 36 0 09 May 2021
A unified framework for Hamiltonian deep neural networks C. Galimberti Liang Xu Giancarlo Ferrari-Trecate 42 5 0 27 Apr 2021
Combining distribution-based neural networks to predict weather forecast probabilities M. Clare Omar Jamil C. Morcrette UQCV 22 41 0 26 Mar 2021
JFB: Jacobian-Free Backpropagation for Implicit Networks Samy Wu Fung Howard Heaton Qiuwei Li Daniel McKenzie Stanley Osher W. Yin FedML 40 84 0 23 Mar 2021
Meta-Solver for Neural Ordinary Differential Equations Julia Gusak A. Katrutsa Talgat Daulbaev A. Cichocki Ivan Oseledets 16 2 0 15 Mar 2021
Dissecting the Diffusion Process in Linear Graph Convolutional Networks Yifei Wang Yisen Wang Jiansheng Yang Zhouchen Lin GNN 44 79 0 22 Feb 2021
Symplectic Adjoint Method for Exact Gradient of Neural ODE with Minimal Memory Takashi Matsubara Yuto Miyatake Takaharu Yaguchi 23 23 0 19 Feb 2021
Momentum Residual Neural Networks Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 32 57 0 15 Feb 2021
MALI: A memory efficient and reverse accurate integrator for Neural ODEs Juntang Zhuang Nicha Dvornek S. Tatikonda James S. Duncan 30 49 0 09 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 67 223 0 27 Jan 2021
Lagrangian Reachtubes: The Next Generation Sophie Gruenbacher J. Cyranka Mathias Lechner Md. Ariful Islam S. Smolka Radu Grosu 16 13 0 14 Dec 2020
Deep Neural Networks Are Effective At Learning High-Dimensional Hilbert-Valued Functions From Limited Data Ben Adcock Simone Brugiapaglia N. Dexter S. Moraga 41 29 0 11 Dec 2020
Deep Neural Networks using a Single Neuron: Folded-in-Time Architecture using Feedback-Modulated Delay Loops Florian Stelzer André Röhm Raul Vicente Ingo Fischer University of Tartu AI4CE 19 46 0 19 Nov 2020
A Helmholtz equation solver using unsupervised learning: Application to transcranial ultrasound A. Stanziola Simon Arridge B. Cox B. Treeby 16 33 0 29 Oct 2020
Physical System for Non Time Sequence Data Xiong Chen CML 13 0 0 07 Oct 2020
A Practical Layer-Parallel Training Algorithm for Residual Networks Qi Sun Hexin Dong Zewei Chen Weizhen Dian Jiacheng Sun Yitong Sun Zhenguo Li Bin Dong ODL 27 2 0 03 Sep 2020
A Differential Game Theoretic Neural Optimizer for Training Residual Networks Guan-Horng Liu T. Chen Evangelos A. Theodorou 24 2 0 17 Jul 2020
Layer-Parallel Training with GPU Concurrency of Deep Residual Neural Networks via Nonlinear Multigrid Andrew Kirby S. Samsi Michael Jones Albert Reuther J. Kepner V. Gadepally 25 12 0 14 Jul 2020
STEER: Simple Temporal Regularization For Neural ODEs Arna Ghosh Harkirat Singh Behl Emilien Dupont Philip Torr Vinay P. Namboodiri BDL AI4TS 27 74 0 18 Jun 2020
On Second Order Behaviour in Augmented Neural ODEs Alexander Norcliffe Cristian Bodnar Ben Day Nikola Simidjievski Pietro Lio 39 90 0 12 Jun 2020
Learning advanced mathematical computations from examples Franccois Charton Amaury Hayat Guillaume Lample PINN 26 4 0 11 Jun 2020
Machine Learning and Control Theory A. Bensoussan Yiqun Li Dinh Phan Cao Nguyen M. Tran S. Yam Xiang Zhou AI4CE 32 12 0 10 Jun 2020
Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODE Juntang Zhuang Nicha Dvornek Xiaoxiao Li S. Tatikonda X. Papademetris James Duncan BDL 66 110 0 03 Jun 2020
Discretize-Optimize vs. Optimize-Discretize for Time-Series Regression and Continuous Normalizing Flows Derek Onken Lars Ruthotto BDL 32 52 0 27 May 2020
Fractional Deep Neural Network via Constrained Optimization Harbir Antil R. Khatri R. Löhner Deepanshu Verma 30 29 0 01 Apr 2020
Stable Neural Flows Stefano Massaroli Michael Poli Michelangelo Bin Jinkyoo Park Atsushi Yamashita Hajime Asama 46 31 0 18 Mar 2020
A Mean-field Analysis of Deep ResNet and Beyond: Towards Provable Optimization Via Overparameterization From Depth Yiping Lu Chao Ma Yulong Lu Jianfeng Lu Lexing Ying MLT 39 78 0 11 Mar 2020
Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Prediction Vincent Le Guen Nicolas Thome AI4CE PINN 98 289 0 03 Mar 2020
Stochastic Latent Residual Video Prediction Jean-Yves Franceschi E. Delasalles Mickaël Chen Sylvain Lamprier Patrick Gallinari VGen 28 159 0 21 Feb 2020
FEA-Net: A Physics-guided Data-driven Model for Efficient Mechanical Response Prediction Houpu Yao Yi Gao Yongming Liu AI4CE 68 66 0 31 Jan 2020
PDE-based Group Equivariant Convolutional Neural Networks B. Smets J. Portegies Erik J. Bekkers R. Duits AI4CE 21 53 0 24 Jan 2020
On Interpretability of Artificial Neural Networks: A Survey Fenglei Fan Jinjun Xiong Mengzhou Li Ge Wang AAML AI4CE 43 301 0 08 Jan 2020
Mean-Field and Kinetic Descriptions of Neural Differential Equations Michael Herty T. Trimborn G. Visconti 41 6 0 07 Jan 2020
Scalable Gradients for Stochastic Differential Equations Xuechen Li Ting-Kam Leonard Wong Ricky T. Q. Chen David Duvenaud 17 312 0 05 Jan 2020
Machine Learning from a Continuous Viewpoint E. Weinan Chao Ma Lei Wu 33 102 0 30 Dec 2019
Deep Learning via Dynamical Systems: An Approximation Perspective Qianxiao Li Ting Lin Zuowei Shen AI4TS AI4CE 30 107 0 22 Dec 2019
Multilevel Initialization for Layer-Parallel Deep Neural Network Training E. Cyr Stefanie Günther J. Schroder AI4CE 22 11 0 19 Dec 2019
Graph Neural Ordinary Differential Equations Michael Poli Stefano Massaroli Junyoung Park Atsushi Yamashita Hajime Asama Jinkyoo Park AI4CE 51 154 0 18 Nov 2019
Neural Similarity Learning Weiyang Liu Zhen Liu James M. Rehg Le Song 27 29 0 28 Oct 2019