v1v2 (latest)

Stability-Informed Initialization of Neural Ordinary Differential Equations

27 November 2023

Papers citing "Stability-Informed Initialization of Neural Ordinary Differential Equations"

26 / 26 papers shown

Title
Analysis of Numerical Integration in RNN-Based Residuals for Fault Diagnosis of Dynamic Systems Arman Mohammadi Theodor Westny Daniel E. Jung Mattias Krysander 44 5 0 08 May 2023
On Numerical Integration in Neural Ordinary Differential Equations Aiqing Zhu Pengzhan Jin Beibei Zhu Yifa Tang 70 27 0 15 Jun 2022
It's Raw! Audio Generation with State-Space Models Karan Goel Albert Gu Chris Donahue Christopher Ré 63 193 0 20 Feb 2022
Which priors matter? Benchmarking models for learning latent dynamics Aleksandar Botev Andrew Jaegle Peter Wirnsberger Daniel Hennes I. Higgins AI4CE 111 28 0 09 Nov 2021
Heavy Ball Neural Ordinary Differential Equations Hedi Xia Vai Suliafu H. Ji T. Nguyen Andrea L. Bertozzi Stanley J. Osher Bao Wang 85 61 0 10 Oct 2021
Benchmarking Energy-Conserving Neural Networks for Learning Dynamics from Data Yaofeng Desmond Zhong Biswadip Dey Amit Chakraborty PINN AI4CE 110 48 0 03 Dec 2020
HiPPO: Recurrent Memory with Optimal Polynomial Projections Albert Gu Tri Dao Stefano Ermon Atri Rudra Christopher Ré 134 535 0 17 Aug 2020
Continuous-in-Depth Neural Networks A. Queiruga N. Benjamin Erichson D. Taylor Michael W. Mahoney 87 48 0 05 Aug 2020
ResNet After All? Neural ODEs and Their Numerical Solution Katharina Ott P. Katiyar Philipp Hennig Michael Tiemann 69 31 0 30 Jul 2020
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains Matthew Tancik Pratul P. Srinivasan B. Mildenhall Sara Fridovich-Keil N. Raghavan Utkarsh Singhal R. Ramamoorthi Jonathan T. Barron Ren Ng 135 2,449 0 18 Jun 2020
Gradient Amplification: An efficient way to train deep neural networks S. Basodi Chunyan Ji Haiping Zhang Yi Pan ODL 45 116 0 16 Jun 2020
Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODE Juntang Zhuang Nicha Dvornek Xiaoxiao Li S. Tatikonda X. Papademetris James Duncan BDL 113 112 0 03 Jun 2020
Neural Controlled Differential Equations for Irregular Time Series Patrick Kidger James Morrill James Foster Terry Lyons AI4TS 129 483 0 18 May 2020
Frequency Bias in Neural Networks for Input of Non-Uniform Density Ronen Basri Meirav Galun Amnon Geifman David Jacobs Yoni Kasten S. Kritchman 92 185 0 10 Mar 2020
Dissecting Neural ODEs Stefano Massaroli Michael Poli Jinkyoo Park Atsushi Yamashita Hajime Asama 121 204 0 19 Feb 2020
On Robustness of Neural Ordinary Differential Equations Hanshu Yan Jiawei Du Vincent Y. F. Tan Jiashi Feng OOD 82 141 0 12 Oct 2019
Approximation Capabilities of Neural ODEs and Invertible Residual Networks Han Zhang Xi Gao Jacob Unterman Tom Arodz 76 100 0 30 Jul 2019
ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs A. Gholami Kurt Keutzer George Biros 110 172 0 27 Feb 2019
On the Spectral Bias of Neural Networks Nasim Rahaman A. Baratin Devansh Arpit Felix Dräxler Min Lin Fred Hamprecht Yoshua Bengio Aaron Courville 161 1,456 0 22 Jun 2018
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 457 5,168 0 19 Jun 2018
WaveNet: A Generative Model for Raw Audio Aaron van den Oord Sander Dieleman Heiga Zen Karen Simonyan Oriol Vinyals Alex Graves Nal Kalchbrenner A. Senior Koray Kavukcuoglu DiffM 406 7,425 0 12 Sep 2016
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter 307 5,539 0 23 Nov 2015
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 355 18,661 0 06 Feb 2015
An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks Ian Goodfellow M. Berk Mirza Xia Da Aaron Courville Yoshua Bengio 159 1,455 0 21 Dec 2013
Auto-Encoding Variational Bayes Diederik P. Kingma Max Welling BDL 461 16,922 0 20 Dec 2013
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 196 1,852 0 20 Dec 2013