Heavy Ball Neural Ordinary Differential Equations

10 October 2021

Stanley J. Osher

Bao Wang

ArXiv PDF HTML

Papers citing "Heavy Ball Neural Ordinary Differential Equations"

32 / 32 papers shown

Title
Understanding and Mitigating Membership Inference Risks of Neural Ordinary Differential Equations Sanghyun Hong Fan Wu A. Gruber Kookjin Lee 42 0 0 12 Jan 2025
MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts R. Teo Tan M. Nguyen MoE 33 3 0 18 Oct 2024
Demystifying the Token Dynamics of Deep Selective State Space Models Thieu N. Vo Tung D. Pham Xin T. Tong Tan Minh Nguyen Mamba 49 0 0 04 Oct 2024
The Disappearance of Timestep Embedding in Modern Time-Dependent Neural Networks Bum Jun Kim Yoshinobu Kawahara Sang Woo Kim AI4TS 26 1 0 23 May 2024
Neural Controlled Differential Equations with Quantum Hidden Evolutions Lingyi Yang Zhen Shao 29 0 0 30 Apr 2024
Operator-learning-inspired Modeling of Neural Ordinary Differential Equations Woojin Cho Seunghyeon Cho Hyundong Jin Jinsung Jeon Kookjin Lee Sanghyun Hong Dongeun Lee Jonghyun Choi Noseong Park AI4TS AI4CE 18 2 0 16 Dec 2023
On Tuning Neural ODE for Stability, Consistency and Faster Convergence Sheikh Waqas Akhtar ODL 24 0 0 04 Dec 2023
Stability-Informed Initialization of Neural Ordinary Differential Equations Theodor Westny Arman Mohammadi Daniel Jung Erik Frisk 25 0 0 27 Nov 2023
PGODE: Towards High-quality System Dynamics Modeling Xiao Luo Yiyang Gu Huiyu Jiang Hang Zhou Jinsheng Huang Wei Ju Zhiping Xiao Ming Zhang Yizhou Sun AI4CE 40 6 0 11 Nov 2023
Faster Training of Neural ODEs Using Gauß-Legendre Quadrature Alexander Norcliffe M. Deisenroth 23 3 0 21 Aug 2023
Diffusion Sampling with Momentum for Mitigating Divergence Artifacts Suttisak Wizadwongsa Worameth Chinchuthakun Pramook Khungurn Amit Raj Supasorn Suwajanakorn DiffM 48 2 0 20 Jul 2023
Trainability, Expressivity and Interpretability in Gated Neural ODEs T. Kim T. Can K. Krishnamurthy AI4CE 35 4 0 12 Jul 2023
Linear convergence of forward-backward accelerated algorithms without knowledge of the modulus of strong convexity Bowen Li Bin Shi Ya-xiang Yuan 22 8 0 16 Jun 2023
Locally Regularized Neural Differential Equations: Some Black Boxes Were Meant to Remain Closed! Avik Pal Alan Edelman Chris Rackauckas 22 3 0 03 Mar 2023
Modulated Neural ODEs I. Auzina Çağatay Yıldız Sara Magliacane Matthias Bethge E. Gavves 30 5 0 26 Feb 2023
Learning PDE Solution Operator for Continuous Modeling of Time-Series Yesom Park Jaemoo Choi Changyeon Yoon Changhoon Song Myung-joo Kang AI4TS AI4CE 27 3 0 02 Feb 2023
Revisiting the acceleration phenomenon via high-resolution differential equations Shu Chen Bin Shi Ya-xiang Yuan 21 8 0 12 Dec 2022
Gated Recurrent Neural Networks with Weighted Time-Delay Feedback N. Benjamin Erichson S. H. Lim Michael W. Mahoney 21 6 0 01 Dec 2022
TimeKit: A Time-series Forecasting-based Upgrade Kit for Collaborative Filtering Seoyoung Hong Minju Jo Seung-Uk Kook Jaeeun Jung Hyowon Wi Noseong Park Sung-Bae Cho AI4TS 21 6 0 08 Nov 2022
torchode: A Parallel ODE Solver for PyTorch Marten Lienen Stephan Günnemann LRM 19 11 0 22 Oct 2022
Momentum Transformer: Closing the Performance Gap Between Self-attention and Its Linearization T. Nguyen Richard G. Baraniuk Robert M. Kirby Stanley J. Osher Bao Wang 32 9 0 01 Aug 2022
AdamNODEs: When Neural ODE Meets Adaptive Moment Estimation Suneghyeon Cho Sanghyun Hong Kookjin Lee Noseong Park 28 2 0 13 Jul 2022
Improved Batching Strategy For Irregular Time-Series ODE Ting Fung Lam Yony Bresler Ahmed E. Khorshid Nathan Perlmutter AI4TS 18 0 0 12 Jul 2022
On Numerical Integration in Neural Ordinary Differential Equations Aiqing Zhu Pengzhan Jin Beibei Zhu Yifa Tang 21 26 0 15 Jun 2022
Proximal Implicit ODE Solvers for Accelerating Learning Neural ODEs Justin Baker Hedi Xia Yiwei Wang E. Cherkaev A. Narayan Long Chen Jack Xin Andrea L. Bertozzi Stanley J. Osher Bao Wang 14 6 0 19 Apr 2022
A dynamical systems based framework for dimension reduction Ryeongkyung Yoon Braxton Osting 13 1 0 18 Apr 2022
Learning POD of Complex Dynamics Using Heavy-ball Neural ODEs Justin Baker E. Cherkaev A. Narayan Bao Wang AI4CE 13 4 0 24 Feb 2022
Continuous Deep Equilibrium Models: Training Neural ODEs faster by integrating them to Infinity Avik Pal Alan Edelman Chris Rackauckas 18 6 0 28 Jan 2022
Improving Transformers with Probabilistic Attention Keys Tam Nguyen T. Nguyen Dung D. Le Duy Khuong Nguyen Viet-Anh Tran Richard G. Baraniuk Nhat Ho Stanley J. Osher 53 32 0 16 Oct 2021
How Does Momentum Benefit Deep Neural Networks Architecture Design? A Few Case Studies Bao Wang Hedi Xia T. Nguyen Stanley Osher AI4CE 39 10 0 13 Oct 2021
AIR-Net: Adaptive and Implicit Regularization Neural Network for Matrix Completion Zhemin Li Tao Sun Hongxia Wang Bao Wang 47 6 0 12 Oct 2021
A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights Weijie Su Stephen P. Boyd Emmanuel J. Candes 108 1,154 0 04 Mar 2015