Differentiable Multiple Shooting Layers

Differentiable Multiple Shooting Layers

7 June 2021

Stefano Massaroli

Jinkyoo Park

Atsushi Yamashita

Papers citing "Differentiable Multiple Shooting Layers"

19 / 19 papers shown

Title
Towards Scalable and Stable Parallelization of Nonlinear RNNs Xavier Gonzalez Andrew Warrington Jimmy T.H. Smith Scott W. Linderman 138 10 0 17 Jan 2025
Opening the Blackbox: Accelerating Neural Differential Equations by Regularizing Internal Solver Heuristics Avik Pal Yingbo Ma Viral B. Shah Chris Rackauckas 40 36 0 09 May 2021
Multiple-shooting adjoint method for whole-brain dynamic causal modeling Juntang Zhuang Nicha Dvornek S. Tatikonda X. Papademetris P. Ventola James Duncan 11 7 0 14 Feb 2021
TorchDyn: A Neural Differential Equations Library Michael Poli Stefano Massaroli Atsushi Yamashita Hajime Asama Jinkyoo Park AI4CE 22 24 0 20 Sep 2020
A Practical Layer-Parallel Training Algorithm for Residual Networks Qi Sun Hexin Dong Zewei Chen Weizhen Dian Jiacheng Sun Yitong Sun Zhenguo Li Bin Dong ODL 35 2 0 03 Sep 2020
Hypersolvers: Toward Fast Continuous-Depth Models Michael Poli Stefano Massaroli Atsushi Yamashita Hajime Asama Jinkyoo Park BDL AI4CE 26 46 0 19 Jul 2020
Layer-Parallel Training with GPU Concurrency of Deep Residual Neural Networks via Nonlinear Multigrid Andrew Kirby S. Samsi Michael Jones Albert Reuther J. Kepner V. Gadepally 42 12 0 14 Jul 2020
A Shooting Formulation of Deep Learning François-Xavier Vialard Roland Kwitt Susan Wei Marc Niethammer 16 13 0 18 Jun 2020
Neural Controlled Differential Equations for Irregular Time Series Patrick Kidger James Morrill James Foster Terry Lyons AI4TS 65 459 0 18 May 2020
Dissecting Neural ODEs Stefano Massaroli Michael Poli Jinkyoo Park Atsushi Yamashita Hajime Asama 56 200 0 19 Feb 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 118 42,038 0 03 Dec 2019
PPINN: Parareal Physics-Informed Neural Network for time-dependent PDEs Xuhui Meng Zhen Li Dongkun Zhang George Karniadakis PINN AI4CE 29 446 0 23 Sep 2019
Deep Equilibrium Models Shaojie Bai J. Zico Kolter V. Koltun 37 663 0 03 Sep 2019
Neural Jump Stochastic Differential Equations Junteng Jia Austin R. Benson BDL 41 222 0 24 May 2019
DiffEqFlux.jl - A Julia Library for Neural Differential Equations Christopher Rackauckas Mike Innes Yingbo Ma J. Bettencourt Lyndon White Vaibhav Dixit 33 116 0 06 Feb 2019
Layer-Parallel Training of Deep Residual Neural Networks Stefanie Günther Lars Ruthotto J. Schroder E. Cyr N. Gauger 31 90 0 11 Dec 2018
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 189 5,024 0 19 Jun 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 314 129,831 0 12 Jun 2017
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 519 149,474 0 22 Dec 2014