Momentum Residual Neural Networks

Momentum Residual Neural Networks

15 February 2021

Michael E. Sander

Pierre Ablin

Mathieu Blondel

Papers citing "Momentum Residual Neural Networks"

14 / 14 papers shown

Title
Revisiting Reset Mechanisms in Spiking Neural Networks for Sequential Modeling: Specialized Discretization for Binary Activated RNN Enqi Zhang MQ 149 0 0 24 Apr 2025
Efficient, Accurate and Stable Gradients for Neural ODEs Sam McCallum James Foster 37 4 0 15 Oct 2024
Understanding the training of infinitely deep and wide ResNets with Conditional Optimal Transport Raphael Barboni Gabriel Peyré Franccois-Xavier Vialard 37 3 0 19 Mar 2024
TorchDEQ: A Library for Deep Equilibrium Models Zhengyang Geng J. Zico Kolter VLM 56 12 0 28 Oct 2023
PaReprop: Fast Parallelized Reversible Backpropagation Tyler Lixuan Zhu K. Mangalam 17 1 0 15 Jun 2023
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network Vitaliy Chiley Vithursan Thangarasa Abhay Gupta Anshul Samar Joel Hestness D. DeCoste 50 8 0 28 Jun 2022
Do Residual Neural Networks discretize Neural Ordinary Differential Equations? Michael E. Sander Pierre Ablin Gabriel Peyré 35 25 0 29 May 2022
Momentum Capsule Networks Josef Gugglberger David Peer A. Rodríguez-Sánchez 3DPC 18 1 0 26 Jan 2022
Sinkformers: Transformers with Doubly Stochastic Attention Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 29 76 0 22 Oct 2021
Heavy Ball Neural Ordinary Differential Equations Hedi Xia Vai Suliafu H. Ji T. Nguyen Andrea L. Bertozzi Stanley J. Osher Bao Wang 35 56 0 10 Oct 2021
SHINE: SHaring the INverse Estimate from the forward pass for bi-level optimization and implicit models Zaccharie Ramzi Florian Mannel Shaojie Bai Jean-Luc Starck P. Ciuciu Thomas Moreau 29 28 0 01 Jun 2021
Efficient and Accurate Gradients for Neural SDEs Patrick Kidger James Foster Xuechen Li Terry Lyons DiffM 24 60 0 27 May 2021
Fixing the train-test resolution discrepancy: FixEfficientNet Hugo Touvron Andrea Vedaldi Matthijs Douze Hervé Jégou AAML 196 110 0 18 Mar 2020
Convolutional Neural Networks combined with Runge-Kutta Methods Mai Zhu Bo Chang Chong Fu AI4CE 38 52 0 24 Feb 2018