Reversible Architectures for Arbitrarily Deep Residual Neural Networks

12 September 2017

Papers citing "Reversible Architectures for Arbitrarily Deep Residual Neural Networks"

50 / 55 papers shown

Title
Good Things Come in Pairs: Paired Autoencoders for Inverse Problems Matthias Chung Bas Peters Michael Solomon 39 0 0 10 May 2025
On Dissipativity of Cross-Entropy Loss in Training ResNets Jens Püttschneider T. Faulwasser 35 0 0 29 May 2024
PaReprop: Fast Parallelized Reversible Backpropagation Tyler Lixuan Zhu K. Mangalam 17 1 0 15 Jun 2023
Universal Approximation Property of Hamiltonian Deep Neural Networks M. Zakwan M. d’Angelo Giancarlo Ferrari-Trecate 36 5 0 21 Mar 2023
CQnet: convex-geometric interpretation and constraining neural-network trajectories Bas Peters 35 0 0 09 Feb 2023
Certified Invertibility in Neural Networks via Mixed-Integer Programming Tianqi Cui Tom S. Bertalan George J. Pappas M. Morari Ioannis G. Kevrekidis Mahyar Fazlyab AAML 27 2 0 27 Jan 2023
Reversible Column Networks Yuxuan Cai Yi Zhou Qi Han Jianjian Sun Xiangwen Kong Jun Yu Li Xiangyu Zhang VLM 31 53 0 22 Dec 2022
Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules Kazuki Irie Francesco Faccio Jürgen Schmidhuber AI4TS 38 11 0 03 Jun 2022
Momentum Capsule Networks Josef Gugglberger David Peer A. Rodríguez-Sánchez 3DPC 20 1 0 26 Jan 2022
Neural Flows: Efficient Alternative to Neural ODEs Marin Bilovs Johanna Sommer Syama Sundar Rangapuram Tim Januschowski Stephan Günnemann AI4TS 33 70 0 25 Oct 2021
Locally-symplectic neural networks for learning volume-preserving dynamics J. Bajārs 34 9 0 19 Sep 2021
m-RevNet: Deep Reversible Neural Networks with Momentum Duo Li Shangqi Gao 36 5 0 12 Aug 2021
PDE-GCN: Novel Architectures for Graph Neural Networks Motivated by Partial Differential Equations Moshe Eliasof E. Haber Eran Treister GNN AI4CE 39 123 0 04 Aug 2021
Cell-average based neural network method for hyperbolic and parabolic partial differential equations Changxin Qiu Jue Yan 16 10 0 02 Jul 2021
Stateful ODE-Nets using Basis Function Expansions A. Queiruga N. Benjamin Erichson Liam Hodgkinson Michael W. Mahoney 27 16 0 21 Jun 2021
Memory-Efficient Differentiable Transformer Architecture Search Yuekai Zhao Li Dong Yelong Shen Zhihua Zhang Furu Wei Weizhu Chen ViT 32 17 0 31 May 2021
A unified framework for Hamiltonian deep neural networks C. Galimberti Liang Xu Giancarlo Ferrari-Trecate 42 5 0 27 Apr 2021
No frame left behind: Full Video Action Recognition X. Liu S. Pintea F. Karimi Nejadasl Olaf Booij Jan van Gemert 21 41 0 29 Mar 2021
Almost Surely Stable Deep Dynamics Nathan P. Lawrence Philip D. Loewen M. Forbes Johan U. Backstrom R. Bhushan Gopaluni BDL 40 20 0 26 Mar 2021
JFB: Jacobian-Free Backpropagation for Implicit Networks Samy Wu Fung Howard Heaton Qiuwei Li Daniel McKenzie Stanley Osher W. Yin FedML 35 84 0 23 Mar 2021
Momentum Residual Neural Networks Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 27 57 0 15 Feb 2021
Learning Optimal Representations with the Decodable Information Bottleneck Yann Dubois Douwe Kiela D. Schwab Ramakrishna Vedantam 26 43 0 27 Sep 2020
Point-to-set distance functions for weakly supervised segmentation Bas Peters 18 1 0 27 Jul 2020
A Differential Game Theoretic Neural Optimizer for Training Residual Networks Guan-Horng Liu T. Chen Evangelos A. Theodorou 24 2 0 17 Jul 2020
Understanding and Mitigating Exploding Inverses in Invertible Neural Networks Jens Behrmann Paul Vicol Kuan-Chieh Jackson Wang Roger C. Grosse J. Jacobsen 23 93 0 16 Jun 2020
Machine Learning and Control Theory A. Bensoussan Yiqun Li Dinh Phan Cao Nguyen M. Tran S. Yam Xiang Zhou AI4CE 32 12 0 10 Jun 2020
Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODE Juntang Zhuang Nicha Dvornek Xiaoxiao Li S. Tatikonda X. Papademetris James Duncan BDL 66 110 0 03 Jun 2020
Optimizing Neural Networks via Koopman Operator Theory Akshunna S. Dogra William T. Redman 19 50 0 03 Jun 2020
Discretize-Optimize vs. Optimize-Discretize for Time-Series Regression and Continuous Normalizing Flows Derek Onken Lars Ruthotto BDL 32 52 0 27 May 2020
Neural Ordinary Differential Equation based Recurrent Neural Network Model M. Habiba Barak A. Pearlmutter AI4TS 35 24 0 20 May 2020
On Information Plane Analyses of Neural Network Classifiers -- A Review Bernhard C. Geiger 32 50 0 21 Mar 2020
Scalable Gradients for Stochastic Differential Equations Xuechen Li Ting-Kam Leonard Wong Ricky T. Q. Chen David Duvenaud 17 310 0 05 Jan 2020
Deep Learning via Dynamical Systems: An Approximation Perspective Qianxiao Li Ting Lin Zuowei Shen AI4TS AI4CE 25 107 0 22 Dec 2019
Multilevel Initialization for Layer-Parallel Deep Neural Network Training E. Cyr Stefanie Günther J. Schroder AI4CE 22 11 0 19 Dec 2019
Optimal checkpointing for heterogeneous chains: how to train deep neural networks with limited memory Julien Herrmann Olivier Beaumont Lionel Eyraud-Dubois J. Herrmann Alexis Joly Alena Shilova BDL 31 29 0 27 Nov 2019
A Review on Deep Learning in Medical Image Reconstruction Hai-Miao Zhang Bin Dong MedIm 35 122 0 23 Jun 2019
Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stability Shaowu Pan Karthik Duraisamy 23 136 0 09 Jun 2019
Neural-networks for geophysicists and their application to seismic data interpretation Bas Peters E. Haber J. Granek AI4CE 22 36 0 27 Mar 2019
IMEXnet: A Forward Stable Deep Neural Network E. Haber Keegan Lensink Eran Treister Lars Ruthotto 36 40 0 06 Mar 2019
ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs A. Gholami Kurt Keutzer George Biros 30 166 0 27 Feb 2019
Forward Stability of ResNet and Its Variants Linan Zhang Hayden Schaeffer 30 47 0 24 Nov 2018
Invertible Residual Networks Jens Behrmann Will Grathwohl Ricky T. Q. Chen David Duvenaud J. Jacobsen UQCV TPM 34 618 0 02 Nov 2018
Monge-Ampère Flow for Generative Modeling Linfeng Zhang E. Weinan Lei Wang DRL 19 62 0 26 Sep 2018
Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network A. Sherstinsky 39 3,603 0 09 Aug 2018
A Mean-Field Optimal Control Formulation of Deep Learning Weinan E Jiequn Han Qianxiao Li OOD 14 182 0 03 Jul 2018
Neural Ordinary Differential Equations T. Chen Yulia Rubanova J. Bettencourt David Duvenaud AI4CE 101 4,954 0 19 Jun 2018
Generative Adversarial Forests for Better Conditioned Adversarial Learning Yan Zuo Gil Avraham Tom Drummond GAN AI4CE 22 8 0 14 May 2018
Deep Neural Networks Motivated by Partial Differential Equations Lars Ruthotto E. Haber AI4CE 27 484 0 12 Apr 2018
An Optimal Control Approach to Deep Learning and Applications to Discrete-Weight Neural Networks Qianxiao Li Shuji Hao 21 75 0 04 Mar 2018
Learning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle Rana Ali Amjad Bernhard C. Geiger 35 196 0 27 Feb 2018