The Reversible Residual Network: Backpropagation Without Storing Activations

14 July 2017

Papers citing "The Reversible Residual Network: Backpropagation Without Storing Activations"

50 / 120 papers shown

Title
Progressive Stage-wise Learning for Unsupervised Feature Representation Enhancement Zefan Li Chenxi Liu Alan Yuille Bingbing Ni Wenjun Zhang Wen Gao SSL 16 5 0 10 Jun 2021
SHINE: SHaring the INverse Estimate from the forward pass for bi-level optimization and implicit models Zaccharie Ramzi Florian Mannel Shaojie Bai Jean-Luc Starck P. Ciuciu Thomas Moreau 37 28 0 01 Jun 2021
Memory-Efficient Differentiable Transformer Architecture Search Yuekai Zhao Li Dong Yelong Shen Zhihua Zhang Furu Wei Weizhu Chen ViT 32 17 0 31 May 2021
PointLIE: Locally Invertible Embedding for Point Cloud Sampling and Recovery Weibing Zhao Xu Yan Jiantao Gao Ruimao Zhang Jiayan Zhang Zhen Li Song Wu Shuguang Cui 3DPC 18 7 0 30 Apr 2021
Invertible Denoising Network: A Light Solution for Real Noise Removal Yang Liu Zhenyue Qin Saeed Anwar Pan Ji Dongwoo Kim Sabrina Caldwell Tom Gedeon 83 143 0 21 Apr 2021
Do We Need Anisotropic Graph Neural Networks? Shyam A. Tailor Felix L. Opolka Pietro Lio Nicholas D. Lane 51 34 0 03 Apr 2021
No frame left behind: Full Video Action Recognition X. Liu S. Pintea F. Karimi Nejadasl Olaf Booij Jan van Gemert 21 41 0 29 Mar 2021
The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures Sushant Singh A. Mahmood AI4TS 60 94 0 23 Mar 2021
Meta-Solver for Neural Ordinary Differential Equations Julia Gusak A. Katrutsa Talgat Daulbaev A. Cichocki Ivan Oseledets 16 2 0 15 Mar 2021
Symplectic Adjoint Method for Exact Gradient of Neural ODE with Minimal Memory Takashi Matsubara Yuto Miyatake Takaharu Yaguchi 23 23 0 19 Feb 2021
Momentum Residual Neural Networks Michael E. Sander Pierre Ablin Mathieu Blondel Gabriel Peyré 27 57 0 15 Feb 2021
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond Risheng Liu Jiaxin Gao Jin Zhang Deyu Meng Zhouchen Lin AI4CE 62 223 0 27 Jan 2021
Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup Luyu Gao Yunyi Zhang Jiawei Han Jamie Callan 34 92 0 18 Jan 2021
ReAssert: Deep Learning for Assert Generation Robert White J. Krinke 34 14 0 19 Nov 2020
A Novel Memory-Efficient Deep Learning Training Framework via Error-Bounded Lossy Compression Sian Jin Guanpeng Li Shuaiwen Leon Song Dingwen Tao AI4CE 29 12 0 18 Nov 2020
Why Layer-Wise Learning is Hard to Scale-up and a Possible Solution via Accelerated Downsampling Wenchi Ma Miao Yu Kaidong Li Guanghui Wang 17 5 0 15 Oct 2020
SMYRF: Efficient Attention using Asymmetric Clustering Giannis Daras Nikita Kitaev Augustus Odena A. Dimakis 31 44 0 11 Oct 2020
Deep Learning Based Brain Tumor Segmentation: A Survey Zhihua Liu Lei Tong Zheheng Jiang Long Chen Feixiang Zhou Qianni Zhang Xiangrong Zhang Ling Li Huiyu Zhou 3DV 24 228 0 18 Jul 2020
Data Movement Is All You Need: A Case Study on Optimizing Transformers A. Ivanov Nikoli Dryden Tal Ben-Nun Shigang Li Torsten Hoefler 36 131 0 30 Jun 2020
Relative gradient optimization of the Jacobian term in unsupervised deep learning Luigi Gresele G. Fissore Adrián Javaloy Bernhard Schölkopf Aapo Hyvarinen DRL 19 22 0 26 Jun 2020
LAMP: Large Deep Nets with Automated Model Parallelism for Image Segmentation Wentao Zhu Can Zhao Wenqi Li H. Roth Ziyue Xu Daguang Xu 3DV 32 18 0 22 Jun 2020
Modeling Lost Information in Lossy Image Compression Yaolong Wang Mingqing Xiao Chang-Shu Liu Shuxin Zheng Tie-Yan Liu 32 23 0 22 Jun 2020
Dynamic Tensor Rematerialization Marisa Kirisame Steven Lyubomirsky Altan Haan Jennifer Brennan Mike He Jared Roesch Tianqi Chen Zachary Tatlock 29 93 0 17 Jun 2020
Understanding and Mitigating Exploding Inverses in Invertible Neural Networks Jens Behrmann Paul Vicol Kuan-Chieh Jackson Wang Roger C. Grosse J. Jacobsen 23 93 0 16 Jun 2020
Globally Injective ReLU Networks Michael Puthawala K. Kothari Matti Lassas Ivan Dokmanić Maarten V. de Hoop 29 26 0 15 Jun 2020
UFO-BLO: Unbiased First-Order Bilevel Optimization Valerii Likhosherstov Xingyou Song K. Choromanski Jared Davis Adrian Weller 34 7 0 05 Jun 2020
Augmented Normalizing Flows: Bridging the Gap Between Generative Flows and Latent Variable Models Chin-Wei Huang Laurent Dinh Aaron Courville DRL 31 87 0 17 Feb 2020
Normalizing Flows for Probabilistic Modeling and Inference George Papamakarios Eric T. Nalisnick Danilo Jimenez Rezende S. Mohamed Balaji Lakshminarayanan TPM AI4CE 62 1,631 0 05 Dec 2019
Multi-Channel Volumetric Neural Network for Knee Cartilage Segmentation in Cone-beam CT Jennifer K. Maier Luis Carlos Rivera Monroy Christopher Syben Yejin Jeon Jang-Hwan Choi M. Hall M. Levenston G. Gold R. Fahrig Andreas Maier 21 1 0 03 Dec 2019
Optimal checkpointing for heterogeneous chains: how to train deep neural networks with limited memory Julien Herrmann Olivier Beaumont Lionel Eyraud-Dubois J. Herrmann Alexis Joly Alena Shilova BDL 31 29 0 27 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 50 11,871 0 13 Nov 2019
Streaming convolutional neural networks for end-to-end learning with multi-megapixel images H. Pinckaers Bram van Ginneken G. Litjens MedIm 27 94 0 11 Nov 2019
CrevNet: Conditionally Reversible Video Prediction Wei Yu Y. Lu S. Easterbrook Sanja Fidler 17 19 0 25 Oct 2019
i-RIM applied to the fastMRI challenge P. Putzky D. Karkalousos Jonas Teuwen Nikita Miriakov Bart Bakker M. Caan Max Welling 6 39 0 20 Oct 2019
Decision Explanation and Feature Importance for Invertible Networks Juntang Zhuang Nicha Dvornek Xiaoxiao Li Junlin Yang James S. Duncan AAML FAtt 33 5 0 30 Sep 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 109 6,377 0 26 Sep 2019
GResNet: Graph Residual Network for Reviving Deep GNNs from Suspended Animation Jiawei Zhang Lin Meng 21 52 0 12 Sep 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 69 542 0 04 Jul 2019
A Review on Deep Learning in Medical Image Reconstruction Hai-Miao Zhang Bin Dong MedIm 35 122 0 23 Jun 2019
Learning Symmetries of Classical Integrable Systems Roberto Bondesan A. Lamacraft 22 39 0 11 Jun 2019
Neural Spline Flows Conor Durkan Artur Bekasov Iain Murray George Papamakarios DRL 29 745 0 10 Jun 2019
Graph Normalizing Flows Jenny Liu Aviral Kumar Jimmy Ba J. Kiros Kevin Swersky BDL GNN AI4CE 27 155 0 30 May 2019
Invertible generative models for inverse problems: mitigating representation error and dataset bias Muhammad Asim Max Daniels Oscar Leong Ali Ahmed Paul Hand 26 146 0 28 May 2019
HINT: Hierarchical Invertible Neural Transport for Density Estimation and Bayesian Inference Jakob Kruse Gianluca Detommaso Ullrich Kothe Robert Scheichl 13 45 0 25 May 2019
Semi-Supervised Learning with Scarce Annotations Sylvestre-Alvise Rebuffi Sébastien Ehrhardt Kai Han Andrea Vedaldi Andrew Zisserman SSL 24 49 0 21 May 2019
IMEXnet: A Forward Stable Deep Neural Network E. Haber Keegan Lensink Eran Treister Lars Ruthotto 36 40 0 06 Mar 2019
VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generation Manoj Kumar Mohammad Babaeizadeh D. Erhan Chelsea Finn Sergey Levine Laurent Dinh Durk Kingma VGen 25 131 0 04 Mar 2019
ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs A. Gholami Kurt Keutzer George Biros 30 166 0 27 Feb 2019
Adversarial Neural Network Inversion via Auxiliary Knowledge Alignment Ziqi Yang E. Chang Zhenkai Liang MLAU 33 60 0 22 Feb 2019
Emerging Convolutions for Generative Normalizing Flows Emiel Hoogeboom Rianne van den Berg Max Welling DRL 24 98 0 30 Jan 2019