The Reversible Residual Network: Backpropagation Without Storing Activations

14 July 2017

Papers citing "The Reversible Residual Network: Backpropagation Without Storing Activations"

50 / 111 papers shown

Title
Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning Le-Trung Nguyen Ael Quélennec Van-Tam Nguyen Enzo Tartaglione 48 0 0 08 May 2025
YOLO-LLTS: Real-Time Low-Light Traffic Sign Detection via Prior-Guided Enhancement and Multi-Branch Feature Interaction Ziyu Lin Yunfan Wu Yuhang Ma Junzhou Chen Ronghui Zhang Jiaming Wu Guodong Yin Liang Lin 55 0 0 18 Mar 2025
GPU Memory Usage Optimization for Backward Propagation in Deep Network Training Ding-Yong Hong Tzu-Hsien Tsai Ning Wang Pangfeng Liu Jan-Jan Wu 44 0 0 18 Feb 2025
INDIGO+: A Unified INN-Guided Probabilistic Diffusion Algorithm for Blind and Non-Blind Image Restoration Di You Pier Luigi Dragotti DiffM 40 2 0 23 Jan 2025
Efficient, Accurate and Stable Gradients for Neural ODEs Sam McCallum James Foster 40 4 0 15 Oct 2024
A Unified Framework for Neural Computation and Learning Over Time S. Melacci Alessandro Betti Michele Casoni Tommaso Guidi Matteo Tiezzi Marco Gori AI4TS 30 0 0 18 Sep 2024
AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurring Xintian Mao Qingli Li Yan Wang 48 14 0 13 Jun 2024
PETRA: Parallel End-to-end Training with Reversible Architectures Stéphane Rivaud Louis Fournier Thomas Pumir Eugene Belilovsky Michael Eickenberg Edouard Oyallon 25 0 0 04 Jun 2024
Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectives Xuan Wu Di Wang Lijie Wen Yubin Xiao Chunguo Wu Yuesong Wu Chaoyu Yu D. Maskell You Zhou 70 6 0 01 Jun 2024
VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections Roy Miles Pradyumna Reddy Ismail Elezi Jiankang Deng VLM 43 3 0 28 May 2024
Invertible Diffusion Models for Compressed Sensing Bin Chen Zhenyu Zhang Weiqi Li Chen Zhao Jiwen Yu Shijie Zhao Jie Chen Jian Zhang DiffM 57 5 0 25 Mar 2024
Fast and Unified Path Gradient Estimators for Normalizing Flows Lorenz Vaitl Ludwig Winkler Lorenz Richter Pan Kessel 39 4 0 23 Mar 2024
Go beyond End-to-End Training: Boosting Greedy Local Learning with Context Supply Chengting Yu Fengzhao Zhang Hanzhi Ma Aili Wang Er-ping Li 29 1 0 12 Dec 2023
Training a Large Video Model on a Single Machine in a Day Yue Zhao Philipp Krahenbuhl VLM 34 15 0 28 Sep 2023
PaReprop: Fast Parallelized Reversible Backpropagation Tyler Lixuan Zhu K. Mangalam 17 1 0 15 Jun 2023
Make Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning Baohao Liao Shaomu Tan Christof Monz KELM 23 29 0 01 Jun 2023
Variance-Reduced Gradient Estimation via Noise-Reuse in Online Evolution Strategies Oscar Li James Harrison Jascha Narain Sohl-Dickstein Virginia Smith Luke Metz 54 5 0 21 Apr 2023
Training Invertible Neural Networks as Autoencoders The-Gia Leo Nguyen Lynton Ardizzone Ullrich Kothe BDL DRL SSL 30 9 0 20 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT Yihan Cao Siyu Li Yixin Liu Zhiling Yan Yutong Dai Philip S. Yu Lichao Sun 38 508 0 07 Mar 2023
Elementwise Language Representation Du-Yeong Kim Jeeeun Kim 36 0 0 27 Feb 2023
Transformed Distribution Matching for Missing Value Imputation He Zhao Ke Sun Amir Dezfouli Edwin V. Bonilla 34 19 0 20 Feb 2023
Certified Invertibility in Neural Networks via Mixed-Integer Programming Tianqi Cui Tom S. Bertalan George J. Pappas M. Morari Ioannis G. Kevrekidis Mahyar Fazlyab AAML 27 2 0 27 Jan 2023
Reversible Column Networks Yuxuan Cai Yi Zhou Qi Han Jianjian Sun Xiangwen Kong Jun Yu Li Xiangyu Zhang VLM 31 53 0 22 Dec 2022
CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion Zixiang Zhao Hao Bai Jiangshe Zhang Yulun Zhang Shuang Xu Zudi Lin Radu Timofte Luc Van Gool 40 311 0 26 Nov 2022
Re^2TAL: Rewiring Pretrained Video Backbones for Reversible Temporal Action Localization Chen Zhao Shuming Liu K. Mangalam Guohao Li 38 17 0 25 Nov 2022
MGNNI: Multiscale Graph Neural Networks with Implicit Layers Juncheng Liu Bryan Hooi Kenji Kawaguchi X. Xiao AI4CE 24 20 0 15 Oct 2022
Dynamical systems' based neural networks E. Celledoni Davide Murari B. Owren Carola-Bibiane Schönlieb Ferdia Sherry OOD 46 12 0 05 Oct 2022
Deep is a Luxury We Don't Have Ahmed Taha Yen Nhi Truong Vu Brent Mombourquette Thomas P. Matthews Jason Su Sadanand Singh ViT MedIm 26 2 0 11 Aug 2022
XG-BoT: An Explainable Deep Graph Neural Network for Botnet Detection and Forensics Wai Weng Lo Gayan K. Kulatilleke Mohanad Sarhan S. Layeghy Marius Portmann 26 41 0 19 Jul 2022
FakeNews: GAN-based generation of realistic 3D volumetric data -- A systematic review and taxonomy André Ferreira Jianning Li Kelsey L. Pomykala Jens Kleesiek Victor Alves Jan Egger MedIm 29 22 0 04 Jul 2022
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network Vitaliy Chiley Vithursan Thangarasa Abhay Gupta Anshul Samar Joel Hestness D. DeCoste 52 8 0 28 Jun 2022
LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning Yi-Lin Sung Jaemin Cho Joey Tianyi Zhou VLM 21 237 0 13 Jun 2022
Do Residual Neural Networks discretize Neural Ordinary Differential Equations? Michael E. Sander Pierre Ablin Gabriel Peyré 35 25 0 29 May 2022
An Interpretable MRI Reconstruction Network with Two-grid-cycle Correction and Geometric Prior Distillation Xiaohong Fan Yin Yang Ke-long Chen Jianping Zhang Ke Dong MedIm 29 13 0 14 May 2022
VPNets: Volume-preserving neural networks for learning source-free dynamics Aiqing Zhu Beibei Zhu Jiawei Zhang Yifa Tang Jian-Dong Liu 34 3 0 29 Apr 2022
DELTA: Dynamically Optimizing GPU Memory beyond Tensor Recomputation Yu Tang Chenyu Wang Yufan Zhang Yuliang Liu Xingcheng Zhang Linbo Qiao Zhiquan Lai Dongsheng Li 21 4 0 30 Mar 2022
Momentum Capsule Networks Josef Gugglberger David Peer A. Rodríguez-Sánchez 3DPC 18 1 0 26 Jan 2022
Deep Equilibrium Models for Video Snapshot Compressive Imaging Yaping Zhao Siming Zheng Xin Yuan 53 19 0 18 Jan 2022
Two-Stage is Enough: A Concise Deep Unfolding Reconstruction Network for Flexible Video Compressive Sensing Siming Zheng Xiaoyu Yang Xin Yuan 27 7 0 15 Jan 2022
COMET: A Novel Memory-Efficient Deep Learning Training Framework by Using Error-Bounded Lossy Compression Sian Jin Chengming Zhang Xintong Jiang Yunhe Feng Hui Guan Guanpeng Li Shuaiwen Leon Song Dingwen Tao 27 23 0 18 Nov 2021
Resampling Base Distributions of Normalizing Flows Vincent Stimper Bernhard Schölkopf José Miguel Hernández-Lobato BDL 30 32 0 29 Oct 2021
8-bit Optimizers via Block-wise Quantization Tim Dettmers M. Lewis Sam Shleifer Luke Zettlemoyer MQ 34 273 0 06 Oct 2021
m-RevNet: Deep Reversible Neural Networks with Momentum Duo Li Shangqi Gao 36 5 0 12 Aug 2021
Feature Alignment as a Generative Process T. S. Farias Jonas Maziero DiffM BDL 21 1 0 23 Jun 2021
Approximation capabilities of measure-preserving neural networks Aiqing Zhu Pengzhan Jin Yifa Tang 29 8 0 21 Jun 2021
Training Graph Neural Networks with 1000 Layers Guohao Li Matthias Muller Guohao Li V. Koltun GNN AI4CE 51 235 0 14 Jun 2021
Progressive Stage-wise Learning for Unsupervised Feature Representation Enhancement Zefan Li Chenxi Liu Alan Yuille Bingbing Ni Wenjun Zhang Wen Gao SSL 16 5 0 10 Jun 2021
SHINE: SHaring the INverse Estimate from the forward pass for bi-level optimization and implicit models Zaccharie Ramzi Florian Mannel Shaojie Bai Jean-Luc Starck P. Ciuciu Thomas Moreau 31 28 0 01 Jun 2021
Memory-Efficient Differentiable Transformer Architecture Search Yuekai Zhao Li Dong Yelong Shen Zhihua Zhang Furu Wei Weizhu Chen ViT 30 17 0 31 May 2021
PointLIE: Locally Invertible Embedding for Point Cloud Sampling and Recovery Weibing Zhao Xu Yan Jiantao Gao Ruimao Zhang Jiayan Zhang Zhen Li Song Wu Shuguang Cui 3DPC 18 7 0 30 Apr 2021