JFB: Jacobian-Free Backpropagation for Implicit Networks

23 March 2021

Stanley Osher

Papers citing "JFB: Jacobian-Free Backpropagation for Implicit Networks"

50 / 52 papers shown

Title
You Only Look One Step: Accelerating Backpropagation in Diffusion Sampling with Gradient Shortcuts Hongkun Dou Zeyu Li Xingyu Jiang H. Li Lijun Yang Wen Yao Yue Deng DiffM 38 0 0 12 May 2025
Recovering Pulse Waves from Video Using Deep Unrolling and Deep Equilibrium Models Vineet Shenoy Suhas Lohit Hassan Mansour Rama Chellappa Tim K. Marks 43 0 0 21 Mar 2025
Fixed-Point RNNs: From Diagonal to Dense in a Few Iterations Sajad Movahedi Felix Sarnthein Nicola Muca Cirone Antonio Orvieto 46 2 0 13 Mar 2025
TomoSelfDEQ: Self-Supervised Deep Equilibrium Learning for Sparse-Angle CT Reconstruction T. Bubba Matteo Santacesaria Andrea Sebastiani OOD 35 0 0 28 Feb 2025
PRDP: Progressively Refined Differentiable Physics Kanishk Bhatia Felix Koehler Nils Thuerey AI4CE 59 0 0 26 Feb 2025
A Generalization Bound for a Family of Implicit Networks Samy Wu Fung Benjamin Berkels 41 0 0 28 Jan 2025
The Differentiable Feasibility Pump M. Cacciola Alexandre Forel A. Frangioni Andrea Lodi 31 0 0 05 Nov 2024
Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective Haixiang Sun Ye Shi 31 0 0 30 Oct 2024
Accelerating AI Performance using Anderson Extrapolation on GPUs Saleem Al Dajani David Keyes 28 0 0 25 Oct 2024
Differentiation Through Black-Box Quadratic Programming Solvers Connor W. Magoon Fengyu Yang Noam Aigerman Shahar Z. Kovalsky 28 0 0 08 Oct 2024
On Logical Extrapolation for Mazes with Recurrent and Implicit Networks Brandon Knutson Amandin Chyba Rabeendran Michael I. Ivanitskiy Jordan Pettyjohn Cecilia G. Diniz Behn Samy Wu Fung Daniel McKenzie LRM 39 2 0 03 Oct 2024
Closed-Loop Long-Horizon Robotic Planning via Equilibrium Sequence Modeling Jinghan Li Zhicheng Sun Fei Li 96 1 0 02 Oct 2024
Constructing artificial life and materials scientists with accelerated AI using Deep AndersoNN Saleem Al Dajani David Keyes AI4CE 39 0 0 29 Jul 2024
The Extrapolation Power of Implicit Models Juliette Decugis Alicia Y. Tsai Max Emerling Ashwin Ganesh L. Ghaoui 34 0 0 19 Jul 2024
From Variance to Veracity: Unbundling and Mitigating Gradient Variance in Differentiable Bundle Adjustment Layers Swaminathan Gurumurthy Karnik Ram Bingqing Chen Zachary Manchester Zico Kolter 45 1 0 12 Jun 2024
Physics-guided Full Waveform Inversion using Encoder-Solver Convolutional Neural Networks Matan Goren Eran Treister 35 0 0 27 May 2024
Deep Equilibrium Models are Almost Equivalent to Not-so-deep Explicit Models for High-dimensional Gaussian Mixtures Zenan Ling Longbo Li Zhanbo Feng Yixuan Zhang Feng Zhou Robert C. Qiu Zhenyu Liao 32 4 0 05 Feb 2024
Training Implicit Networks for Image Deblurring using Jacobian-Free Backpropagation Linghai Liu Shuaicheng Tong Lisa Zhao 21 1 0 03 Feb 2024
Fixed Point Diffusion Models Xingjian Bai Luke Melas-Kyriazi 18 3 0 16 Jan 2024
IDKM: Memory Efficient Neural Network Quantization via Implicit, Differentiable k-Means Sean Jaffe Ambuj K. Singh Francesco Bullo MQ 20 0 0 12 Dec 2023
Deep Equilibrium Based Neural Operators for Steady-State PDEs Tanya Marwah Ashwini Pokle J. Zico Kolter Zachary Chase Lipton Jianfeng Lu Andrej Risteski 20 8 0 30 Nov 2023
Making Scalable Meta Learning Practical Sang Keun Choe Sanket Vaibhav Mehta Hwijeen Ahn W. Neiswanger Pengtao Xie Emma Strubell Eric P. Xing 47 14 0 09 Oct 2023
Spike Accumulation Forwarding for Effective Training of Spiking Neural Networks Ryuji Saiin Tomoya Shirakawa Sota Yoshihara Yoshihide Sawada Hiroyuki Kusumoto 22 1 0 04 Oct 2023
Federated Deep Equilibrium Learning: A Compact Shared Representation for Edge Communication Efficiency Long Tan Le Tuan Dung Nguyen Tung-Anh Nguyen Choong Seon Hong Nguyen H. Tran FedML 24 0 0 27 Sep 2023
Deep Equilibrium Object Detection Shuai Wang Yao Teng Limin Wang 43 6 0 18 Aug 2023
A Survey of Contextual Optimization Methods for Decision Making under Uncertainty Utsav Sadana A. Chenreddy Erick Delage Alexandre Forel Emma Frejinger Thibaut Vidal AI4CE 45 83 0 17 Jun 2023
Improving Adversarial Robustness of DEQs with Explicit Regulations Along the Neural Dynamics Zonghan Yang Peng Li Tianyu Pang Yang Liu AAML 35 3 0 02 Jun 2023
Test like you Train in Implicit Deep Learning Zaccharie Ramzi Pierre Ablin Gabriel Peyré Thomas Moreau 34 3 0 24 May 2023
Efficient Training of Deep Equilibrium Models Bac Nguyen Cong Lukas Mauch 24 0 0 23 Apr 2023
Model-corrected learned primal-dual models for fast limited-view photoacoustic tomography A. Hauptmann Jenni Poimala MedIm 31 5 0 04 Apr 2023
Achieving Hierarchy-Free Approximation for Bilevel Programs With Equilibrium Constraints Jiayang Li J. Yu Boyi Liu Zhaoran Wang Y. Nie 32 6 0 20 Feb 2023
Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis Zhu Wang Sourav Medya Sathya Ravi VLM 28 0 0 11 Feb 2023
Learning to Solve Integer Linear Programs with Davis-Yin Splitting Daniel McKenzie Samy Wu Fung Howard Heaton 32 4 0 31 Jan 2023
Unlocking Slot Attention by Changing Optimal Transport Costs Yan Zhang David W. Zhang Simon Lacoste-Julien Gertjan J. Burghouts Cees G. M. Snoek OCL 37 11 0 30 Jan 2023
Towards Vision Transformer Unrolling Fixed-Point Algorithm: a Case Study on Image Restoration Peng Qiao Sidun Liu Tao Sun Ke Yang Y. Dou ViT 23 1 0 29 Jan 2023
Lightweight and Flexible Deep Equilibrium Learning for CSI Feedback in FDD Massive MIMO Yifan Ma Wentao Yu Xianghao Yu Jun Zhang Shenghui Song Khaled B. Letaief 12 2 0 28 Nov 2022
A Neural-Network-Based Convex Regularizer for Inverse Problems Alexis Goujon Sebastian Neumayer Pakshal Bohra Stanislas Ducotterd M. Unser 11 26 0 22 Nov 2022
Online Training Through Time for Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 45 60 0 09 Oct 2022
Self-Supervised Deep Equilibrium Models for Inverse Problems with Theoretical Guarantees Weijie Gan Chunwei Ying Parna Eshraghi Tongyao Wang C. Eldeniz Yuyang Hu Jiaming Liu Yasheng Chen H. An Ulugbek S. Kamilov 35 4 0 07 Oct 2022
Alternating Differentiation for Optimization Layers Haixiang Sun Ye Shi Jingya Wang H. Tuan H. Vincent Poor Dacheng Tao ODL 35 14 0 03 Oct 2022
Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-training Risheng Liu Xuan Liu Shangzhi Zeng Jin Zhang Yixuan Zhang 35 6 0 16 Jun 2022
Learned reconstruction methods with convergence guarantees Subhadip Mukherjee A. Hauptmann Ozan Oktem Marcelo Pereyra Carola-Bibiane Schönlieb 22 49 0 11 Jun 2022
Online Deep Equilibrium Learning for Regularization by Denoising Jiaming Liu Xiaojian Xu Weijie Gan S. Shoushtari Ulugbek S. Kamilov 31 26 0 25 May 2022
Explainable AI via Learning to Optimize Howard Heaton Samy Wu Fung 24 14 0 29 Apr 2022
Representation Recycling for Streaming Video Analysis Can Ufuk Ertenli R. G. Cinbis Emre Akbas 21 1 0 28 Apr 2022
Continuous Deep Equilibrium Models: Training Neural ODEs faster by integrating them to Infinity Avik Pal Alan Edelman Chris Rackauckas 13 6 0 28 Jan 2022
AdaViT: Adaptive Tokens for Efficient Vision Transformer Hongxu Yin Arash Vahdat J. Álvarez Arun Mallya Jan Kautz Pavlo Molchanov ViT 35 313 0 14 Dec 2021
Multiset-Equivariant Set Prediction with Approximate Implicit Differentiation Yan Zhang David W. Zhang Simon Lacoste-Julien Gertjan J. Burghouts Cees G. M. Snoek BDL 35 21 0 23 Nov 2021
Is Attention Better Than Matrix Decomposition? Zhengyang Geng Meng-Hao Guo Hongxu Chen Xia Li Ke Wei Zhouchen Lin 54 137 0 09 Sep 2021
Operator Splitting for Learning to Predict Equilibria in Convex Games Daniel McKenzie Howard Heaton Qiuwei Li Samy Wu Fung Stanley Osher Wotao Yin 30 0 0 02 Jun 2021