Deep Learning without Weight Transport

10 April 2019

Papers citing "Deep Learning without Weight Transport"

50 / 80 papers shown

Title
Training Large Neural Networks With Low-Dimensional Error Feedback Maher Hanut Jonathan Kadmon 45 1 0 27 Feb 2025
Self-Assembly of a Biologically Plausible Learning Circuit Q. Liao Liu Ziyin Yulu Gan Brian Cheung Mark Harnett Tomaso Poggio 52 0 0 31 Dec 2024
Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation Satoki Ishikawa Rio Yokota Ryo Karakida 46 0 0 04 Nov 2024
Towards training digitally-tied analog blocks via hybrid gradient computation Timothy Nest M. Ernoult 52 1 0 05 Sep 2024
Oja's plasticity rule overcomes several challenges of training neural networks under biological constraints Navid Shervani-Tabar Marzieh Alireza Mirhoseini Robert Rosenbaum AAML AI4CE 45 0 0 15 Aug 2024
Online Pseudo-Zeroth-Order Training of Neuromorphic Spiking Neural Networks Mingqing Xiao Qingyan Meng Zongpeng Zhang D.K. He Zhouchen Lin 40 0 0 17 Jul 2024
Momentum Auxiliary Network for Supervised Local Learning Junhao Su Changpeng Cai Feiyu Zhu Chenghao He Xiaojie Xu Dongzhi Guan Chenyang Si 40 4 0 08 Jul 2024
Towards Interpretable Deep Local Learning with Successive Gradient Reconciliation Yibo Yang Xiaojie Li Motasem Alfarra Hasan Hammoud Adel Bibi Philip Torr Guohao Li 37 2 0 07 Jun 2024
Deep Learning without Weight Symmetry Ji-An Li M. Benna 32 1 0 31 May 2024
Pretraining with Random Noise for Fast and Robust Learning without Weight Transport Jeonghwan Cheon Sang Wan Lee Se-Bum Paik OOD 203 1 0 27 May 2024
Contribute to balance, wire in accordance: Emergence of backpropagation from a simple, bio-plausible neuroplasticity rule Xinhao Fan S. P. Mysore 37 0 0 23 May 2024
Backpropagation through space, time, and the brain B. Ellenberger Paul Haider Jakob Jordan Kevin Max Ismael Jaras Laura Kriener Federico Benitez Mihai A. Petrovici 133 8 0 25 Mar 2024
Scaling Supervised Local Learning with Augmented Auxiliary Networks Chenxiang Ma Jibin Wu Chenyang Si Kay Chen Tan 49 2 0 27 Feb 2024
Two Tales of Single-Phase Contrastive Hebbian Learning R. Høier Christopher Zach 33 1 0 13 Feb 2024
Go beyond End-to-End Training: Boosting Greedy Local Learning with Context Supply Chengting Yu Fengzhao Zhang Hanzhi Ma Aili Wang Er-ping Li 29 1 0 12 Dec 2023
Brain-like Flexible Visual Inference by Harnessing Feedback-Feedforward Alignment Tahereh Toosi Elias B. Issa 19 2 0 31 Oct 2023
Intrinsic Biologically Plausible Adversarial Robustness Matilde Tristany Farinha Thomas Ortner Giorgia Dellaferrera Benjamin Grewe A. Pantazi AAML 44 1 0 29 Sep 2023
Improving equilibrium propagation without weight symmetry through Jacobian homeostasis Axel Laborieux Friedemann Zenke 20 7 0 05 Sep 2023
Correlative Information Maximization: A Biologically Plausible Approach to Supervised Deep Neural Networks without Weight Symmetry Bariscan Bozkurt Cengiz Pehlevan A. Erdogan 35 1 0 07 Jun 2023
Biologically-Motivated Learning Model for Instructed Visual Processing R. Abel S. Ullman 25 0 0 04 Jun 2023
Synaptic Weight Distributions Depend on the Geometry of Plasticity Roman Pogodin Jonathan H. Cornford Arna Ghosh Gauthier Gidel Guillaume Lajoie Blake A. Richards 23 4 0 30 May 2023
Block-local learning with probabilistic latent representations David Kappel Khaleelulla Khan Nazeer Cabrel Teguemne Fokam Christian Mayr Anand Subramoney 24 4 0 24 May 2023
Predictive Coding as a Neuromorphic Alternative to Backpropagation: A Critical Evaluation Umais Zahid Qinghai Guo Z. Fountas BDL 26 7 0 05 Apr 2023
Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization R. Srinivasan Francesca Mignacco M. Sorbaro Maria Refinetti A. Cooper Gabriel Kreiman Giorgia Dellaferrera 27 15 0 10 Feb 2023
Dual Propagation: Accelerating Contrastive Hebbian Learning with Dyadic Neurons R. Høier D. Staudt Christopher Zach 31 11 0 02 Feb 2023
Learning efficient backprojections across cortical hierarchies in real time Kevin Max Laura Kriener Garibaldi Pineda García Thomas Nowotny Ismael Jaras Walter Senn Mihai A. Petrovici OOD 26 15 0 20 Dec 2022
Low-Variance Forward Gradients using Direct Feedback Alignment and Momentum Florian Bacho Dominique F. Chu 21 8 0 14 Dec 2022
Is Bio-Inspired Learning Better than Backprop? Benchmarking Bio Learning vs. Backprop Manas Gupta Sarthak Ketanbhai Modi Hang Zhang Joon Hei Lee J. Lim 27 7 0 09 Dec 2022
Synaptic Dynamics Realize First-order Adaptive Learning and Weight Symmetry Yukun Yang Peng Li ODL 38 1 0 01 Dec 2022
Meta-Learning Biologically Plausible Plasticity Rules with Random Feedback Pathways Navid Shervani-Tabar Robert Rosenbaum AI4CE 42 14 0 28 Oct 2022
Fusing Event-based Camera and Radar for SLAM Using Spiking Neural Networks with Continual STDP Learning A. Safa Tim Verbelen I. Ocket A. Bourdoux Hichem Sahli F. Catthoor Georges G. E. Gielen 24 18 0 09 Oct 2022
Scaling Forward Gradient With Local Losses Mengye Ren Simon Kornblith Renjie Liao Geoffrey E. Hinton 81 49 0 07 Oct 2022
Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillations Axel Laborieux Friedemann Zenke 36 33 0 01 Sep 2022
The least-control principle for local learning at equilibrium Alexander Meulemans Nicolas Zucchet Seijin Kobayashi J. Oswald João Sacramento 28 20 0 04 Jul 2022
Distinguishing Learning Rules with Brain Machine Interfaces Jacob P. Portes Christian Schmid James M. Murray 28 7 0 27 Jun 2022
A Robust Backpropagation-Free Framework for Images Timothy Zee Alexander Ororbia A. Mali Ifeoma Nwogu 22 1 0 03 Jun 2022
A comparative study of back propagation and its alternatives on multilayer perceptrons John F. Waldo AAML 19 1 0 31 May 2022
Emergent organization of receptive fields in networks of excitatory and inhibitory neurons Leon Lufkin Ashish Puri Ganlin Song Xinyi Zhong John D. Lafferty 16 1 0 26 May 2022
A Computational Framework of Cortical Microcircuits Approximates Sign-concordant Random Backpropagation Yukun Yang Peng Li 24 1 0 15 May 2022
Minimizing Control for Credit Assignment with Strong Feedback Alexander Meulemans Matilde Tristany Farinha Maria R. Cervera João Sacramento Benjamin Grewe 19 17 0 14 Apr 2022
Constrained Parameter Inference as a Principle for Learning Nasir Ahmad Ellen Schrader Marcel van Gerven 18 10 0 22 Mar 2022
Towards Scaling Difference Target Propagation by Learning Backprop Targets M. Ernoult Fabrice Normandin A. Moudgil Sean Spinney Eugene Belilovsky Irina Rish Blake A. Richards Yoshua Bengio 19 28 0 31 Jan 2022
Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Pass Giorgia Dellaferrera Gabriel Kreiman 29 53 0 27 Jan 2022
Target Propagation via Regularized Inversion Vincent Roulet Zaïd Harchaoui BDL AAML 27 4 0 02 Dec 2021
Information Bottleneck-Based Hebbian Learning Rule Naturally Ties Working Memory and Synaptic Updates Kyle Daruwalla Mikko H. Lipasti 15 0 0 24 Nov 2021
How and When Random Feedback Works: A Case Study of Low-Rank Matrix Factorization Shivam Garg Santosh Vempala 28 3 0 17 Nov 2021
Latent Equilibrium: A unified learning theory for arbitrarily fast computation with arbitrarily slow neurons Paul Haider B. Ellenberger Laura Kriener Jakob Jordan Walter Senn Mihai A. Petrovici 27 24 0 27 Oct 2021
BioGrad: Biologically Plausible Gradient-Based Learning for Spiking Neural Networks Guangzhi Tang Neelesh Kumar Ioannis E. Polykretis Konstantinos Michmizos 23 6 0 27 Oct 2021
Biologically Plausible Training Mechanisms for Self-Supervised Learning in Deep Networks Mufeng Tang Yibo Yang Y. Amit SSL 16 7 0 30 Sep 2021
Benchmarking the Accuracy and Robustness of Feedback Alignment Algorithms Albert Jiménez Sanfiz Mohamed Akrout OOD AAML 14 8 0 30 Aug 2021