Training Neural Networks with Local Error Signals

20 January 2019

Papers citing "Training Neural Networks with Local Error Signals"

50 / 134 papers shown

Title
Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization R. Srinivasan Francesca Mignacco M. Sorbaro Maria Refinetti A. Cooper Gabriel Kreiman Giorgia Dellaferrera 27 15 0 10 Feb 2023
Local Learning with Neuron Groups Adeetya Patel Michael Eickenberg Eugene Belilovsky 29 5 0 18 Jan 2023
The Predictive Forward-Forward Algorithm Alexander Ororbia A. Mali 35 37 0 04 Jan 2023
GoogLe2Net: Going Transverse with Convolutions Yuanpeng He 22 2 0 01 Jan 2023
Local Learning on Transformers via Feature Reconstruction P. Pathak Jingwei Zhang Dimitris Samaras ViT 24 5 0 29 Dec 2022
QuickNets: Saving Training and Preventing Overconfidence in Early-Exit Neural Architectures Devdhar Patel H. Siegelmann OnRL 42 1 0 25 Dec 2022
Low-Variance Forward Gradients using Direct Feedback Alignment and Momentum Florian Bacho Dominique F. Chu 21 8 0 14 Dec 2022
Scaling Laws Beyond Backpropagation Matthew J. Filipovich Alessandro Cappelli Daniel Hesslow Julien Launay 19 3 0 26 Oct 2022
Scaling Forward Gradient With Local Losses Mengye Ren Simon Kornblith Renjie Liao Geoffrey E. Hinton 81 49 0 07 Oct 2022
Block-wise Training of Residual Networks via the Minimizing Movement Scheme Skander Karkar Ibrahim Ayed Emmanuel de Bézenac Patrick Gallinari 33 1 0 03 Oct 2022
Hebbian Deep Learning Without Feedback Adrien Journé Hector Garcia Rodriguez Qinghai Guo Timoleon Moraitis AAML 31 49 0 23 Sep 2022
Deep learning in a bilateral brain with hemispheric specialization C. Rajagopalan D. Rawlinson E. Goldberg Gideon Kowadlo 19 4 0 09 Sep 2022
Supervised Dimensionality Reduction and Image Classification Utilizing Convolutional Autoencoders Ioannis A. Nellas S. Tasoulis V. Plagianakos S. Georgakopoulos DRL 9 0 0 25 Aug 2022
Locally Supervised Learning with Periodic Global Guidance Hasnain Irshad Bhatti Jaekyun Moon 11 0 0 01 Aug 2022
Gigapixel Whole-Slide Images Classification using Locally Supervised Learning Jingwei Zhang Xin Zhang Ke Ma Rajarsi R. Gupta Joel H. Saltz Maria Vakalopoulou Dimitris Samaras 24 24 0 17 Jul 2022
A Robust Backpropagation-Free Framework for Images Timothy Zee Alexander Ororbia A. Mali Ifeoma Nwogu 25 1 0 03 Jun 2022
BackLink: Supervised Local Training with Backward Links Wenzhe Guo M. Fouda A. Eltawil K. Salama 21 2 0 14 May 2022
OccamNets: Mitigating Dataset Bias by Favoring Simpler Hypotheses Robik Shrestha Kushal Kafle Christopher Kanan CML 33 13 0 05 Apr 2022
Signal Propagation: A Framework for Learning and Inference In a Forward Pass Adam A. Kohan E. Rietman H. Siegelmann 24 26 0 04 Apr 2022
Deep Regression Ensembles Antoine Didisheim Bryan Kelly Semyon Malamud UQCV 17 4 0 10 Mar 2022
Deep Layer-wise Networks Have Closed-Form Weights Chieh-Tsai Wu A. Masoomi Arthur Gretton Jennifer Dy 29 3 0 01 Feb 2022
Error-driven Input Modulation: Solving the Credit Assignment Problem without a Backward Pass Giorgia Dellaferrera Gabriel Kreiman 29 53 0 27 Jan 2022
Semantic Clustering based Deduction Learning for Image Recognition and Classification Wenchi Ma Xuemin Tu Bo Luo Guanghui Wang 36 29 0 25 Dec 2021
Efficient Training of Spiking Neural Networks with Temporally-Truncated Local Backpropagation through Time Wenzhe Guo M. Fouda A. Eltawil K. Salama 23 12 0 13 Dec 2021
Layer-Parallel Training of Residual Networks with Auxiliary-Variable Networks Qi Sun Hexin Dong Zewei Chen Jiacheng Sun Zhenguo Li Bin Dong 29 1 0 10 Dec 2021
Information Bottleneck-Based Hebbian Learning Rule Naturally Ties Working Memory and Synaptic Updates Kyle Daruwalla Mikko H. Lipasti 15 0 0 24 Nov 2021
Signature-Graph Networks Ali Hamdi Flora D. Salim D. Kim Xiaojun Chang 21 1 0 22 Oct 2021
Cascaded Compressed Sensing Networks: A Reversible Architecture for Layerwise Learning Weizhi Lu Mingrui Chen Kai Guo Weiyu Li 8 0 0 20 Oct 2021
Biologically Plausible Training Mechanisms for Self-Supervised Learning in Deep Networks Mufeng Tang Yibo Yang Y. Amit SSL 16 7 0 30 Sep 2021
The staircase property: How hierarchical structure can guide deep learning Emmanuel Abbe Enric Boix-Adserà Matthew Brennan Guy Bresler Dheeraj M. Nagaraj 17 48 0 24 Aug 2021
How much pre-training is enough to discover a good subnetwork? Cameron R. Wolfe Fangshuo Liao Qihan Wang J. Kim Anastasios Kyrillidis 30 3 0 31 Jul 2021
Towards Biologically Plausible Convolutional Networks Roman Pogodin Yash Mehta Timothy Lillicrap P. Latham 26 22 0 22 Jun 2021
How to Train Your Wide Neural Network Without Backprop: An Input-Weight Alignment Perspective Akhilan Boopathy Ila Fiete 39 9 0 15 Jun 2021
Self-Supervised Learning with Kernel Dependence Maximization Yazhe Li Roman Pogodin Danica J. Sutherland Arthur Gretton SSL 19 80 0 15 Jun 2021
Gradient Forward-Propagation for Large-Scale Temporal Video Modelling Mateusz Malinowski Dimitrios Vytiniotis G. Swirszcz Viorica Patraucean João Carreira 30 8 0 15 Jun 2021
Low-memory stochastic backpropagation with multi-channel randomized trace estimation M. Louboutin Ali Siahkoohi Rongrong Wang Felix J. Herrmann 21 0 0 13 Jun 2021
Decoupled Greedy Learning of CNNs for Synchronous and Asynchronous Distributed Learning Eugene Belilovsky Louis Leconte Lucas Caccia Michael Eickenberg Edouard Oyallon 16 7 0 11 Jun 2021
Front Contribution instead of Back Propagation Swaroop Mishra Anjana Arunkumar 14 0 0 10 Jun 2021
Credit Assignment Through Broadcasting a Global Error Vector David G. Clark L. F. Abbott SueYeon Chung 25 23 0 08 Jun 2021
Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligence Charlotte Frenkel D. Bol Giacomo Indiveri 34 33 0 02 Jun 2021
Learning to Time-Decode in Spiking Neural Networks Through the Information Bottleneck N. Skatchkovsky Osvaldo Simeone Hyeryung Jang 33 20 0 02 Jun 2021
Intra-Model Collaborative Learning of Neural Networks Shijie Fang Tong Lin 11 2 0 20 May 2021
Learning in Deep Neural Networks Using a Biologically Inspired Optimizer Giorgia Dellaferrera Stanisław Woźniak Giacomo Indiveri A. Pantazi E. Eleftheriou 30 2 0 23 Apr 2021
Reverse Differentiation via Predictive Coding Tommaso Salvatori Yuhang Song Thomas Lukasiewicz Rafal Bogacz Zhenghua Xu PINN 30 26 0 08 Mar 2021
Predictive Coding Can Do Exact Backpropagation on Convolutional and Recurrent Neural Networks Tommaso Salvatori Yuhang Song Thomas Lukasiewicz Rafal Bogacz Zhenghua Xu PINN 27 24 0 05 Mar 2021
Contrastive Self-supervised Neural Architecture Search Nam Nguyen Morris J Chang 21 20 0 21 Feb 2021
Train your classifier first: Cascade Neural Networks Training from upper layers to lower layers Shucong Zhang Cong-Thanh Do R. Doddipatla Erfan Loweimi P. Bell Steve Renals 24 2 0 09 Feb 2021
An Analytic Layer-wise Deep Learning Framework with Applications to Robotics Huu-Thiet Nguyen C. Cheah Kar-Ann Toh 16 16 0 07 Feb 2021
Revisiting Locally Supervised Learning: an Alternative to End-to-end Training Yulin Wang Zanlin Ni Shiji Song Le Yang Gao Huang 11 82 0 26 Jan 2021
Faster Convergence in Deep-Predictive-Coding Networks to Learn Deeper Representations I. Sledge José C. Príncipe 30 1 0 18 Jan 2021