Training Neural Networks with Local Error Signals

20 January 2019

Papers citing "Training Neural Networks with Local Error Signals"

34 / 134 papers shown

Title
Training Deep Architectures Without End-to-End Backpropagation: A Survey on the Provably Optimal Methods Shiyu Duan José C. Príncipe MQ 38 3 0 09 Jan 2021
Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment Julien Launay Iacopo Poli Kilian Muller Gustave Pariente I. Carron L. Daudet Florent Krzakala S. Gigan MoE 15 18 0 11 Dec 2020
Convex Regularization Behind Neural Reconstruction Arda Sahiner Morteza Mardani Batu Mehmet Ozturkler Mert Pilanci John M. Pauly 35 25 0 09 Dec 2020
Accumulated Decoupled Learning: Mitigating Gradient Staleness in Inter-Layer Model Parallelization Huiping Zhuang Zhiping Lin Kar-Ann Toh 28 4 0 03 Dec 2020
On-Chip Error-triggered Learning of Multi-layer Memristive Spiking Neural Networks Melika Payvand M. Fouda Fadi J. Kurdahi A. Eltawil Emre Neftci 32 29 0 21 Nov 2020
Kernel Dependence Network Chieh-Tsai Wu A. Masoomi Arthur Gretton Jennifer Dy 13 0 0 04 Nov 2020
Brain-Inspired Learning on Neuromorphic Substrates Friedemann Zenke Emre Neftci 38 89 0 22 Oct 2020
Local plasticity rules can learn deep representations using self-supervised contrastive predictions Bernd Illing Jean-Paul Ventura G. Bellec W. Gerstner SSL DRL 54 69 0 16 Oct 2020
Why Layer-Wise Learning is Hard to Scale-up and a Possible Solution via Accelerated Downsampling Wenchi Ma Miao Yu Kaidong Li Guanghui Wang 14 5 0 15 Oct 2020
Interlocking Backpropagation: Improving depthwise model-parallelism Aidan Gomez Oscar Key Kuba Perlin Stephen Gou Nick Frosst J. Dean Y. Gal 10 19 0 08 Oct 2020
Neighbourhood Distillation: On the benefits of non end-to-end distillation Laetitia Shao Max Moroz Elad Eban Yair Movshovitz-Attias ODL 18 0 0 02 Oct 2020
VINNAS: Variational Inference-based Neural Network Architecture Search Martin Ferianc Hongxiang Fan Miguel R. D. Rodrigues 3DPC 19 6 0 12 Jul 2020
SpinalNet: Deep Neural Network with Gradual Input H. M. D. Kabir Moloud Abdar S. M. Jalali Abbas Khosravi A. Atiya S. Nahavandi D. Srinivasan AI4CE 32 131 0 07 Jul 2020
Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures Julien Launay Iacopo Poli Franccois Boniface Florent Krzakala 36 62 0 23 Jun 2020
Fine-Tuning DARTS for Image Classification M. Tanveer Muhammad Umar Karim Khan C. Kyung 31 49 0 16 Jun 2020
Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks Roman Pogodin P. Latham 24 34 0 12 Jun 2020
Gaussian Gated Linear Networks David Budden Adam H. Marblestone Eren Sezener Tor Lattimore Greg Wayne J. Veness BDL AI4CE 24 12 0 10 Jun 2020
Layer-wise training convolutional neural networks with smaller filters for human activity recognition using wearable sensors Yin Tang Qi Teng Lefei Zhang Fuhong Min Jun He HAI 19 89 0 08 May 2020
Why should we add early exits to neural networks? Simone Scardapane M. Scarpiniti E. Baccarelli A. Uncini 14 117 0 27 Apr 2020
Ensemble learning in CNN augmented with fully connected subnetworks Daiki Hirata Norikazu Takahashi OOD 22 25 0 19 Mar 2020
Contrastive Similarity Matching for Supervised Learning Shanshan Qin N. Mudur Cengiz Pehlevan SSL DRL 16 1 0 24 Feb 2020
Large-Scale Gradient-Free Deep Learning with Recursive Local Representation Alignment Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles 15 2 0 10 Feb 2020
Sideways: Depth-Parallel Training of Video Models Mateusz Malinowski G. Swirszcz João Carreira Viorica Patraucean MDE 35 13 0 17 Jan 2020
Questions to Guide the Future of Artificial Intelligence Research J. Ott 14 3 0 21 Dec 2019
Online Learned Continual Compression with Adaptive Quantization Modules Lucas Caccia Eugene Belilovsky Massimo Caccia Joelle Pineau 30 5 0 19 Nov 2019
Deep Semantic Segmentation of Natural and Medical Images: A Review Saeid Asgari Taghanaki Kumar Abhishek Joseph Paul Cohen Julien Cohen-Adad Ghassan Hamarneh SSeg VLM 45 667 0 16 Oct 2019
Gated Linear Networks William H. Guss Tor Lattimore David Budden Avishkar Bhoopchand Christopher Mattern ... Ruslan Salakhutdinov Jianan Wang Peter Toth Simon Schmitt Marcus Hutter AI4CE 18 40 0 30 Sep 2019
Learning without feedback: Fixed random learning signals allow for feedforward training of deep neural networks Charlotte Frenkel M. Lefebvre D. Bol 11 23 0 03 Sep 2019
Deep Learning Theory Review: An Optimal Control and Dynamical Systems Perspective Guan-Horng Liu Evangelos A. Theodorou AI4CE 19 71 0 28 Aug 2019
Fully Decoupled Neural Network Learning Using Delayed Gradients Huiping Zhuang Yi Wang Qinglai Liu Shuai Zhang Zhiping Lin FedML 16 30 0 21 Jun 2019
Associated Learning: Decomposing End-to-end Backpropagation based on Auto-encoders and Target Propagation Yu-Wei Kao Hung-Hsuan Chen BDL 20 5 0 13 Jun 2019
Principled Training of Neural Networks with Direct Feedback Alignment Julien Launay Iacopo Poli Florent Krzakala 19 35 0 11 Jun 2019
Putting An End to End-to-End: Gradient-Isolated Learning of Representations Sindy Löwe Peter O'Connor Bastiaan S. Veeling SSL 6 143 0 28 May 2019
Decoupled Greedy Learning of CNNs Eugene Belilovsky Michael Eickenberg Edouard Oyallon 6 114 0 23 Jan 2019