Block-local learning with probabilistic latent representations

24 May 2023

David Kappel

Khaleelulla Khan Nazeer

Cabrel Teguemne Fokam

Christian Mayr

Anand Subramoney

ArXiv PDF HTML

Papers citing "Block-local learning with probabilistic latent representations"

21 / 21 papers shown

Title
Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates Cabrel Teguemne Fokam Khaleelulla Khan Nazeer Lukas König David Kappel Anand Subramoney 66 0 0 08 Oct 2024
Fixed-Weight Difference Target Propagation Tatsukichi Shibuya Nakamasa Inoue Rei Kawakami Ikuro Sato AAML 43 3 0 19 Dec 2022
Towards Scaling Difference Target Propagation by Learning Backprop Targets M. Ernoult Fabrice Normandin A. Moudgil Sean Spinney Eugene Belilovsky Irina Rish Blake A. Richards Yoshua Bengio 68 31 0 31 Jan 2022
Learning on Arbitrary Graph Topologies via Predictive Coding Tommaso Salvatori Luca Pinchetti Beren Millidge Yuhang Song Tianyi Bao Rafal Bogacz Thomas Lukasiewicz 80 34 0 31 Jan 2022
Credit Assignment Through Broadcasting a Global Error Vector David G. Clark L. F. Abbott SueYeon Chung 79 23 0 08 Jun 2021
Greedy Hierarchical Variational Autoencoders for Large-Scale Video Prediction Bohan Wu Suraj Nair Roberto Martin-Martin Li Fei-Fei Chelsea Finn DRL 68 102 0 06 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 307 2,347 0 04 Mar 2021
A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges Moloud Abdar Farhad Pourpanah Sadiq Hussain Dana Rezazadegan Li Liu ... Xiaochun Cao Abbas Khosravi U. Acharya V. Makarenkov S. Nahavandi BDL UQCV 339 1,922 0 12 Nov 2020
Local plasticity rules can learn deep representations using self-supervised contrastive predictions Bernd Illing Jean-Paul Ventura G. Bellec W. Gerstner SSL DRL 83 70 0 16 Oct 2020
Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures Julien Launay Iacopo Poli Franccois Boniface Florent Krzakala 85 64 0 23 Jun 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 369 18,778 0 13 Feb 2020
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 76 227 0 20 Jan 2019
Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures Sergey Bartunov Adam Santoro Blake A. Richards Luke Marris Geoffrey E. Hinton Timothy Lillicrap 87 244 0 12 Jul 2018
Deep Predictive Coding Network with Local Recurrent Processing for Object Recognition Kuan Han Haiguang Wen Yizhen Zhang Di Fu Eugenio Culurciello Zhongming Liu 55 70 0 19 May 2018
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 283 8,883 0 25 Aug 2017
Reinforcement Learning with Unsupervised Auxiliary Tasks Max Jaderberg Volodymyr Mnih Wojciech M. Czarnecki Tom Schaul Joel Z Leibo David Silver Koray Kavukcuoglu SSL 101 1,228 0 16 Nov 2016
Direct Feedback Alignment Provides Learning in Deep Neural Networks Arild Nøkland ODL 85 457 0 06 Sep 2016
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 80 356 0 18 Aug 2016
SGDR: Stochastic Gradient Descent with Warm Restarts I. Loshchilov Frank Hutter ODL 333 8,130 0 13 Aug 2016
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification Kaiming He Xinming Zhang Shaoqing Ren Jian Sun VLM 323 18,625 0 06 Feb 2015
Difference Target Propagation Dong-Hyun Lee Saizheng Zhang Asja Fischer Yoshua Bengio AAML 93 350 0 23 Dec 2014