Understanding and Improving Optimization in Predictive Coding Networks

23 May 2023

Papers citing "Understanding and Improving Optimization in Predictive Coding Networks"

14 / 14 papers shown

Title
Benchmarking Predictive Coding Networks -- Made Simple Luca Pinchetti Chang Qi Oleh Lokshyn Gaspard Olivers Cornelius Emde ... Simon Frieder Bayar I. Menzat Rafal Bogacz Thomas Lukasiewicz Tommaso Salvatori 167 6 0 17 Feb 2025
Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation Satoki Ishikawa Rio Yokota Ryo Karakida 90 0 0 04 Nov 2024
Self-Contrastive Forward-Forward Algorithm Xing Chen Dongshu Liu Jérémie Laydevant Julie Grollier 109 2 0 17 Sep 2024
A Theoretical Framework for Inference and Learning in Predictive Coding Networks Beren Millidge Yuhang Song Tommaso Salvatori Thomas Lukasiewicz Rafal Bogacz 74 14 0 21 Jul 2022
Backpropagation at the Infinitesimal Inference Limit of Energy-Based Models: Unifying Predictive Coding, Equilibrium Propagation, and Contrastive Hebbian Learning Beren Millidge Yuhang Song Tommaso Salvatori Thomas Lukasiewicz Rafal Bogacz 74 22 0 31 May 2022
Towards Scaling Difference Target Propagation by Learning Backprop Targets M. Ernoult Fabrice Normandin A. Moudgil Sean Spinney Eugene Belilovsky Irina Rish Blake A. Richards Yoshua Bengio 68 31 0 31 Jan 2022
Learning on Arbitrary Graph Topologies via Predictive Coding Tommaso Salvatori Luca Pinchetti Beren Millidge Yuhang Song Tianyi Bao Rafal Bogacz Thomas Lukasiewicz 85 35 0 31 Jan 2022
Associative Memories via Predictive Coding Tommaso Salvatori Yuhang Song Yujian Hong Simon Frieder Lei Sha Zhenghua Xu Rafal Bogacz Thomas Lukasiewicz 64 64 0 16 Sep 2021
On the relationship between predictive coding and backpropagation Robert Rosenbaum 59 28 0 20 Jun 2021
Tightening the Biological Constraints on Gradient-Based Predictive Coding Nick Alonso Emre Neftci 47 7 0 30 Apr 2021
Predictive Coding Approximates Backprop along Arbitrary Computation Graphs Beren Millidge Alexander Tschantz Christopher L. Buckley 70 122 0 07 Jun 2020
Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Bias Axel Laborieux M. Ernoult B. Scellier Yoshua Bengio Julie Grollier D. Querlioz 48 74 0 06 Jun 2020
Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures Sergey Bartunov Adam Santoro Blake A. Richards Luke Marris Geoffrey E. Hinton Timothy Lillicrap 87 244 0 12 Jul 2018
How Important is Weight Symmetry in Backpropagation? Q. Liao Joel Z Leibo T. Poggio 71 170 0 17 Oct 2015