How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagation

29 July 2014

Papers citing "How Auto-Encoders Could Provide Credit Assignment in Deep Networks via Target Propagation"

50 / 100 papers shown

Title
Predictive Coding, Variational Autoencoders, and Biological Connections Joseph Marino DRL AI4CE 30 43 0 15 Nov 2020
Self Normalizing Flows Thomas Anderson Keller Jorn W. T. Peters P. Jaini Emiel Hoogeboom Patrick Forré Max Welling 30 14 0 14 Nov 2020
Identifying Learning Rules From Neural Network Observables Aran Nayebi S. Srivastava Surya Ganguli Daniel L. K. Yamins 19 21 0 22 Oct 2020
MAP Propagation Algorithm: Faster Learning with a Team of Reinforcement Learning Agents Stephen Chung 14 5 0 15 Oct 2020
LoCo: Local Contrastive Representation Learning Yuwen Xiong Mengye Ren R. Urtasun SSL DRL 35 69 0 04 Aug 2020
Deriving Differential Target Propagation from Iterating Approximate Inverses Yoshua Bengio 14 24 0 29 Jul 2020
Biological credit assignment through dynamic inversion of feedforward networks William F. Podlaski C. Machens 27 19 0 10 Jul 2020
A Theoretical Framework for Target Propagation Alexander Meulemans Francesco S. Carzaniga Johan A. K. Suykens João Sacramento Benjamin Grewe AAML 33 77 0 25 Jun 2020
Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures Julien Launay Iacopo Poli Franccois Boniface Florent Krzakala 41 63 0 23 Jun 2020
Learning to infer in recurrent biological networks Ari S. Benjamin Konrad Paul Kording SSL DRL 32 1 0 18 Jun 2020
Learning to Learn with Feedback and Local Plasticity Jack W Lindsey Ashok Litwin-Kumar CLL 34 32 0 16 Jun 2020
Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks Roman Pogodin P. Latham 24 34 0 12 Jun 2020
GAIT-prop: A biologically plausible learning rule derived from backpropagation of error Nasir Ahmad Marcel van Gerven L. Ambrogioni AAML 20 25 0 11 Jun 2020
Scaling Equilibrium Propagation to Deep ConvNets by Drastically Reducing its Gradient Estimator Bias Axel Laborieux M. Ernoult B. Scellier Yoshua Bengio Julie Grollier D. Querlioz 16 69 0 06 Jun 2020
Modularizing Deep Learning via Pairwise Learning With Kernels Shiyu Duan Shujian Yu José C. Príncipe MoMe 27 20 0 12 May 2020
Two Routes to Scalable Credit Assignment without Weight Symmetry D. Kunin Aran Nayebi Javier Sagastuy-Breña Surya Ganguli Jonathan M. Bloom Daniel L. K. Yamins 34 32 0 28 Feb 2020
Large-Scale Gradient-Free Deep Learning with Recursive Local Representation Alignment Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles 23 2 0 10 Feb 2020
Biologically-Motivated Deep Learning Method using Hierarchical Competitive Learning T. Shinozaki SSL 8 2 0 04 Jan 2020
Temporal Coding in Spiking Neural Networks with Alpha Synaptic Function: Learning with Backpropagation Iulia Comsa Krzysztof Potempa Luca Versari T. Fischbacher Andrea Gesmundo J. Alakuijala 27 174 0 30 Jul 2019
Associated Learning: Decomposing End-to-end Backpropagation based on Auto-encoders and Target Propagation Yu-Wei Kao Hung-Hsuan Chen BDL 20 5 0 13 Jun 2019
Principled Training of Neural Networks with Direct Feedback Alignment Julien Launay Iacopo Poli Florent Krzakala 27 35 0 11 Jun 2019
DANTE: Deep AlterNations for Training nEural networks Vaibhav Sinha Sneha Kudugunta Adepu Ravi Sankar Surya Teja Chavali Purushottam Kar V. Balasubramanian 6 3 0 01 Feb 2019
Training Neural Networks with Local Error Signals Arild Nøkland L. Eidnes 32 226 0 20 Jan 2019
Feedback alignment in deep convolutional networks Theodore H. Moskovitz Ashok Litwin-Kumar L. F. Abbott 27 60 0 12 Dec 2018
Dendritic cortical microcircuits approximate the backpropagation algorithm João Sacramento Rui Ponte Costa Yoshua Bengio Walter Senn 16 308 0 26 Oct 2018
Gradient target propagation T. S. Farias Jonas Maziero 11 3 0 19 Oct 2018
Combinatorial Attacks on Binarized Neural Networks Elias Boutros Khalil Amrita Gupta B. Dilkina AAML 49 40 0 08 Oct 2018
Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures Sergey Bartunov Adam Santoro Blake A. Richards Luke Marris Geoffrey E. Hinton Timothy Lillicrap 26 240 0 12 Jul 2018
Multi-Layered Gradient Boosting Decision Trees Ji Feng Yang Yu Zhi-Hua Zhou AI4CE 22 120 0 31 May 2018
Understanding Autoencoders with Information Theoretic Concepts Shujian Yu José C. Príncipe AI4CE 49 132 0 30 Mar 2018
Conducting Credit Assignment by Aligning Local Representations Alexander Ororbia A. Mali Daniel Kifer C. Lee Giles ODL 31 29 0 05 Mar 2018
On Kernel Method-Based Connectionist Models and Supervised Deep Learning Without Backpropagation Shiyu Duan Shujian Yu Yunmei Chen José C. Príncipe 18 16 0 11 Feb 2018
Dendritic error backpropagation in deep cortical microcircuits João Sacramento Rui Ponte Costa Yoshua Bengio Walter Senn 15 47 0 30 Dec 2017
Convergent Block Coordinate Descent for Training Tikhonov Regularized Deep Neural Networks Ziming Zhang M. Brand 26 70 0 20 Nov 2017
Deep supervised learning using local errors Hesham Mostafa V. Ramesh Gert Cauwenberghs 41 113 0 17 Nov 2017
Deep Learning as a Mixed Convex-Combinatorial Optimization Problem A. Friesen Pedro M. Domingos 26 20 0 31 Oct 2017
Reconstruction of Hidden Representation for Robust Feature Extraction Zeng Yu Tianrui Li Ning Yu Yi Pan Hongmei Chen Bing-Quan Liu 22 27 0 08 Oct 2017
Training Language Models Using Target-Propagation Sam Wiseman S. Chopra MarcÁurelio Ranzato Arthur Szlam Ruoyu Sun Soumith Chintala Nicolas Vasilache 17 8 0 15 Feb 2017
Decoupled Neural Interfaces using Synthetic Gradients Max Jaderberg Wojciech M. Czarnecki Simon Osindero Oriol Vinyals Alex Graves David Silver Koray Kavukcuoglu 47 353 0 18 Aug 2016
Deep Predictive Coding Networks for Video Prediction and Unsupervised Learning William Lotter Gabriel Kreiman David D. Cox SSL 52 927 0 25 May 2016
ReSeg: A Recurrent Neural Network-based Model for Semantic Segmentation Francesco Visin Marco Ciccone Adriana Romero Kyle Kastner Kyunghyun Cho Yoshua Bengio Matteo Matteucci Aaron Courville VLM SSeg 19 251 0 22 Nov 2015
Online Semi-Supervised Learning with Deep Hybrid Boltzmann Machines and Denoising Autoencoders Alexander Ororbia C. Lee Giles David Reitter AI4CE 20 30 0 22 Nov 2015
Deconstructing the Ladder Network Architecture Mohammad Pezeshki Linxi Fan Philemon Brakel Aaron Courville Yoshua Bengio 25 98 0 19 Nov 2015
How Important is Weight Symmetry in Backpropagation? Q. Liao Joel Z Leibo T. Poggio 20 167 0 17 Oct 2015
Semi-Supervised Learning with Ladder Networks Antti Rasmus Harri Valpola Mikko Honkala Mathias Berglund T. Raiko SSL 17 1,365 0 09 Jul 2015
Towards Biologically Plausible Deep Learning Yoshua Bengio Dong-Hyun Lee J. Bornschein Thomas Mesnard Zhouhan Lin DRL OOD 32 347 0 14 Feb 2015
Difference Target Propagation Dong-Hyun Lee Saizheng Zhang Asja Fischer Yoshua Bengio AAML 25 346 0 23 Dec 2014
From neural PCA to deep unsupervised learning Harri Valpola BDL 41 184 0 28 Nov 2014
NICE: Non-linear Independent Components Estimation Laurent Dinh David M. Krueger Yoshua Bengio DRL BDL 24 2,233 0 30 Oct 2014
Deep Directed Generative Autoencoders Sherjil Ozair Yoshua Bengio DRL 24 18 0 02 Oct 2014