Interneurons accelerate learning dynamics in recurrent neural networks
for statistical adaptation

v1v2 (latest)

Interneurons accelerate learning dynamics in recurrent neural networks for statistical adaptation

21 September 2022

Cengiz Pehlevan

ArXiv (abs)PDF HTML

Papers citing "Interneurons accelerate learning dynamics in recurrent neural networks for statistical adaptation"

16 / 16 papers shown

Title
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 153 944 0 11 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 185 195 0 02 May 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 347 2,362 0 04 Mar 2021
A simple normative network approximates local non-Hebbian learning in the cortex Siavash Golkar David Lipshutz Yanis Bahroun Anirvan M. Sengupta D. Chklovskii OffRL 42 15 0 23 Oct 2020
Biologically plausible single-layer networks for nonnegative independent component analysis David Lipshutz Cengiz Pehlevan D. Chklovskii 48 12 0 23 Oct 2020
A biologically plausible neural network for multi-channel Canonical Correlation Analysis David Lipshutz Yanis Bahroun Siavash Golkar Anirvan M. Sengupta Dmitri B. Chkovskii 31 23 0 01 Oct 2020
Whitening for Self-Supervised Representation Learning Aleksandr Ermolov Aliaksandr Siarohin E. Sangineto N. Sebe SSL 93 315 0 13 Jul 2020
Implicit Regularization of Discrete Gradient Dynamics in Linear Neural Networks Gauthier Gidel Francis R. Bach Simon Lacoste-Julien AI4CE 70 155 0 30 Apr 2019
A mathematical theory of semantic development in deep neural networks Andrew M. Saxe James L. McClelland Surya Ganguli 73 271 0 23 Oct 2018
Decorrelated Batch Normalization Lei Huang Dawei Yang B. Lang Jia Deng 55 193 0 23 Apr 2018
On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization Sanjeev Arora Nadav Cohen Elad Hazan 105 488 0 19 Feb 2018
Blind nonnegative source separation using biological neural networks Cengiz Pehlevan S. Mohan D. Chklovskii 115 39 0 01 Jun 2017
Why do similarity matching objectives lead to Hebbian/anti-Hebbian networks? Cengiz Pehlevan Anirvan M. Sengupta D. Chklovskii 43 79 0 23 Mar 2017
Optimal whitening and decorrelation A. Kessy A. Lewin K. Strimmer 60 404 0 02 Dec 2015
A Normative Theory of Adaptive Dimensionality Reduction in Neural Networks Cengiz Pehlevan D. Chklovskii 42 54 0 30 Nov 2015
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 185 1,852 0 20 Dec 2013

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.