Title
Memorization and Knowledge Injection in Gated LLMs Xu Pan Ely Hahami Zechen Zhang H. Sompolinsky KELM CLL RALM 106 1 0 30 Apr 2025
Expressivity of Neural Networks with Random Weights and Learned Biases Ezekiel Williams Avery Hee-Woon Ryoo Thomas Jiralerspong Alexandre Payeur M. Perich Luca Mazzucato Guillaume Lajoie 38 2 0 01 Jul 2024
Local Learning with Neuron Groups Adeetya Patel Michael Eickenberg Eugene Belilovsky 26 5 0 18 Jan 2023
Globally Gated Deep Linear Networks Qianyi Li H. Sompolinsky AI4CE 27 10 0 31 Oct 2022
Scaling Forward Gradient With Local Losses Mengye Ren Simon Kornblith Renjie Liao Geoffrey E. Hinton 81 49 0 07 Oct 2022
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks Andrew M. Saxe Shagun Sodhani Sam Lewallen AI4CE 30 34 0 21 Jul 2022
Explicitising The Implicit Intrepretability of Deep Neural Networks Via Duality Chandrashekar Lakshminarayanan Ashutosh Kumar Singh A. Rajkumar AI4CE 26 1 0 01 Mar 2022
Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environments A. Iyer Karan Grewal Akash Velu Lucas O. Souza Jérémy Forest Subutai Ahmad AI4CE 32 41 0 31 Dec 2021
SPINE: Soft Piecewise Interpretable Neural Equations Jasdeep Singh Grover Harsh Minesh Domadia Rajashree Tapase Grishma Sharma 19 0 0 20 Nov 2021
Reinforcement Learning with Information-Theoretic Actuation Elliot Catt Marcus Hutter J. Veness 45 0 0 30 Sep 2021
Training Deep Architectures Without End-to-End Backpropagation: A Survey on the Provably Optimal Methods Shiyu Duan José C. Príncipe MQ 25 3 0 09 Jan 2021
Kernelized information bottleneck leads to biologically plausible 3-factor Hebbian learning in deep networks Roman Pogodin P. Latham 21 34 0 12 Jun 2020
Gaussian Gated Linear Networks David Budden Adam H. Marblestone Eren Sezener Tor Lattimore Greg Wayne J. Veness BDL AI4CE 21 12 0 10 Jun 2020
Locally-Adaptive Nonparametric Online Learning Ilja Kuzborskij Nicolò Cesa-Bianchi 15 5 0 05 Feb 2020
Pixel Recurrent Neural Networks Aaron van den Oord Nal Kalchbrenner Koray Kavukcuoglu SSeg GAN 251 2,550 0 25 Jan 2016
Stochastic Gradient Descent for Non-smooth Optimization: Convergence Results and Optimal Averaging Schemes Ohad Shamir Tong Zhang 101 571 0 08 Dec 2012