Overparameterized Neural Networks Implement Associative Memory

Overparameterized Neural Networks Implement Associative Memory

26 September 2019

Adityanarayanan Radhakrishnan

Papers citing "Overparameterized Neural Networks Implement Associative Memory"

16 / 16 papers shown

Title
Key-value memory in the brain Samuel J. Gershman Ila Fiete Kazuki Irie 34 7 0 06 Jan 2025
Empirical Capacity Model for Self-Attention Neural Networks Aki Härmä M. Pietrasik Anna Wilbik 36 1 0 22 Jul 2024
Rethinking the Relationship between Recurrent and Non-Recurrent Neural Networks: A Study in Sparsity Quincy Hershey Randy Paffenroth Harsh Nilesh Pathak Simon Tavener 66 1 0 01 Apr 2024
Unified machine learning tasks and datasets for enhancing renewable energy Arsam Aryandoust Thomas Rigoni Francesco di Stefano Anthony Patt 40 0 0 12 Nov 2023
How Much Training Data is Memorized in Overparameterized Autoencoders? An Inverse Problem Perspective on Memorization Evaluation Koren Abitbul Yehuda Dar TDI 25 2 0 04 Oct 2023
Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss T. Getu Georges Kaddoum M. Bennis 40 1 0 13 Sep 2023
On the Relationship Between Variational Inference and Auto-Associative Memory Louis Annabi Alexandre Pitti M. Quoy BDL 35 5 0 14 Oct 2022
Bird-Eye Transformers for Text Generation Models Lei Sha Yuhang Song Yordan Yordanov Tommaso Salvatori Thomas Lukasiewicz 30 0 0 08 Oct 2022
Content Addressable Memory Without Catastrophic Forgetting by Heteroassociation with a Fixed Scaffold Sugandha Sharma Sarthak Chandra Ila R. Fiete 52 20 0 01 Feb 2022
Associative Memories via Predictive Coding Tommaso Salvatori Yuhang Song Yujian Hong Simon Frieder Lei Sha Zhenghua Xu Rafal Bogacz Thomas Lukasiewicz 29 61 0 16 Sep 2021
Simple, Fast, and Flexible Framework for Matrix Completion with Infinite Width Neural Networks Adityanarayanan Radhakrishnan George Stefanakis M. Belkin Caroline Uhler 30 25 0 31 Jul 2021
A Mechanism for Producing Aligned Latent Spaces with Autoencoders Saachi Jain Adityanarayanan Radhakrishnan Caroline Uhler 16 9 0 29 Jun 2021
RNNs of RNNs: Recursive Construction of Stable Assemblies of Recurrent Neural Networks L. Kozachkov Michaela Ennis Jean-Jacques E. Slotine 16 18 0 16 Jun 2021
Honest-but-Curious Nets: Sensitive Attributes of Private Inputs Can Be Secretly Coded into the Classifiers' Outputs Mohammad Malekzadeh Anastasia Borovykh Deniz Gündüz MIACV 14 42 0 25 May 2021
Associative Memory in Iterated Overparameterized Sigmoid Autoencoders Yibo Jiang C. Pehlevan 19 13 0 30 Jun 2020
Pixel Recurrent Neural Networks Aaron van den Oord Nal Kalchbrenner Koray Kavukcuoglu SSeg GAN 242 2,550 0 25 Jan 2016