Understanding Factual Recall in Transformers via Associative Memories

9 December 2024

Papers citing "Understanding Factual Recall in Transformers via Associative Memories"

2 / 2 papers shown

Title
Data Mixing Can Induce Phase Transitions in Knowledge Acquisition Xinran Gu Kaifeng Lyu Jiazheng Li Jingzhao Zhang 73 0 0 23 May 2025
Mixture of Parrots: Experts improve memorization more than reasoning Samy Jelassi Clara Mohri David Brandfonbrener Alex Gu Nikhil Vyas Nikhil Anand David Alvarez-Melis Yuanzhi Li Sham Kakade Eran Malach MoE 76 5 0 24 Oct 2024