On The Specialization of Neural Modules

On The Specialization of Neural Modules

23 September 2024

Benjamin Rosman

Papers citing "On The Specialization of Neural Modules"

14 / 14 papers shown

Title
Systematic Generalization in Language Models Scales with Information Entropy Sondre Wold Lucas Georges Gabriel Charpentier Étienne Simon 123 0 0 19 May 2025
Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking) Yoonsoo Nam Seok Hyeong Lee Clementine Domine Yea Chan Park Charles London Wonyl Choi Niclas Goring Seungjai Lee AI4CE 114 0 0 28 Feb 2025
A Complexity-Based Theory of Compositionality Eric Elmoznino Thomas Jiralerspong Yoshua Bengio Guillaume Lajoie CoGe 87 9 0 18 Oct 2024
Breaking Neural Network Scaling Laws with Modularity Akhilan Boopathy Sunshine Jiang William Yue Jaedong Hwang Abhiram Iyer Ila Fiete OOD 104 2 0 09 Sep 2024
Compositional Models for Estimating Causal Effects Purva Pruthi David D. Jensen CML 118 0 0 25 Jun 2024
When does compositional structure yield compositional generalization? A kernel theory Samuel Lippl Kim Stachenfeld NAI CoGe 152 8 0 26 May 2024
Is a Modular Architecture Enough? Sarthak Mittal Yoshua Bengio Guillaume Lajoie 62 48 0 06 Jun 2022
Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems P. Smolensky R. Thomas McCoy Roland Fernandez Matthew A. Goldrick Jia-Hao Gao 76 63 0 02 May 2022
Emergent Language Generalization and Acquisition Speed are not tied to Compositionality Eugene Kharitonov Marco Baroni LRM 92 23 0 07 Apr 2020
Compositional Languages Emerge in a Neural Iterated Learning Model Yi Ren Shangmin Guo Matthieu Labeau Shay B. Cohen S. Kirby 128 97 0 04 Feb 2020
Learning to Reason: End-to-End Module Networks for Visual Question Answering Ronghang Hu Jacob Andreas Marcus Rohrbach Trevor Darrell Kate Saenko KELM GNN ReLM LRM 101 576 0 18 Apr 2017
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning Justin Johnson B. Hariharan Laurens van der Maaten Li Fei-Fei C. L. Zitnick Ross B. Girshick CoGe 280 2,346 0 20 Dec 2016
On the Sample Complexity of End-to-end Training vs. Semantic Abstraction Training Shai Shalev-Shwartz Amnon Shashua 38 59 0 23 Apr 2016
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks Andrew M. Saxe James L. McClelland Surya Ganguli ODL 130 1,830 0 20 Dec 2013