Information-Restricted Neural Language Models Reveal Different Brain
Regions' Sensitivity to Semantics, Syntax and Context

Information-Restricted Neural Language Models Reveal Different Brain Regions' Sensitivity to Semantics, Syntax and Context

28 February 2023

Alexandre Pasquiou

Bertrand Thirion

Christophe Pallier

Papers citing "Information-Restricted Neural Language Models Reveal Different Brain Regions' Sensitivity to Semantics, Syntax and Context"

11 / 11 papers shown

Title
Neural Language Models are not Born Equal to Fit Brain Data, but Training Helps Alexandre Pasquiou Yair Lakretz John T. Hale Bertrand Thirion Christophe Pallier 65 37 0 07 Jul 2022
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little Koustuv Sinha Robin Jia Dieuwke Hupkes J. Pineau Adina Williams Douwe Kiela 73 246 0 14 Apr 2021
Disentangling Syntax and Semantics in the Brain with Deep Networks Charlotte Caucheteux Alexandre Gramfort J. King 91 71 0 02 Mar 2021
Mechanisms for Handling Nested Dependencies in Neural-Network Language Models and Humans Yair Lakretz Dieuwke Hupkes A. Vergallito Marco Marelli Marco Baroni S. Dehaene 75 62 0 19 Jun 2020
Array Programming with NumPy Charles R. Harris K. Millman S. Walt R. Gommers Pauli Virtanen ... Tyler Reddy Warren Weckesser Hameer Abbasi C. Gohlke T. Oliphant 93 14,757 0 18 Jun 2020
PyTorch: An Imperative Style, High-Performance Deep Learning Library Adam Paszke Sam Gross Francisco Massa Adam Lerer James Bradbury ... Sasank Chilamkurthy Benoit Steiner Lu Fang Junjie Bai Soumith Chintala ODL 310 42,038 0 03 Dec 2019
Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain) Mariya Toneva Leila Wehbe MILM AI4CE 64 225 0 28 May 2019
Compositional generalization in a deep seq2seq model by separating syntax and semantics Jacob Russin Jason Jo R. C. O'Reilly Yoshua Bengio 58 103 0 22 Apr 2019
The emergence of number and syntax units in LSTM language models Yair Lakretz Germán Kruszewski T. Desbordes Dieuwke Hupkes S. Dehaene Marco Baroni 41 170 0 18 Mar 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.2K 93,936 0 11 Oct 2018
Constituency Parsing with a Self-Attentive Encoder Nikita Kitaev Dan Klein 58 537 0 02 May 2018