Implicit Representations of Meaning in Neural Language Models

1 June 2021

ArXiv (abs)PDF HTML Github (54★)

Papers citing "Implicit Representations of Meaning in Neural Language Models"

22 / 122 papers shown

Title
Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task Kenneth Li Aspen K. Hopkins David Bau Fernanda Viégas Hanspeter Pfister Martin Wattenberg MILM 182 297 0 24 Oct 2022
Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs Maarten Sap Ronan Le Bras Daniel Fried Yejin Choi 101 232 0 24 Oct 2022
Language Models Understand Us, Poorly Jared Moore LRM 55 4 0 19 Oct 2022
The Debate Over Understanding in AI's Large Language Models Melanie Mitchell D. Krakauer ELM 159 223 0 14 Oct 2022
Transparency Helps Reveal When Language Models Learn Meaning Zhaofeng Wu William Merrill Hao Peng Iz Beltagy Noah A. Smith 59 10 0 14 Oct 2022
Generating Executable Action Plans with Environmentally-Aware Language Models Maitrey Gramopadhye D. Szafir LM&Ro LLMAG 100 24 0 10 Oct 2022
Linearly Mapping from Image to Text Space Jack Merullo Louis Castricato Carsten Eickhoff Ellie Pavlick VLM 251 118 0 30 Sep 2022
Do Large Language Models know what humans know? Sean Trott Cameron J. Jones Tyler A. Chang J. Michaelov Benjamin Bergen 93 97 0 04 Sep 2022
Meaning without reference in large language models S. Piantadosi Felix Hill 89 77 0 05 Aug 2022
Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks Tilman Raukur A. Ho Stephen Casper Dylan Hadfield-Menell AAML AI4CE 128 134 0 27 Jul 2022
CoSe-Co: Text Conditioned Generative CommonSense Contextualizer Rachit Bansal Milan Aggarwal S. Bhatia Jivat Neet Kaur Balaji Krishnamurthy 43 4 0 12 Jun 2022
Few-shot Subgoal Planning with Language Models Lajanugen Logeswaran Yao Fu Moontae Lee Honglak Lee LRM 76 26 0 28 May 2022
When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it Sebastian Schuster Tal Linzen 77 25 0 06 May 2022
Natural Language to Code Translation with Execution Freda Shi Daniel Fried Marjan Ghazvininejad Luke Zettlemoyer Sida I. Wang 129 129 0 25 Apr 2022
Pre-Trained Language Models for Interactive Decision-Making Shuang Li Xavier Puig Chris Paxton Yilun Du Clinton Jia Wang ... Anima Anandkumar Jacob Andreas Igor Mordatch Antonio Torralba Yuke Zhu LM&Ro 135 264 0 03 Feb 2022
Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents Wenlong Huang Pieter Abbeel Deepak Pathak Igor Mordatch LM&Ro 129 1,129 0 18 Jan 2022
Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge Ian Porada Alessandro Sordoni Jackie C.K. Cheung 52 8 0 16 Dec 2021
Show Your Work: Scratchpads for Intermediate Computation with Language Models Maxwell Nye Anders Andreassen Guy Gur-Ari Henryk Michalewski Jacob Austin ... Aitor Lewkowycz Maarten Bosma D. Luan Charles Sutton Augustus Odena ReLM LRM 226 757 0 30 Nov 2021
Dyna-bAbI: unlocking bAbI's potential with dynamic synthetic benchmarking Ronen Tamari Kyle Richardson Aviad Sar-Shalom Noam Kahlon Nelson F. Liu Reut Tsarfaty Dafna Shahaf 124 5 0 30 Nov 2021
Program Synthesis with Large Language Models Jacob Austin Augustus Odena Maxwell Nye Maarten Bosma Henryk Michalewski ... Ellen Jiang Carrie J. Cai Michael Terry Quoc V. Le Charles Sutton ELM AIMat ReCod ALM 218 2,024 0 16 Aug 2021
Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning Maxwell Nye Michael Henry Tessler J. Tenenbaum Brenden M. Lake 85 119 0 06 Jul 2021
Symbolic Behaviour in Artificial Intelligence Adam Santoro Andrew Kyle Lampinen Kory W. Mathewson Timothy Lillicrap David Raposo 83 34 0 05 Feb 2021