Implicit Representations of Meaning in Neural Language Models

1 June 2021

ArXiv (abs)PDF HTML Github (54★)

Papers citing "Implicit Representations of Meaning in Neural Language Models"

50 / 122 papers shown

Title
Vision-Language Models Provide Promptable Representations for Reinforcement Learning William Chen Oier Mees Aviral Kumar Sergey Levine VLM LM&Ro 134 29 0 05 Feb 2024
LLMs for Relational Reasoning: How Far are We? Zhiming Li Yushi Cao Xiufeng Xu Junzhe Jiang Xu Liu Yon Shin Teo Shang-Wei Lin Yang Liu LRM 109 22 0 17 Jan 2024
A Vision Check-up for Language Models Pratyusha Sharma Tamar Rott Shaham Manel Baradad Stephanie Fu Adrian Rodriguez-Munoz Shivam Duggal Phillip Isola Antonio Torralba VLM LRM 152 29 0 03 Jan 2024
More than Correlation: Do Large Language Models Learn Causal Representations of Space? Yida Chen Yixian Gan Sijia Li Li Yao Xiaohan Zhao LRM 80 6 0 26 Dec 2023
Deep de Finetti: Recovering Topic Distributions from Large Language Models Liyi Zhang R. Thomas McCoy T. Sumers Jian-Qiao Zhu Thomas Griffiths BDL 108 7 0 21 Dec 2023
Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning Zhiting Hu Tianmin Shu LLMAG LM&Ro LRM 163 37 0 08 Dec 2023
Identifying Linear Relational Concepts in Large Language Models David Chanin Anthony Hunter Oana-Maria Camburu LLMSV KELM 83 4 0 15 Nov 2023
Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models Ziqiao Ma Jacob Sansom Run Peng Joyce Chai 134 21 0 30 Oct 2023
Personas as a Way to Model Truthfulness in Language Models Nitish Joshi Javier Rando Abulhair Saparov Najoung Kim He He HILM 126 34 0 27 Oct 2023
How do Language Models Bind Entities in Context? Jiahai Feng Jacob Steinhardt 134 40 0 26 Oct 2023
Can You Follow Me? Testing Situational Understanding in ChatGPT Chenghao Yang Allyson Ettinger LRM LLMAG ELM 148 4 0 24 Oct 2023
EpiK-Eval: Evaluation for Language Models as Epistemic Models Gabriele Prato Jerry Huang Prasannna Parthasarathi Shagun Sodhani Sarath Chandar ELM 62 4 0 23 Oct 2023
Implicit meta-learning may lead language models to trust more reliable sources Dmitrii Krasheninnikov Egor Krasheninnikov Bruno Mlodozeniec Tegan Maharaj David M. Krueger 86 4 0 23 Oct 2023
When Language Models Fall in Love: Animacy Processing in Transformer Language Models Michael Hanna Yonatan Belinkov Sandro Pezzelle 53 13 0 23 Oct 2023
Evaluating Spatial Understanding of Large Language Models Yutaro Yamada Yihan Bao Andrew Kyle Lampinen Jungo Kasai Ilker Yildirim LRM 91 43 0 23 Oct 2023
The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets Samuel Marks Max Tegmark HILM 153 227 0 10 Oct 2023
Language Models Represent Space and Time Wes Gurnee Max Tegmark 137 168 0 03 Oct 2023
Physics of Language Models: Part 3.1, Knowledge Storage and Extraction Zeyuan Allen-Zhu Yuanzhi Li KELM 169 159 0 25 Sep 2023
Emergent Linear Representations in World Models of Self-Supervised Sequence Models Neel Nanda Andrew Lee Martin Wattenberg FAtt MILM 125 186 0 02 Sep 2023
Planning with Logical Graph-based Language Model for Instruction Generation Fan Zhang Kebing Jin H. Zhuo LRM 100 3 0 26 Aug 2023
Linearity of Relation Decoding in Transformer Language Models Evan Hernandez Arnab Sen Sharma Tal Haklay Kevin Meng Martin Wattenberg Jacob Andreas Yonatan Belinkov David Bau KELM 90 100 0 17 Aug 2023
On the Unexpected Abilities of Large Language Models S. Nolfi LRM 90 11 0 09 Aug 2023
Why Do We Need Neuro-symbolic AI to Model Pragmatic Analogies? Thilini Wijesiriwardene Amit P. Sheth V. Shalin Amitava Das 61 3 0 02 Aug 2023
Learning to Model the World with Language Jessy Lin Yuqing Du Olivia Watkins Danijar Hafner Pieter Abbeel Dan Klein Anca Dragan LM&Ro SyDa 130 55 0 31 Jul 2023
Learning Symbolic Rules over Abstract Meaning Representations for Textual Reinforcement Learning Subhajit Chaudhury Sarathkrishna Swaminathan Daiki Kimura Prithviraj Sen K. Murugesan ... Michiaki Tatsubori Achille Fokoue Pavan Kapanipathi Asim Munawar Alexander G. Gray NAI 70 7 0 05 Jul 2023
Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks Zhaofeng Wu Linlu Qiu Alexis Ross Ekin Akyürek Boyuan Chen Bailin Wang Najoung Kim Jacob Andreas Yoon Kim LRM ReLM 178 223 0 05 Jul 2023
Inductive reasoning in humans and large language models Simon J. Han Keith Ransom Andrew Perfors Charles Kemp ELM ReLM LRM 79 40 0 11 Jun 2023
Causal interventions expose implicit situation models for commonsense language understanding Takateru Yamakoshi James L. McClelland A. Goldberg Robert D. Hawkins 104 6 0 06 Jun 2023
The Hidden Language of Diffusion Models Hila Chefer Oran Lang Mor Geva Volodymyr Polosukhin Assaf Shocher Michal Irani Inbar Mosseri Lior Wolf DiffM 121 27 0 01 Jun 2023
Decision-Oriented Dialogue for Human-AI Collaboration Jessy Lin Nicholas Tomlin Jacob Andreas J. Eisner LLMAG 118 28 0 31 May 2023
Passive learning of active causal strategies in agents and language models Andrew Kyle Lampinen Stephanie C. Y. Chan Ishita Dasgupta A. Nam Jane X. Wang 95 18 0 25 May 2023
ByteSized32: A Corpus and Challenge Task for Generating Task-Specific World Models Expressed as Text Games Ruoyao Wang Graham Todd Xingdi Yuan Ziang Xiao Marc-Alexandre Côté Peter Alexander Jansen LRM 76 14 0 24 May 2023
Interpretability at Scale: Identifying Causal Mechanisms in Alpaca Zhengxuan Wu Atticus Geiger Thomas Icard Christopher Potts Noah D. Goodman MILM 87 93 0 15 May 2023
Similarity-weighted Construction of Contextualized Commonsense Knowledge Graphs for Knowledge-intense Argumentation Tasks Moritz Plenz Juri Opitz Philipp Heinisch Philipp Cimiano Anette Frank 95 9 0 15 May 2023
The System Model and the User Model: Exploring AI Dashboard Design Fernanda Viégas Martin Wattenberg 66 6 0 04 May 2023
Entity Tracking in Language Models Najoung Kim Sebastian Schuster 147 22 0 03 May 2023
The Vector Grounding Problem Dimitri Coelho Mollo Raphael Milliere 146 28 0 04 Apr 2023
Inspecting and Editing Knowledge Representations in Language Models Evan Hernandez Belinda Z. Li Jacob Andreas KELM 100 91 0 03 Apr 2023
Eight Things to Know about Large Language Models Sam Bowman ALM 103 117 0 02 Apr 2023
Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representations Atticus Geiger Zhengxuan Wu Christopher Potts Thomas Icard Noah D. Goodman CML 187 112 0 05 Mar 2023
LaMPP: Language Models as Probabilistic Priors for Perception and Action Belinda Z. Li William Chen Pratyusha Sharma Jacob Andreas 59 15 0 03 Feb 2023
Creating a Large Language Model of a Philosopher Eric Schwitzgebel David Schwitzgebel A. Strasser DeLMO AI4CE 97 63 0 02 Feb 2023
Towards Reasoning in Large Language Models: A Survey Jie Huang Kevin Chen-Chuan Chang LM&MA ELM LRM 194 645 0 20 Dec 2022
Language Modeling with Latent Situations Belinda Z. Li Maxwell Nye Jacob Andreas LRM 98 7 0 20 Dec 2022
Talking About Large Language Models Murray Shanahan AI4CE 132 275 0 07 Dec 2022
Language Models as Agent Models Jacob Andreas LLMAG 90 141 0 03 Dec 2022
Localization vs. Semantics: Visual Representations in Unimodal and Multimodal Models Zhuowan Li Cihang Xie Benjamin Van Durme Alan Yuille VLM SSL 56 2 0 01 Dec 2022
TRAC: A Textual Benchmark for Reasoning about Actions and Change Weinan He Canming Huang Zhanhao Xiao Yongmei Liu LLMAG ReLM LRM 50 0 0 25 Nov 2022
Probing for Incremental Parse States in Autoregressive Language Models Tiwalayo Eisape Vineet Gangireddy R. Levy Yoon Kim 58 13 0 17 Nov 2022
Breakpoint Transformers for Modeling and Tracking Intermediate Beliefs Kyle Richardson Ronen Tamari Oren Sultan Reut Tsarfaty Dafna Shahaf Ashish Sabharwal KELM 106 8 0 15 Nov 2022