Evaluating Spatial Understanding of Large Language Models

Evaluating Spatial Understanding of Large Language Models

23 October 2023

Andrew Kyle Lampinen

Papers citing "Evaluating Spatial Understanding of Large Language Models"

10 / 10 papers shown

Title
From Reasoning to Generalization: Knowledge-Augmented LLMs for ARC Benchmark Chao Lei Nir Lipovetzky Krista A. Ehinger Yanchuan Chang LRM 101 0 0 23 May 2025
BIG-Bench Extra Hard Mehran Kazemi Bahare Fatemi Hritik Bansal John Palowitch Chrysovalantis Anastasiou ... Kate Olszewska Yi Tay Vinh Q. Tran Quoc V. Le Orhan Firat ELM LRM 278 12 0 26 Feb 2025
GRASP: A Grid-Based Benchmark for Evaluating Commonsense Spatial Reasoning Zhisheng Tang Mayank Kejriwal LRM 97 3 0 20 Jan 2025
Evaluating Vision-Language Models as Evaluators in Path Planning Mohamed Aghzal Xiang Yue Erion Plaku Ziyu Yao LRM 150 1 0 27 Nov 2024
RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Robotics Chan Hee Song Valts Blukis Jonathan Tremblay Stephen Tyree Yu-Chuan Su Stan Birchfield 162 15 0 25 Nov 2024
BALROG: Benchmarking Agentic LLM and VLM Reasoning On Games Davide Paglieri Bartłomiej Cupiał Samuel Coward Ulyana Piterbarg Maciej Wolczyk ... Lerrel Pinto Rob Fergus Jakob Foerster Jack Parker-Holder Tim Rocktaschel LLMAG LRM 189 19 0 20 Nov 2024
Evaluating Cognitive Maps and Planning in Large Language Models with CogEval Ida Momennejad Hosein Hasanbeig Felipe Vieira Frujeri Hiteshi Sharma Robert Osazuwa Ness Nebojsa Jojic Hamid Palangi Jonathan Larson ELM LLMAG LRM 79 73 0 25 Sep 2023
StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts Zhengxiang Shi Qiang Zhang Aldo Lipani 118 74 0 18 Apr 2022
Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color Mostafa Abdou Artur Kulmizev Daniel Hershcovich Stella Frank Ellie Pavlick Anders Søgaard 71 122 0 13 Sep 2021
Implicit Representations of Meaning in Neural Language Models Belinda Z. Li Maxwell Nye Jacob Andreas NAI MILM 60 176 0 01 Jun 2021