Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks

Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks

14 November 2023

Melanie Mitchell

Alessandro B. Palmarini

Papers citing "Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks"

10 / 10 papers shown

Title
Evaluating Compositional Scene Understanding in Multimodal Generative Models Shuhao Fu Andrew Jun Lee Anna Wang Ida Momennejad Trevor Bihl Hongjing Lu Taylor Webb CoGe OCL 109 1 0 29 Mar 2025
Shuttle Between the Instructions and the Parameters of Large Language Models Wangtao Sun Haotian Xu Huanxuan Liao Xuanqing Yu Zhongtao Jiang Shizhu He Jun Zhao Kang Liu 70 0 0 04 Feb 2025
TurtleBench: A Visual Programming Benchmark in Turtle Geometry Sina Rismanchian Yasaman Razeghi Sameer Singh Shayan Doroudi 56 1 0 31 Oct 2024
Understanding the Limits of Vision Language Models Through the Lens of the Binding Problem Declan Campbell Sunayana Rane Tyler Giallanza Nicolò De Sabbata Kia Ghods ... Alexander Ku Steven M. Frankland Thomas Griffiths Jonathan D. Cohen Taylor W. Webb 42 13 0 31 Oct 2024
H-ARC: A Robust Estimate of Human Performance on the Abstraction and Reasoning Corpus Benchmark Solim LeGris Wai Keen Vong Brenden M. Lake Todd M. Gureckis LRM 45 8 0 02 Sep 2024
ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learning Hosung Lee Sejin Kim Seungpil Lee Sanha Hwang Jihwan Lee Byung-Jun Lee Sundong Kim LRM 41 8 0 30 Jul 2024
A-I-RAVEN and I-RAVEN-Mesh: Two New Benchmarks for Abstract Visual Reasoning Mikołaj Małkiński Jacek Mańdziuk 39 1 0 16 Jun 2024
A Survey of Language-Based Communication in Robotics William Hunt Sarvapali D. Ramchurn Mohammad D. Soorati LM&Ro 65 12 0 06 Jun 2024
Program Synthesis using Inductive Logic Programming for the Abstraction and Reasoning Corpus Filipe Marinho Rocha Ines Dutra Vítor Santos Costa LRM 40 2 0 10 May 2024
Inherent limitations of LLMs regarding spatial information He Yan Xinyao Hu Xiangpeng Wan Chengyu Huang Kai Zou Shiqi Xu LRM 36 2 0 05 Dec 2023