GPT-4 Can't Reason

21 July 2023

Papers citing "GPT-4 Can't Reason"

22 / 22 papers shown

Title
Have Large Language Models Learned to Reason? A Characterization via 3-SAT Phase Transition Rishi Hazra Gabriele Venturato Pedro Zuidberg Dos Martires Luc de Raedt ReLM LRM 63 0 0 04 Apr 2025
Evaluating the Systematic Reasoning Abilities of Large Language Models through Graph Coloring Alex Heyman Joel Zylberberg LRM 50 0 0 10 Feb 2025
Aligning Generalisation Between Humans and Machines Filip Ilievski Barbara Hammer F. V. Harmelen Benjamin Paassen S. Saralajew ... Vered Shwartz Gabriella Skitalinskaya Clemens Stachl Gido M. van de Ven T. Villmann 81 1 0 23 Nov 2024
Leveraging LLMs for Hypothetical Deduction in Logical Inference: A Neuro-Symbolic Approach Qingchuan Li Jiatong Li Tongxuan Liu Yuting Zeng Mingyue Cheng Weizhe Huang Qi Liu LRM AI4CE 54 2 0 29 Oct 2024
A Statistical Analysis of LLMs' Self-Evaluation Using Proverbs Ryosuke Sonoda Ramya Srinivasan 59 1 0 22 Oct 2024
A Theoretical Survey on Foundation Models Shi Fu Yuzhu Chen Yingjie Wang Dacheng Tao 28 0 0 15 Oct 2024
The application of GPT-4 in grading design university students' assignment and providing feedback: An exploratory study Qian Huang Thijs Willems King Wang Poon 18 0 0 26 Sep 2024
Logic-of-Thought: Injecting Logic into Contexts for Full Reasoning in Large Language Models Tongxuan Liu Wenjiang Xu Weizhe Huang Yuting Zeng Jiaxing Wang Hailong Yang Hailong Yang Jing Li LRM ReLM 52 5 0 26 Sep 2024
Can Large Language Models Reason? A Characterization via 3-SAT Rishi Hazra Gabriele Venturato Pedro Zuidberg Dos Martires Luc de Raedt ELM ReLM LRM 38 4 0 13 Aug 2024
Evaluating and Modeling Social Intelligence: A Comparative Study of Human and AI Capabilities Junqi Wang Chunhui Zhang Jiapeng Li Yuxi Ma Lixing Niu Jiaheng Han Yujia Peng Yixin Zhu Lifeng Fan ELM ALM 31 3 0 20 May 2024
Information Re-Organization Improves Reasoning in Large Language Models Xiaoxia Cheng Zeqi Tan Wei Xue Weiming Lu LRM 28 2 0 22 Apr 2024
MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation Zhongshen Zeng Pengguang Chen Shu Liu Haiyun Jiang Jiaya Jia ReLM ELM LRM 36 18 0 28 Dec 2023
How should the advent of large language models affect the practice of science? Marcel Binz Stephan Alaniz Adina Roskies B. Aczel Carl T. Bergstrom ... Emily M. Bender M. Marelli Matthew M. Botvinick Zeynep Akata Eric Schulz 36 9 0 05 Dec 2023
Conditions for Length Generalization in Learning Reasoning Skills Changnan Xiao Bing Liu LRM 37 7 0 22 Nov 2023
The Generative AI Paradox: "What It Can Create, It May Not Understand" Peter West Ximing Lu Nouha Dziri Faeze Brahman Linjie Li ... Khyathi Raghavi Chandu Benjamin Newman Pang Wei Koh Allyson Ettinger Yejin Choi AIMat 18 68 0 31 Oct 2023
GPT-4 Doesn't Know It's Wrong: An Analysis of Iterative Prompting for Reasoning Problems Kaya Stechly Matthew Marquez Subbarao Kambhampati LRM 165 84 0 19 Oct 2023
SocREval: Large Language Models with the Socratic Method for Reference-Free Reasoning Evaluation Hangfeng He Hongming Zhang Dan Roth LRM ELM ReLM 28 13 0 29 Sep 2023
Chain-of-Thought Reasoning is a Policy Improvement Operator Hugh Zhang David C. Parkes ReLM LM&Ro LRM 21 12 0 15 Sep 2023
Strategic Behavior of Large Language Models: Game Structure vs. Contextual Framing Nunzio Lorè Babak Heydari 21 33 0 12 Sep 2023
Memory Injections: Correcting Multi-Hop Reasoning Failures during Inference in Transformer-Based Language Models Mansi Sakarvadia Aswathy Ajith Arham Khan Daniel Grzenda Nathaniel Hudson André Bauer Kyle Chard Ian Foster KELM LRM 24 16 0 11 Sep 2023
Concepts is All You Need: A More Direct Path to AGI Peter Voss M. Jovanovic 25 4 0 04 Sep 2023
Conversational Process Modeling: Can Generative AI Empower Domain Experts in Creating and Redesigning Process Models? Nataliia Klievtsova Janik-Vasily Benzin T. Kampik Juergen Mangler Stefanie Rinderle-Ma 25 6 0 19 Apr 2023