The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs

27 February 2025

Papers citing "The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs"

8 / 8 papers shown

Title
Language Models, Graph Searching, and Supervision Adulteration: When More Supervision is Less and How to Make More More Arvid Frydenlund LRM 98 0 0 13 Mar 2025
Language Models Use Trigonometry to Do Addition Subhash Kantamneni Max Tegmark LRM 52 7 0 02 Feb 2025
Arithmetic Without Algorithms: Language Models Solve Math With a Bag of Heuristics Yaniv Nikankin Anja Reusch Aaron Mueller Yonatan Belinkov AIFin LRM 84 29 0 28 Oct 2024
Language Models Encode Numbers Using Digit Representations in Base 10 Amit Arnold Levy Mor Geva 48 5 0 15 Oct 2024
Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs Aaditya K. Singh DJ Strouse 75 53 0 22 Feb 2024
Successor Heads: Recurring, Interpretable Attention Heads In The Wild Rhys Gould Euan Ong George Ogden Arthur Conmy LRM 31 48 0 14 Dec 2023
What Algorithms can Transformers Learn? A Study in Length Generalization Hattie Zhou Arwen Bradley Etai Littwin Noam Razin Omid Saremi Josh Susskind Samy Bengio Preetum Nakkiran 52 118 0 24 Oct 2023
Qwen Technical Report Jinze Bai Shuai Bai Yunfei Chu Zeyu Cui Kai Dang ... Zhenru Zhang Chang Zhou Jingren Zhou Xiaohuan Zhou Tianhang Zhu OSLM 174 1,756 0 28 Sep 2023