Teaching Algorithmic Reasoning via In-context Learning

15 November 2022

Papers citing "Teaching Algorithmic Reasoning via In-context Learning"

50 / 93 papers shown

Title
A Survey on Large Language Models for Mathematical Reasoning Peng-Yuan Wang Tian-Shuo Liu Chenyang Wang Yi-Di Wang Shu Yan ... Xu-Hui Liu Xin-Wei Chen Jia-Cheng Xu Ziniu Li Yang Yu LRM 35 0 0 10 Jun 2025
The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity Parshin Shojaee Iman Mirzadeh Keivan Alizadeh Maxwell Horton Samy Bengio Mehrdad Farajtabar LRM 36 9 0 07 Jun 2025
EPiC: Towards Lossless Speedup for Reasoning Training through Edge-Preserving CoT Condensation Jinghan Jia Hadi Reisizadeh Chongyu Fan Nathalie Baracaldo Mingyi Hong Sijia Liu LRM 135 0 0 04 Jun 2025
DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience Runxiang Wang Boxiao Wang Kai Li Yifan Zhang Jian Cheng 30 0 0 04 Jun 2025
DSR-Bench: Evaluating the Structural Reasoning Abilities of LLMs via Data Structures Yu He Yingxi Li Colin White Ellen Vitercik ELM LRM 26 0 0 29 May 2025
L0-Reasoning Bench: Evaluating Procedural Correctness in Language Models via Simple Program Execution Simeng Sun Cheng-Ping Hsieh Faisal Ladhak Erik Arakelyan Santiago Akle Serano Boris Ginsburg ReLM ELM LRM 496 0 0 28 Mar 2025
A Survey on Mathematical Reasoning and Optimization with Large Language Models Ali Forootani OffRL LRM AI4CE 120 1 0 22 Mar 2025
Improving Value-based Process Verifier via Structural Prior Injection Zetian Sun Dongfang Li Baotian Hu Jun Yu Min Zhang 97 0 0 21 Feb 2025
Are Transformers Able to Reason by Connecting Separated Knowledge in Training Data? Yutong Yin Zhaoran Wang LRM ReLM 476 1 0 27 Jan 2025
Mathematical Language Models: A Survey Wen Liu Hanglei Hu Jie Zhou Yuyang Ding Junsong Li ... Mengliang He Qin Chen Bo Jiang Aimin Zhou Liang He LRM 235 14 0 03 Jan 2025
Prompting Strategies for Enabling Large Language Models to Infer Causation from Correlation Eleni Sgouritsa Virginia Aglietti Yee Whye Teh Arnaud Doucet Arthur Gretton Silvia Chiappa ReLM LRM 167 1 0 18 Dec 2024
SetLexSem Challenge: Using Set Operations to Evaluate the Lexical and Semantic Robustness of Language Models Bardiya Akhbari Manish Gawali Nicholas A. Dronen AAML 115 0 0 11 Nov 2024
Quantifying artificial intelligence through algorithmic generalization Takuya Ito Murray Campbell L. Horesh Tim Klinger Parikshit Ram ELM 124 0 0 08 Nov 2024
RARe: Retrieval Augmented Retrieval with In-Context Examples Atula Tejaswi Yoonsang Lee Sujay Sanghavi Eunsol Choi RALM LRM 62 1 0 26 Oct 2024
In-Context Learning Enables Robot Action Prediction in LLMs Yida Yin Zekai Wang Yuvan Sharma Dantong Niu Trevor Darrell Roei Herzig LM&Ro 278 4 0 16 Oct 2024
Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent Bo Chen Xiaoyu Li Yingyu Liang Zhenmei Shi Zhao Song 152 22 0 15 Oct 2024
Beyond Graphs: Can Large Language Models Comprehend Hypergraphs? Yifan Feng Chengwu Yang Xingliang Hou S. Du Shihui Ying Zongze Wu Yue Gao 111 4 0 14 Oct 2024
Everything Everywhere All at Once: LLMs can In-Context Learn Multiple Tasks in Superposition Zheyang Xiong Ziyang Cai John Cooper Albert Ge Vasilis Papageorgiou ... Saurabh Agarwal Grigorios G Chrysos Samet Oymak Kangwook Lee Dimitris Papailiopoulos LRM 102 3 0 08 Oct 2024
Your Context Is Not an Array: Unveiling Random Access Limitations in Transformers MohammadReza Ebrahimi Sunny Panchal Roland Memisevic 99 7 0 10 Aug 2024
Reasoning in Large Language Models: A Geometric Perspective Romain Cosentino Sarath Shekkizhar LRM 88 3 0 02 Jul 2024
Effective Generative AI: The Human-Algorithm Centaur S. Saghafian Lihi Idan 83 7 0 16 Jun 2024
Transformers meet Neural Algorithmic Reasoners Wilfried Bounsi Borja Ibarz Andrew Dudzik Jessica B. Hamrick Larisa Markeeva Alex Vitvitskyi Razvan Pascanu Petar Veličković NAI AI4CE LRM 84 7 0 13 Jun 2024
The CLRS-Text Algorithmic Reasoning Language Benchmark Larisa Markeeva Sean McLeish Borja Ibarz Wilfried Bounsi Olga Kozlova Alex Vitvitskyi Charles Blundell Tom Goldstein Avi Schwarzschild Petar Veličković LRM 99 15 0 06 Jun 2024
Language Models Need Inductive Biases to Count Inductively Yingshan Chang Yonatan Bisk LRM 78 7 0 30 May 2024
Why Larger Language Models Do In-context Learning Differently? Zhenmei Shi Junyi Wei Zhuoyan Xu Yingyu Liang 81 26 0 30 May 2024
Understanding Transformer Reasoning Capabilities via Graph Algorithms Clayton Sanford Bahare Fatemi Ethan Hall Anton Tsitsulin Seyed Mehran Kazemi Jonathan J. Halcrow Bryan Perozzi Vahab Mirrokni 112 39 0 28 May 2024
Chain of Thoughtlessness? An Analysis of CoT in Planning Kaya Stechly Karthik Valmeekam Subbarao Kambhampati LRM LM&Ro 184 52 0 08 May 2024
A Survey on the Integration of Generative AI for Critical Thinking in Mobile Networks Athanasios Karapantelakis Alexandros Nikou Ajay Kattepur Jean Martins Leonid Mokrushin S. Mohalik Marin Orlic Aneta Vulgarakis Feljan 89 2 0 10 Apr 2024
Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models Hyungjoo Chae Yeonghyeon Kim Seungone Kim Kai Tzu-iunn Ong Beong-woo Kwak ... Seonghwan Kim Taeyoon Kwon Jiwan Chung Youngjae Yu Jinyoung Yeo LRM ReLM 78 16 0 03 Apr 2024
Task Agnostic Architecture for Algorithm Induction via Implicit Composition Sahil J. Sindhi Ignas Budvytis 87 0 0 03 Apr 2024
Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking E. Zelikman Georges Harik Yijia Shao Varuna Jayasiri Nick Haber Noah D. Goodman LLMAG ReLM LRM 137 151 0 14 Mar 2024
Mastering Text, Code and Math Simultaneously via Fusing Highly Specialized Language Models Ning Ding Yulin Chen Ganqu Cui Xingtai Lv Weilin Zhao Ruobing Xie Bowen Zhou Zhiyuan Liu Maosong Sun ALM MoMe AI4CE 152 7 0 13 Mar 2024
DP-TabICL: In-Context Learning with Differentially Private Tabular Data Alycia N. Carey Karuna Bhaila Kennedy Edemacu Xintao Wu 113 7 0 08 Mar 2024
How Well Can Transformers Emulate In-context Newton's Method? Angeliki Giannou Liu Yang Tianhao Wang Dimitris Papailiopoulos Jason D. Lee 88 20 0 05 Mar 2024
Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs Aaditya K. Singh DJ Strouse 116 61 0 22 Feb 2024
Transformers Can Achieve Length Generalization But Not Robustly Yongchao Zhou Uri Alon Xinyun Chen Xuezhi Wang Rishabh Agarwal Denny Zhou 125 43 0 14 Feb 2024
Leveraging the Context through Multi-Round Interactions for Jailbreaking Attacks Yixin Cheng Markos Georgopoulos Volkan Cevher Grigorios G. Chrysos AAML 71 15 0 14 Feb 2024
Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought Alex Havrilla Maia Iyer 57 8 0 06 Feb 2024
Evolving Code with A Large Language Model Erik Hemberg Stephen Moskal Una-May O’Reilly 82 30 0 13 Jan 2024
SimLM: Can Language Models Infer Parameters of Physical Systems? Sean Memery Mirella Lapata Kartic Subr LRM AI4CE 84 3 0 21 Dec 2023
Frugal LMs Trained to Invoke Symbolic Solvers Achieve Parameter-Efficient Arithmetic Reasoning Subhabrata Dutta Joykirat Singh Ishan Pandey Sunny Manchanda Soumen Chakrabarti Tanmoy Chakraborty ReLM LRM 88 4 0 09 Dec 2023
Hot PATE: Private Aggregation of Distributions for Diverse Task Edith Cohen Benjamin Cohen-Wang Xin Lyu Jelani Nelson Tamas Sarlos Uri Stemmer 119 4 0 04 Dec 2023
Positional Description Matters for Transformers Arithmetic Ruoqi Shen Sébastien Bubeck Ronen Eldan Yin Tat Lee Yuanzhi Li Yi Zhang 92 45 0 22 Nov 2023
Looped Transformers are Better at Learning Learning Algorithms Liu Yang Kangwook Lee Robert D. Nowak Dimitris Papailiopoulos 97 26 0 21 Nov 2023
Unleashing the Creative Mind: Language Model As Hierarchical Policy For Improved Exploration on Challenging Problem Solving Z. Ling Yunhao Fang Xuanlin Li Tongzhou Mu Mingu Lee Reza Pourreza Roland Memisevic Hao Su LRM 93 4 0 01 Nov 2023
Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review Banghao Chen Zhaofeng Zhang Nicolas Langrené Shengxin Zhu LLMAG 114 13 0 23 Oct 2023
Evaluating Large Language Models on Controlled Generation Tasks Jiao Sun Yufei Tian Wangchunshu Zhou Nan Xu Qian Hu Rahul Gupta John Wieting Nanyun Peng Xuezhe Ma LRM ELM 97 65 0 23 Oct 2023
From Interpolation to Extrapolation: Complete Length Generalization for Arithmetic Transformers Shaoxiong Duan Yining Shi Wei Xu 113 12 0 18 Oct 2023
Llemma: An Open Language Model For Mathematics Zhangir Azerbayev Hailey Schoelkopf Keiran Paster Marco Dos Santos Stephen Marcus McAleer Albert Q. Jiang Jia Deng Stella Biderman Sean Welleck CLL 126 303 0 16 Oct 2023
Large Language Models for In-Context Student Modeling: Synthesizing Student's Behavior in Visual Programming Manh Hung Nguyen Sebastian Tschiatschek Adish Singla AI4Ed 58 7 0 15 Oct 2023