Teaching Algorithmic Reasoning via In-context Learning

15 November 2022

Papers citing "Teaching Algorithmic Reasoning via In-context Learning"

43 / 93 papers shown

Title
Autonomous Tree-search Ability of Large Language Models Zheyu Zhang Zhuorui Ye Yikang Shen Chuang Gan LRM 44 0 0 14 Oct 2023
KwaiYiiMath: Technical Report Jia-Yi Fu Lei Lin Xiaoyang Gao Pengli Liu Zhengzong Chen ... Zijia Lin Fuzheng Zhang Zhongyuan Wang Di Zhang Kun Gai LRM ReLM RALM 136 2 0 11 Oct 2023
Large Language Models can Learn Rules Zhaocheng Zhu Yuan Xue Xinyun Chen Denny Zhou Jian Tang Dale Schuurmans Hanjun Dai LRM ReLM 108 70 0 10 Oct 2023
Towards Better Chain-of-Thought Prompting Strategies: A Survey Zihan Yu Liang He Zhen Wu Xinyu Dai Jiajun Chen LRM 167 55 0 08 Oct 2023
Amortizing intractable inference in large language models Marvin Schmitt Moksh Jain Daniel Habermann Younesse Kaddar Ullrich Kothe Stefan T. Radev Nikolay Malkin AIFin BDL 130 58 0 06 Oct 2023
Decoding In-Context Learning: Neuroscience-inspired Analysis of Representations in Large Language Models Safoora Yousefi Leo Betthauser Hosein Hasanbeig Raphael Milliere Ida Momennejad 61 4 0 30 Sep 2023
Stress Testing Chain-of-Thought Prompting for Large Language Models Aayush Mishra Jitin Singla LRM 18 2 0 28 Sep 2023
In-context Interference in Chat-based Large Language Models Eric Nuertey Coleman J. Hurtado Vincenzo Lomonaco KELM 61 1 0 22 Sep 2023
EchoPrompt: Instructing the Model to Rephrase Queries for Improved In-context Learning Rajasekhar Reddy Mekala Yasaman Razeghi Sameer Singh LRM 91 11 0 16 Sep 2023
Chain-of-Thought Reasoning is a Policy Improvement Operator Hugh Zhang David C. Parkes ReLM LM&Ro LRM 78 13 0 15 Sep 2023
Hypothesis Search: Inductive Reasoning with Language Models Ruocheng Wang E. Zelikman Gabriel Poesia Yewen Pu Nick Haber Noah D. Goodman ReLM LRM 132 112 0 11 Sep 2023
GPT Can Solve Mathematical Problems Without a Calculator Zhiyong Yang Ming Ding Qingsong Lv Zhihuan Jiang Zehai He Yuyi Guo Jinfeng Bai Jie Tang RALM LRM 116 56 0 06 Sep 2023
Learning the greatest common divisor: explaining transformer predictions Franccois Charton 99 18 0 29 Aug 2023
Teaching Arithmetic to Small Transformers Nayoung Lee Kartik K. Sreenivasan Jason D. Lee Kangwook Lee Dimitris Papailiopoulos LRM 105 94 0 07 Jul 2023
Length Generalization in Arithmetic Transformers Samy Jelassi Stéphane dÁscoli Carles Domingo-Enrich Yuhuai Wu Yuan-Fang Li Franccois Charton 110 43 0 27 Jun 2023
Language models are weak learners Hariharan Manikandan Yiding Jiang J Zico Kolter 87 19 0 25 Jun 2023
Deductive Verification of Chain-of-Thought Reasoning Z. Ling Yunhao Fang Xuanlin Li Zhiao Huang Mingu Lee Roland Memisevic Hao Su ReLM LRM 118 136 0 06 Jun 2023
Exposing Attention Glitches with Flip-Flop Language Modeling Bingbin Liu Jordan T. Ash Surbhi Goel A. Krishnamurthy Cyril Zhang LRM 97 53 0 01 Jun 2023
Examining the Emergence of Deductive Reasoning in Generative Language Models Peter Belcak Luca A. Lanzendörfer Roger Wattenhofer ReLM ELM LRM AI4CE 43 0 0 31 May 2023
Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learning Yingcong Li Kartik K. Sreenivasan Angeliki Giannou Dimitris Papailiopoulos Samet Oymak LRM 113 18 0 30 May 2023
Faith and Fate: Limits of Transformers on Compositionality Nouha Dziri Ximing Lu Melanie Sclar Xiang Lorraine Li Liwei Jian ... Sean Welleck Xiang Ren Allyson Ettinger Zaïd Harchaoui Yejin Choi ReLM LRM 204 388 0 29 May 2023
FERMAT: An Alternative to Accuracy for Numerical Reasoning Jasivan Sivakumar N. Moosavi ReLM LRM 93 4 0 27 May 2023
Passive learning of active causal strategies in agents and language models Andrew Kyle Lampinen Stephanie C. Y. Chan Ishita Dasgupta A. Nam Jane X. Wang 93 18 0 25 May 2023
Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement Zhiheng Xi Senjie Jin Yuhao Zhou Rui Zheng Songyang Gao Tao Gui Qi Zhang Xuanjing Huang ReLM LRM 89 48 0 23 May 2023
Goat: Fine-tuned LLaMA Outperforms GPT-4 on Arithmetic Tasks Tiedong Liu K. H. Low ALM 91 87 0 23 May 2023
Can Language Models Solve Graph Problems in Natural Language? Heng Wang Shangbin Feng Tianxing He Zhaoxuan Tan Xiaochuang Han Yulia Tsvetkov ReLM LRM 119 199 0 17 May 2023
Large Language Model Programs Imanol Schlag Sainbayar Sukhbaatar Asli Celikyilmaz Wen-tau Yih Jason Weston Jürgen Schmidhuber Xian Li LRM 94 15 0 09 May 2023
Code Execution with Pre-trained Language Models Chenxiao Liu Shuai Lu Weizhu Chen Daxin Jiang Alexey Svyatkovskiy Shengyu Fu Neel Sundaresan Nan Duan ELM 112 28 0 08 May 2023
Prompted LLMs as Chatbot Modules for Long Open-domain Conversation Gibbeum Lee Volker Hartmann Jongho Park Dimitris Papailiopoulos Kangwook Lee 77 67 0 08 May 2023
Faithful Question Answering with Monte-Carlo Planning Ruixin Hong Hongming Zhang Honghui Zhao Dong Yu Changshui Zhang ReLM LRM 152 20 0 04 May 2023
Few-shot In-context Learning for Knowledge Base Question Answering Tianle Li Xueguang Ma Alex Zhuang Yu Gu Yu-Chuan Su Wenhu Chen 182 84 0 02 May 2023
Teaching Large Language Models to Self-Debug Xinyun Chen Maxwell Lin Nathanael Scharli Denny Zhou LRM 151 711 0 11 Apr 2023
Mastering Symbolic Operations: Augmenting Language Models with Compiled Neural Networks Yixuan Weng Minjun Zhu Fei Xia Bin Li Shizhu He Kang Liu Jun Zhao 90 6 0 04 Apr 2023
Can neural networks do arithmetic? A survey on the elementary numerical skills of state-of-the-art deep learning models Alberto Testolin AIMat 72 22 0 14 Mar 2023
Complex QA and language models hybrid architectures, Survey Xavier Daull P. Bellot Emmanuel Bruno Vincent Martin Elisabeth Murisasco ELM 214 16 0 17 Feb 2023
Looped Transformers as Programmable Computers Angeliki Giannou Shashank Rajput Jy-yong Sohn Kangwook Lee Jason D. Lee Dimitris Papailiopoulos 103 107 0 30 Jan 2023
A Survey on In-context Learning Qingxiu Dong Lei Li Damai Dai Ce Zheng Jingyuan Ma ... Zhiyong Wu Baobao Chang Xu Sun Lei Li Zhifang Sui ReLM AIMat 157 547 0 31 Dec 2022
Parsel: Algorithmic Reasoning with Language Models by Composing Decompositions E. Zelikman Qian Huang Gabriel Poesia Noah D. Goodman Nick Haber ReLM LRM 88 58 0 20 Dec 2022
LAMBADA: Backward Chaining for Automated Reasoning in Natural Language Seyed Mehran Kazemi Najoung Kim Deepti Bhatia Xinyuan Xu Deepak Ramachandran LRM 106 81 0 20 Dec 2022
Towards Reasoning in Large Language Models: A Survey Jie Huang Kevin Chen-Chuan Chang LM&MA ELM LRM 194 645 0 20 Dec 2022
Reasoning with Language Model Prompting: A Survey Shuofei Qiao Yixin Ou Ningyu Zhang Xiang Chen Yunzhi Yao Shumin Deng Chuanqi Tan Fei Huang Huajun Chen ReLM ELM LRM 234 327 0 19 Dec 2022
Evaluating Step-by-Step Reasoning through Symbolic Verification Yi-Fan Zhang Hanlin Zhang Li Erran Li Eric P. Xing ReLM LRM 95 8 0 16 Dec 2022
Complementary Explanations for Effective In-Context Learning Xi Ye Srini Iyer Asli Celikyilmaz Ves Stoyanov Greg Durrett Ramakanth Pasunuru ReLM LRM 112 96 0 25 Nov 2022