Language Models Are Greedy Reasoners: A Systematic Formal Analysis of
Chain-of-Thought

Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought

3 October 2022

Abulhair Saparov

Papers citing "Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought"

19 / 69 papers shown

Title
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 842 12,893 0 04 Mar 2022
Impact of Pretraining Term Frequencies on Few-Shot Reasoning Yasaman Razeghi Robert L Logan IV Matt Gardner Sameer Singh ReLM LRM 74 155 0 15 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 770 9,351 0 28 Jan 2022
Natural Language Deduction through Search over Statement Compositions Kaj Bostrom Zayne Sprague Swarat Chaudhuri Greg Durrett ReLM LRM 74 46 0 16 Jan 2022
Training Verifiers to Solve Math Word Problems K. Cobbe V. Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun ... Jerry Tworek Jacob Hilton Reiichiro Nakano Christopher Hesse John Schulman ReLM OffRL LRM 267 4,392 0 27 Oct 2021
Saturated Transformers are Constant-Depth Threshold Circuits William Merrill Ashish Sabharwal Noah A. Smith 68 105 0 30 Jun 2021
Towards General Natural Language Understanding with Probabilistic Worldbuilding Abulhair Saparov Tom Michael Mitchell 61 6 0 06 May 2021
Flexible Generation of Natural Language Deductions Kaj Bostrom Xinyu Zhao Swarat Chaudhuri Greg Durrett ReLM LRM 288 33 0 18 Apr 2021
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu Max Bartolo Alastair Moore Sebastian Riedel Pontus Stenetorp AILaw LRM 398 1,181 0 18 Apr 2021
Can NLI Models Verify QA Systems' Predictions? Jifan Chen Eunsol Choi Greg Durrett 87 54 0 18 Apr 2021
NaturalProofs: Mathematical Theorem Proving in Natural Language Sean Welleck Jiacheng Liu Ronan Le Bras Hannaneh Hajishirzi Yejin Choi Kyunghyun Cho AIMat 62 68 0 24 Mar 2021
ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language Oyvind Tafjord Bhavana Dalvi Peter Clark 70 273 0 24 Dec 2020
Leveraging Abstract Meaning Representation for Knowledge Base Question Answering Pavan Kapanipathi Ibrahim Abdelaziz Srinivas Ravishankar Salim Roukos Alexander G. Gray ... Ryan Riegel Gaetano Rossiello Udit Sharma G P Shrivatsa Bhargav Mo Yu 57 110 0 03 Dec 2020
Critical Thinking for Language Models Gregor Betz Christian Voigt Kyle Richardson SyDa ReLM LRM AI4CE 72 35 0 15 Sep 2020
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 741 41,894 0 28 May 2020
Abductive Commonsense Reasoning Chandra Bhagavatula Ronan Le Bras Chaitanya Malaviya Keisuke Sakaguchi Ari Holtzman Hannah Rashkin Doug Downey Scott Yih Yejin Choi ReLM LRM 72 460 0 15 Aug 2019
Neural Logic Machines Honghua Dong Jiayuan Mao Tian Lin Chong-Jun Wang Lihong Li Denny Zhou NAI LRM AI4CE 124 249 0 26 Apr 2019
End-to-End Differentiable Proving Tim Rocktaschel Sebastian Riedel NAI 94 381 0 31 May 2017
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks Jason Weston Antoine Bordes S. Chopra Alexander M. Rush Bart van Merriënboer Armand Joulin Tomas Mikolov LRM ELM 142 1,181 0 19 Feb 2015