ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning

ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning

15 December 2022

O. Yu. Golovneva

Martin Corredor

Luke Zettlemoyer

Maryam Fazel-Zarandi

Asli Celikyilmaz

Papers citing "ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning"

11 / 111 papers shown

Title
Neuro-Symbolic Execution of Generic Source Code Yaojie Hu Jin Tian NAI 30 0 0 23 Mar 2023
CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification Seungone Kim Se June Joo Yul Jang Hyungjoo Chae Jinyoung Yeo LRM 19 12 0 07 Mar 2023
Towards Reasoning in Large Language Models: A Survey Jie Huang Kevin Chen-Chuan Chang LM&MA ELM LRM 29 583 0 20 Dec 2022
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters Boshi Wang Sewon Min Xiang Deng Jiaming Shen You Wu Luke Zettlemoyer Huan Sun LRM ReLM 34 224 0 20 Dec 2022
ALERT: Adapting Language Models to Reasoning Tasks Ping Yu Tianlu Wang O. Yu. Golovneva Badr AlKhamissi Siddharth Verma Zhijing Jin Gargi Ghosh Mona T. Diab Asli Celikyilmaz ReLM LRM 34 21 0 16 Dec 2022
MENLI: Robust Evaluation Metrics from Natural Language Inference Yanran Chen Steffen Eger 32 15 0 15 Aug 2022
Self-Consistency Improves Chain of Thought Reasoning in Language Models Xuezhi Wang Jason W. Wei Dale Schuurmans Quoc Le Ed H. Chi Sharan Narang Aakanksha Chowdhery Denny Zhou ReLM BDL LRM AI4CE 314 3,248 0 21 Mar 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 382 8,495 0 28 Jan 2022
Explaining Answers with Entailment Trees Bhavana Dalvi Peter Alexander Jansen Oyvind Tafjord Zhengnan Xie Hannah Smith Leighanna Pipatanangkura Peter Clark ReLM FAtt LRM 239 184 0 17 Apr 2021
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies Mor Geva Daniel Khashabi Elad Segal Tushar Khot Dan Roth Jonathan Berant RALM 250 677 0 06 Jan 2021
e-SNLI: Natural Language Inference with Natural Language Explanations Oana-Maria Camburu Tim Rocktaschel Thomas Lukasiewicz Phil Blunsom LRM 260 620 0 04 Dec 2018