Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability
of Large Language Models

Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Models

24 June 2024

Mohith Kulkarni

Aashna Budhiraja

Mutsumi Nakamura

Neeraj Varshney

ArXiv (abs)PDF HTML Github (1★)

Papers citing "Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Models"

11 / 11 papers shown

Title
Autonomous Evaluation of LLMs for Truth Maintenance and Reasoning Tasks Rushang Karia Daniel Bramblett D. Dobhal Siddharth Srivastava ELM LRM 105 0 0 11 Oct 2024
Yi: Open Foundation Models by 01.AI 01. AI Alex Young 01.AI Alex Young Bei Chen Chao Li ... Yue Wang Yuxuan Cai Zhenyu Gu Zhiyuan Liu Zonghong Dai OSLM LRM 311 573 0 07 Mar 2024
KTO: Model Alignment as Prospect Theoretic Optimization Kawin Ethayarajh Winnie Xu Niklas Muennighoff Dan Jurafsky Douwe Kiela 275 569 0 02 Feb 2024
Orca 2: Teaching Small Language Models How to Reason Arindam Mitra Luciano Del Corro Shweti Mahajan Andres Codas Clarisse Simoes ... Hamid Palangi Guoqing Zheng Corby Rosset Hamed Khanpour Ahmed Hassan Awadallah ReLM LRM 89 144 0 18 Nov 2023
LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers Theo X. Olausson Alex Gu Benjamin Lipkin Cedegao E. Zhang Armando Solar-Lezama Josh Tenenbaum Roger Levy LRM AI4CE ReLM 147 119 0 23 Oct 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 389 4,163 0 29 May 2023
On the Paradox of Learning to Reason from Data Honghua Zhang Liunian Harold Li Tao Meng Kai-Wei Chang Guy Van den Broeck NAI ReLM OOD LRM 203 108 0 23 May 2022
RuleBert: Teaching Soft Rules to Pre-trained Language Models Mohammed Saeed N. Ahmadi Preslav Nakov Paolo Papotti LRM 320 33 0 24 Sep 2021
Finetuned Language Models Are Zero-Shot Learners Jason W. Wei Maarten Bosma Vincent Zhao Kelvin Guu Adams Wei Yu Brian Lester Nan Du Andrew M. Dai Quoc V. Le ALM UQCV 251 3,789 0 03 Sep 2021
ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language Oyvind Tafjord Bhavana Dalvi Peter Clark 95 277 0 24 Dec 2020
Transformers as Soft Reasoners over Language Peter Clark Oyvind Tafjord Kyle Richardson ReLM OffRL LRM 109 361 0 14 Feb 2020