ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning

11 February 2020

Weihao Yu

Papers citing "ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning"

50 / 159 papers shown

Title
Reason from Fallacy: Enhancing Large Language Models' Logical Reasoning through Logical Fallacy Understanding Yanda Li Dixuan Wang Jiaqing Liang Guochao Jiang Qi He Yanghua Xiao Deqing Yang LRM ELM 48 7 0 04 Apr 2024
Advancing LLM Reasoning Generalists with Preference Trees Lifan Yuan Ganqu Cui Hanbin Wang Ning Ding Xingyao Wang ... Zhenghao Liu Bowen Zhou Hao Peng Zhiyuan Liu Maosong Sun LRM 45 101 0 02 Apr 2024
Towards Generalizable and Faithful Logic Reasoning over Natural Language via Resolution Refutation Zhouhao Sun Xiao Ding Li Du Bibo Cai Jin-Fang Gao Ting Liu Bing Qin LRM ReLM 34 0 0 02 Apr 2024
TriSum: Learning Summarization Ability from Large Language Models with Structured Rationale Pengcheng Jiang Cao Xiao Zifeng Wang Parminder Bhatia Jimeng Sun Jiawei Han LRM 26 10 0 15 Mar 2024
FCoReBench: Can Large Language Models Solve Challenging First-Order Combinatorial Reasoning Problems? Chinmay Mittal Krishna Kartik Mausam Parag Singla LRM 44 1 0 04 Feb 2024
Distractor Generation for Multiple-Choice Questions: A Survey of Methods, Datasets, and Evaluation Elaf Alhazmi Quan Z. Sheng W. Zhang Munazza Zaib A. Alhazmi AI4Ed 48 1 0 02 Feb 2024
An Information-Theoretic Approach to Analyze NLP Classification Tasks Luran Wang Mark J. F. Gales Vatsal Raina 22 1 0 01 Feb 2024
Learning Planning-based Reasoning by Trajectories Collection and Process Reward Synthesizing Fangkai Jiao Chengwei Qin Zhengyuan Liu Nancy F. Chen Chenyu You LRM 23 29 0 01 Feb 2024
A Study on Training and Developing Large Language Models for Behavior Tree Generation Fu Li Xueying Wang Bin Li Yunlong Wu Yanzhen Wang Xiaodong Yi 14 4 0 16 Jan 2024
DCR: Divide-and-Conquer Reasoning for Multi-choice Question Answering with LLMs Zijie Meng Yan Zhang Zhaopeng Feng Zuozhu Liu LRM 27 4 0 10 Jan 2024
Assessing Logical Reasoning Capabilities of Encoder-Only Transformer Models Paulo Pirozelli M. M. José Paulo de Tarso P. Filho A. Brandão Fabio Gagliardi Cozman LRM ELM 42 2 0 18 Dec 2023
Explain To Decide: A Human-Centric Review on the Role of Explainable Artificial Intelligence in AI-assisted Decision Making Milad Rogha 41 0 0 11 Dec 2023
Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers Nuo Chen Ning Wu Shining Liang Ming Gong Linjun Shou Dongmei Zhang Jia Li LRM 19 9 0 07 Dec 2023
Competition-Level Problems are Effective LLM Evaluators Yiming Huang Zheng-Wen Lin Xiao Liu Yeyun Gong Shuai Lu ... Yaobo Liang Yelong Shen Chen Lin Nan Duan Weizhu Chen ELM LRM 35 25 0 04 Dec 2023
Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension Akira Kawabata Saku Sugawara ELM 19 5 0 30 Nov 2023
TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models Zheng Chu Jingchang Chen Qianglong Chen Weijiang Yu Haotian Wang Ming Liu Bing Qin LRM ELM 35 9 0 29 Nov 2023
CLOMO: Counterfactual Logical Modification with Large Language Models Yinya Huang Ruixin Hong Hongming Zhang Wei Shao Zhicheng YANG Dong Yu Changshui Zhang Xiaodan Liang Linqi Song LRM 39 7 0 29 Nov 2023
GPQA: A Graduate-Level Google-Proof Q&A Benchmark David Rein Betty Li Hou Asa Cooper Stickland Jackson Petty Richard Yuanzhe Pang Julien Dirani Julian Michael Samuel R. Bowman AI4MH ELM 36 471 0 20 Nov 2023
Mirror: A Universal Framework for Various Information Extraction Tasks Tong Zhu Junfei Ren Zijian Yu Mengsong Wu Guoliang Zhang Xiaoye Qu Wenliang Chen Zhefeng Wang Baoxing Huai Min Zhang 38 14 0 09 Nov 2023
Assessing Distractors in Multiple-Choice Tests Vatsal Raina Adian Liusie Mark J. F. Gales 19 0 0 08 Nov 2023
Defining a New NLP Playground Sha Li Chi Han Pengfei Yu Carl Edwards Manling Li ... Yi R. Fung Charles Yu Joel R. Tetreault Eduard H. Hovy Heng Ji 41 5 0 31 Oct 2023
Eliminating Reasoning via Inferring with Planning: A New Framework to Guide LLMs' Non-linear Thinking Yongqi Tong Yifan Wang Dawei Li Sizhe Wang Zi Lin Simeng Han Jingbo Shang LRM 26 17 0 18 Oct 2023
GLoRE: Evaluating Logical Reasoning of Large Language Models Hanmeng Liu Zhiyang Teng Ruoxi Ning Jian Liu Qiji Zhou Yuexin Zhang Yue Zhang ReLM ELM LRM 70 8 0 13 Oct 2023
Empower Nested Boolean Logic via Self-Supervised Curriculum Learning Hongqiu Wu Linfeng Liu Haizhen Zhao Min Zhang LRM AI4CE NAI ELM 40 7 0 09 Oct 2023
Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models Man Luo Shrinidhi Kumbhar Ming shen Mihir Parmar Neeraj Varshney Pratyay Banerjee Somak Aditya Chitta Baral ReLM ELM LRM 45 25 0 02 Oct 2023
Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future Zheng Chu Jingchang Chen Qianglong Chen Weijiang Yu Tao He Haotian Wang Weihua Peng Ming-Yu Liu Bing Qin Ting Liu LRM AI4CE 37 153 0 27 Sep 2023
The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants Lucas Bandarkar Davis Liang Benjamin Muller Mikel Artetxe Satya Narayan Shukla Don Husa Naman Goyal Abhinandan Krishnan Luke Zettlemoyer Madian Khabsa 30 133 0 31 Aug 2023
Detecting Language Model Attacks with Perplexity Gabriel Alon Michael Kamfonas AAML 54 182 0 27 Aug 2023
Platypus: Quick, Cheap, and Powerful Refinement of LLMs Ariel N. Lee Cole J. Hunter Nataniel Ruiz ALM ObjD 34 136 0 14 Aug 2023
Teaching Smaller Language Models To Generalise To Unseen Compositional Questions Tim Hartill N. Tan Michael Witbrock Patricia J. Riddle ReLM KELM LRM 34 2 0 02 Aug 2023
Piecing Together Clues: A Benchmark for Evaluating the Detective Skills of Large Language Models Zhouhong Gu Lin Zhang Jiangjie Chen Haoning Ye Xiaoxuan Zhu ... Jianchen Wang Yikai Zhang Wenhao Huang Yanghua Xiao Hongwei Feng RALM ELM 36 0 0 11 Jul 2023
Chain of Thought Prompting Elicits Knowledge Augmentation Di Wu Jing Zhang Xinmei Huang LRM 28 31 0 04 Jul 2023
Analyzing Multiple-Choice Reading and Listening Comprehension Tests Vatsal Raina Adian Liusie Mark J. F. Gales ELM 43 2 0 03 Jul 2023
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning Zihang Xu Ziqing Yang Yiming Cui Shijin Wang LRM ReLM MLLM 38 5 0 27 Jun 2023
Analysis of the Cambridge Multiple-Choice Questions Reading Dataset with a Focus on Candidate Response Distribution Adian Liusie Vatsal Raina Andrew Mullooly Kate Knill Mark J. F. Gales 9 4 0 22 Jun 2023
Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension Pascal Hitzler ZhuoSheng Zhang Chenyu You AI4CE 24 4 0 21 Jun 2023
Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond Fangzhi Xu Qika Lin Jiawei Han Tianzhe Zhao Jun Liu Min Zhang ELM LRM 44 32 0 16 Jun 2023
Exploring the MIT Mathematics and EECS Curriculum Using Large Language Models Sarah J. Zhang Samuel H. Florin Ariel N. Lee Eamon Niknafs Andrei Marginean ... Madeleine Udell Yoon Kim Tonio Buonassisi Armando Solar-Lezama Iddo Drori ELM 37 18 0 15 Jun 2023
Certified Deductive Reasoning with Language Models Gabriel Poesia Kanishk Gandhi E. Zelikman Noah D. Goodman ELM ReLM LRM 37 0 0 06 Jun 2023
Large Language Models Are Not Strong Abstract Reasoners Gaël Gendron Qiming Bao Michael Witbrock Gillian Dobbie ELM LRM 31 32 0 31 May 2023
Harnessing the Power of Large Language Models for Natural Language to First-Order Logic Translation Yuan Yang Siheng Xiong Ali Payani Ehsan Shareghi Faramarz Fekri LRM 22 35 0 24 May 2023
On Degrees of Freedom in Defining and Testing Natural Language Understanding Saku Sugawara S. Tsugita ELM 34 1 0 24 May 2023
Few-shot Unified Question Answering: Tuning Models or Prompts? Srijan Bansal Semih Yavuz Bo Pang Meghana Moorthy Bhat Yingbo Zhou 36 2 0 23 May 2023
Out-of-Distribution Generalization in Text Classification: Past, Present, and Future Linyi Yang Yangqiu Song Xuan Ren Chenyang Lyu Yidong Wang Lingqiao Liu Jindong Wang Jennifer Foster Yue Zhang OOD 37 2 0 23 May 2023
Exploring Self-supervised Logic-enhanced Training for Large Language Models Fangkai Jiao Zhiyang Teng Bosheng Ding Zhengyuan Liu Nancy F. Chen Chenyu You ReLM LRM 32 4 0 23 May 2023
LogiCoT: Logical Chain-of-Thought Instruction-Tuning Hanmeng Liu Zhiyang Teng Leyang Cui Chaoli Zhang Qiji Zhou Yue Zhang LRM 27 24 0 20 May 2023
RCOT: Detecting and Rectifying Factual Inconsistency in Reasoning by Reversing Chain-of-Thought Tianci Xue Ziqi Wang Zhenhailong Wang Chi Han Pengfei Yu Heng Ji KELM LRM 35 32 0 19 May 2023
Document Understanding Dataset and Evaluation (DUDE) Jordy Van Landeghem Rubèn Pérez Tito Łukasz Borchmann Michal Pietruszka Pawel Józiak ... Bertrand Ackaert Ernest Valveny Matthew Blaschko Sien Moens Tomasz Stanislawek VGen 24 53 0 15 May 2023
Long-Tailed Question Answering in an Open World Yinpei Dai Hao Lang Yinhe Zheng Fei Huang Yongbin Li VLM 29 7 0 11 May 2023
In ChatGPT We Trust? Measuring and Characterizing the Reliability of ChatGPT Xinyue Shen Zhenpeng Chen Michael Backes Yang Zhang 27 55 0 18 Apr 2023