SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables

22 May 2023

Papers citing "SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables"

22 / 22 papers shown

Title
Can LLMs Generate Tabular Summaries of Science Papers? Rethinking the Evaluation Protocol Weiqi Wang Jiefu Ou Yangqiu Song Benjamin Van Durme Daniel Khashabi LMTD 87 2 0 14 Apr 2025
Claim Verification in the Age of Large Language Models: A Survey A. Dmonte Roland Oruche Marcos Zampieri Prasad Calyam Isabelle Augenstein 76 9 0 26 Aug 2024
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context Zirui Wu Yansong Feng LMTD ReLM LRM 94 11 0 04 Mar 2024
Scientific Fact-Checking: A Survey of Resources and Approaches Juraj Vladika Florian Matthes HILM 70 48 0 26 May 2023
Capabilities of GPT-4 on Medical Challenge Problems Harsha Nori Nicholas King S. McKinney Dean Carignan Eric Horvitz LM&MA ELM AI4MH 91 793 0 20 Mar 2023
Measuring and Narrowing the Compositionality Gap in Language Models Ofir Press Muru Zhang Sewon Min Ludwig Schmidt Noah A. Smith M. Lewis ReLM KELM LRM 121 595 0 07 Oct 2022
CoVERT: A Corpus of Fact-checked Biomedical COVID-19 Tweets I. Mohr Amelie Wuhrl Roman Klinger OffRL 39 26 0 26 Apr 2022
Generating Scientific Claims for Zero-Shot Scientific Fact Checking Dustin Wright David Wadden Kyle Lo Bailey Kuehl Arman Cohan Isabelle Augenstein Lucy Lu Wang MedIm 82 56 0 24 Mar 2022
WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation Alisa Liu Swabha Swayamdipta Noah A. Smith Yejin Choi 120 219 0 16 Jan 2022
A Survey on Automated Fact-Checking Zhijiang Guo Michael Schlichtkrull Andreas Vlachos 81 479 0 26 Aug 2021
TAPEX: Table Pre-training via Learning a Neural SQL Executor Qian Liu Bei Chen Jiaqi Guo Morteza Ziyadi Zeqi Lin Weizhu Chen Jian-Guang Lou LMTD 59 261 0 16 Jul 2021
X-FACT: A New Benchmark Dataset for Multilingual Fact Checking Ashim Gupta Vivek Srikumar HILM 57 99 0 17 Jun 2021
FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured information Rami Aly Zhijiang Guo Michael Schlichtkrull James Thorne Andreas Vlachos Christos Christodoulopoulos O. Cocarascu Arpit Mittal HILM 57 179 0 10 Jun 2021
COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic Arkadiy Saakyan Tuhin Chakrabarty Smaranda Muresan HILM 40 116 0 07 Jun 2021
SemEval-2021 Task 9: Fact Verification and Evidence Finding for Tabular Data in Scientific Documents (SEM-TAB-FACTS) N. Wang Diwakar Mahajan Marina Danilevsky Sara Rosenthal LMTD 38 53 0 28 May 2021
CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims Thomas Diggelmann Jordan L. Boyd-Graber Jannis Bulian Massimiliano Ciaramita Markus Leippold 79 200 0 01 Dec 2020
INFOTABS: Inference on Tables as Semi-structured Data Vivek Gupta Maitrey Mehta Pegah Nokhiz Vivek Srikumar LMTD 44 103 0 13 May 2020
TLDR: Extreme Summarization of Scientific Documents Isabel Cachola Kyle Lo Arman Cohan Daniel S. Weld 84 216 0 30 Apr 2020
Fact or Fiction: Verifying Scientific Claims David Wadden Shanchuan Lin Kyle Lo Lucy Lu Wang Madeleine van Zuylen Arman Cohan Hannaneh Hajishirzi HAI 94 440 0 30 Apr 2020
TabFact: A Large-scale Dataset for Table-based Fact Verification Wenhu Chen Hongmin Wang Jianshu Chen Yunkai Zhang Hong Wang Shiyang Li Xiyou Zhou William Yang Wang LMTD 81 488 0 05 Sep 2019
Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task Tao Yu Rui Zhang Kai-Chou Yang Michihiro Yasunaga Dongxu Wang ... Irene Li Qingning Yao Shanelle Roman Zilin Zhang Dragomir R. Radev RALM 76 1,203 0 24 Sep 2018
FEVER: a large-scale dataset for Fact Extraction and VERification James Thorne Andreas Vlachos Christos Christodoulopoulos Arpit Mittal HILM 118 1,633 0 14 Mar 2018