v1v2 (latest)

DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs

1 March 2019

Gabriel Stanovsky

Papers citing "DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs"

50 / 376 papers shown

Title
A Survey on Measuring and Mitigating Reasoning Shortcuts in Machine Reading Comprehension Xanh Ho Johannes Mario Meissner Saku Sugawara Akiko Aizawa OffRL 92 4 0 05 Sep 2022
FOLIO: Natural Language Reasoning with First-Order Logic Simeng Han Hailey Schoelkopf Yilun Zhao Zhenting Qi Martin Riddell ... Yingbo Zhou Caiming Xiong Rex Ying Arman Cohan Dragomir R. Radev ReLM LRM 148 109 0 02 Sep 2022
Heterogeneous Line Graph Transformer for Math Word Problems Zijian Hu Meng Jiang 64 2 0 11 Aug 2022
Efficient Training of Language Models to Fill in the Middle Mohammad Bavarian Heewoo Jun Nikolas Tezak John Schulman C. McLeavey Jerry Tworek Mark Chen 94 197 0 28 Jul 2022
Towards Complex Document Understanding By Discrete Reasoning Fengbin Zhu Wenqiang Lei Fuli Feng Chao Wang Haozhou Zhang Tat-Seng Chua 118 48 0 25 Jul 2022
BioTABQA: Instruction Learning for Biomedical Table Question Answering Man Luo S. Saxena Swaroop Mishra Mihir Parmar Chitta Baral LMTD 196 16 0 06 Jul 2022
Discourse-Aware Graph Networks for Textual Logical Reasoning Yinya Huang Lemao Liu Kun Xu Meng Fang Liang Lin Xi Liang NAI 57 5 0 04 Jul 2022
Modern Question Answering Datasets and Benchmarks: A Survey Zhen Wang 85 24 0 30 Jun 2022
longhorns at DADC 2022: How many linguists does it take to fool a Question Answering model? A systematic approach to adversarial attacks Venelin Kovatchev Trina Chatterjee Venkata S Govindarajan Jifan Chen Eunsol Choi ... K. Erk Matthew Lease Junyi Jessy Li Yating Wu Kyle Mahowald AAML ELM 89 9 0 29 Jun 2022
A Robustly Optimized Long Text to Math Models for Numerical Reasoning On FinQA Renhui Zhang Youwei Zhang Yao Yu AIMat 31 1 0 29 Jun 2022
Collecting high-quality adversarial data for machine reading comprehension tasks with humans and models in the loop Damian Y. Romero Diaz M. Aniol John M. Culnan 82 0 0 28 Jun 2022
QAGAN: Adversarial Approach To Learning Domain Invariant Language Features Shubham Shrivastava Kaiyue Wang OOD 75 2 0 24 Jun 2022
RDU: A Region-based Approach to Form-style Document Understanding Fengbin Zhu Chao Wang Wenqiang Lei Ziyang Liu Tat-Seng Chua 63 2 0 14 Jun 2022
Language Models are General-Purpose Interfaces Y. Hao Haoyu Song Li Dong Shaohan Huang Zewen Chi Wenhui Wang Shuming Ma Furu Wei MLLM 78 102 0 13 Jun 2022
Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization Hang Hua Xingjian Li Dejing Dou Chengzhong Xu Jiebo Luo 94 15 0 12 Jun 2022
MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Data Yilun Zhao Yunxiang Li Chenying Li Rui Zhang AIMat 72 107 0 03 Jun 2022
MMTM: Multi-Tasking Multi-Decoder Transformer for Math Word Problems Keyur Faldu Amit P. Sheth Prashant Kikani Darshan Patel AIMat 54 1 0 02 Jun 2022
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding Rishabh Bhardwaj Amrita Saha Guosheng Lin Soujanya Poria VLM VPVLM 53 7 0 23 May 2022
Least-to-Most Prompting Enables Complex Reasoning in Large Language Models Denny Zhou Nathanael Scharli Le Hou Jason W. Wei Nathan Scales ... Dale Schuurmans Claire Cui Olivier Bousquet Quoc Le Ed H. Chi RALM LRM AI4CE 109 1,139 0 21 May 2022
Modeling Multi-hop Question Answering as Single Sequence Prediction Semih Yavuz Kazuma Hashimoto Yingbo Zhou N. Keskar Caiming Xiong 73 29 0 18 May 2022
LogiGAN: Learning Logical Reasoning via Adversarial Pre-training Xinyu Pi Wanjun Zhong Yan Gao Nan Duan Jian-Guang Lou NAI GAN LRM AI4CE 87 16 0 18 May 2022
Addressing Resource and Privacy Constraints in Semantic Parsing Through Data Augmentation Kevin Yang Olivia Deng Charles C. Chen Richard Shin Subhro Roy Benjamin Van Durme 96 10 0 18 May 2022
ProQA: Structural Prompt-based Pre-training for Unified Question Answering Wanjun Zhong Yifan Gao Ning Ding Yujia Qin Zhiyuan Liu Ming Zhou Jiahai Wang Jian Yin Nan Duan 83 34 0 09 May 2022
QLEVR: A Diagnostic Dataset for Quantificational Language and Elementary Visual Reasoning Zechen Li Anders Søgaard 42 6 0 06 May 2022
Improving In-Context Few-Shot Learning via Self-Supervised Training Mingda Chen Jingfei Du Ramakanth Pasunuru Todor Mihaylov Srini Iyer Ves Stoyanov Zornitsa Kozareva SSL AI4MH 111 67 0 03 May 2022
Don't Blame the Annotator: Bias Already Starts in the Annotation Instructions Mihir Parmar Swaroop Mishra Mor Geva Chitta Baral 114 55 0 01 May 2022
OPERA:Operation-Pivoted Discrete Reasoning over Text Yongwei Zhou Junwei Bao Chaoqun Duan Haipeng Sun Jiahui Liang Yifan Wang Jing Zhao Youzheng Wu Xiaodong He Tiejun Zhao LRM 81 11 0 29 Apr 2022
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations Roy Schwartz Gabriel Stanovsky 102 26 0 27 Apr 2022
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks Ruixiang Cui Daniel Hershcovich Anders Søgaard 89 13 0 22 Apr 2022
What If: Generating Code to Answer Simulation Questions G. Peretz Kira Radinsky 77 3 0 16 Apr 2022
Towards Fine-grained Causal Reasoning and QA Linyi Yang Zhen Wang Yuxiang Wu Jie Yang Yue Zhang 88 16 0 15 Apr 2022
Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understanding Zeming Chen Qiyue Gao ELM 67 4 0 13 Apr 2022
NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks Swaroop Mishra Arindam Mitra Neeraj Varshney Bhavdeep Singh Sachdeva Peter Clark Chitta Baral Ashwin Kalyan AIMat ReLM ELM LRM 98 110 0 12 Apr 2022
PaLM: Scaling Language Modeling with Pathways Aakanksha Chowdhery Sharan Narang Jacob Devlin Maarten Bosma Gaurav Mishra ... Kathy Meier-Hellstern Douglas Eck J. Dean Slav Petrov Noah Fiedel PILM LRM 610 6,326 0 05 Apr 2022
Towards Differential Relational Privacy and its use in Question Answering Simone Bombari Alessandro Achille Zijian Wang Yu Wang Yusheng Xie Kunwar Yashraj Singh Srikar Appalaraju Vijay Mahadevan Stefano Soatto 63 1 0 30 Mar 2022
MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering Ankit Pal Logesh Kumar Umapathi Malaikannan Sankarasubbu ELM LM&MA 113 354 0 27 Mar 2022
AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension Xiao Li Gong Cheng Ziheng Chen Yawei Sun Yuzhong Qu NAI AI4CE 45 20 0 16 Mar 2022
Hyperdecoders: Instance-specific decoders for multi-task NLP Hamish Ivison Matthew E. Peters AI4CE 117 22 0 15 Mar 2022
Reasoning over Public and Private Data in Retrieval-Based Systems Simran Arora Patrick Lewis Angela Fan Jacob Kahn Christopher Ré 66 26 0 14 Mar 2022
What Makes Reading Comprehension Questions Difficult? Saku Sugawara Nikita Nangia Alex Warstadt Sam Bowman ELM RALM 62 14 0 12 Mar 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 1.2K 13,290 0 04 Mar 2022
UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Training Daniel Khashabi Yeganeh Kordi Hannaneh Hajishirzi 107 67 0 23 Feb 2022
Reasoning Like Program Executors Xinyu Pi Qian Liu Bei Chen Morteza Ziyadi Zeqi Lin Qiang Fu Yan Gao Jian-Guang Lou Weizhu Chen ReLM LRM 323 53 0 27 Jan 2022
CommonsenseQA 2.0: Exposing the Limits of AI through Gamification Alon Talmor Ori Yoran Ronan Le Bras Chandrasekhar Bhagavatula Yoav Goldberg Yejin Choi Jonathan Berant ELM 108 146 0 14 Jan 2022
NumHTML: Numeric-Oriented Hierarchical Transformer Model for Multi-task Financial Forecasting Linyi Yang Jiazheng Li Ruihai Dong Yue Zhang Barry Smyth AI4TS 44 39 0 05 Jan 2022
Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants Max Bartolo Tristan Thrush Sebastian Riedel Pontus Stenetorp Robin Jia Douwe Kiela 98 34 0 16 Dec 2021
Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context Daniel M. Spokoyny Ivan Lee Zhao Jin Taylor Berg-Kirkpatrick 72 8 0 16 Dec 2021
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts Nan Du Yanping Huang Andrew M. Dai Simon Tong Dmitry Lepikhin ... Kun Zhang Quoc V. Le Yonghui Wu Zhiwen Chen Claire Cui ALM MoE 300 835 0 13 Dec 2021
MetaQA: Combining Expert Agents for Multi-Skill Question Answering Haritz Puerto Gözde Gül Sahin Iryna Gurevych LLMAG 105 21 0 03 Dec 2021
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning V. Aribandi Yi Tay Tal Schuster J. Rao H. Zheng ... Jianmo Ni Jai Gupta Kai Hui Sebastian Ruder Donald Metzler MoE 127 216 0 22 Nov 2021