v1v2 (latest)

DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs

1 March 2019

Gabriel Stanovsky

Papers citing "DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs"

50 / 376 papers shown

Title
Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Dataset Junling Liu Peilin Zhou Yining Hua Dading Chong Zhongyu Tian ... Helin Wang Chenyu You Zhenhua Guo Lei Zhu Michael Lingzhi Li LM&MA ELM 113 80 0 05 Jun 2023
FERMAT: An Alternative to Accuracy for Numerical Reasoning Jasivan Sivakumar N. Moosavi ReLM LRM 93 4 0 27 May 2023
Fine-Tuning Language Models with Just Forward Passes Sadhika Malladi Tianyu Gao Eshaan Nichani Alexandru Damian Jason D. Lee Danqi Chen Sanjeev Arora 167 205 0 27 May 2023
Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering Wang Zhu Jesse Thomason Robin Jia BDL LRM 77 8 0 24 May 2023
Large Language Models are In-Context Semantic Reasoners rather than Symbolic Reasoners Xiaojuan Tang Zilong Zheng Jiaqi Li Fanxu Meng Song-Chun Zhu Yitao Liang Muhan Zhang ReLM LRM 86 62 0 24 May 2023
UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoning Ahmed Masry P. Kavehzadeh Do Xuan Long Enamul Hoque Shafiq Joty LRM 95 113 0 24 May 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 92 6 0 14 May 2023
LINGO : Visually Debiasing Natural Language Instructions to Support Task Diversity Anjana Arunkumar Shubham Sharma Rakhi Agrawal Sriramakrishnan Chandrasekaran Chris Bryan 80 0 0 12 Apr 2023
STREET: A Multi-Task Structured Reasoning and Explanation Benchmark D. Ribeiro Shen Wang Xiaofei Ma He Zhu Rui Dong ... William Yang Wang Zhiheng Huang George Karypis Bing Xiang Dan Roth LRM ReLM 86 23 0 13 Feb 2023
Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering Xanh Ho A. Nguyen Saku Sugawara Akiko Aizawa LRM 97 7 0 12 Feb 2023
Weakly-Supervised Questions for Zero-Shot Relation Extraction Saeed Najafi Alona Fyshe 63 10 0 21 Jan 2023
SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images Ryota Tanaka Kyosuke Nishida Kosuke Nishida Taku Hasegawa Itsumi Saito Kuniko Saito 66 85 0 12 Jan 2023
ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization Weixin Liu Xuyi Chen Jiaxiang Liu Shi Feng Yu Sun Hao Tian Hua Wu 95 2 0 09 Jan 2023
Inflected Forms Are Redundant in Question Generation Models Xingwu Sun Hongyin Tang Chengzhong Xu 69 1 0 01 Jan 2023
A Survey on Table-and-Text HybridQA: Concepts, Methods, Challenges and Future Directions Dingzirui Wang Longxu Dou Wanxiang Che 98 5 0 27 Dec 2022
A Survey of Deep Learning for Mathematical Reasoning Pan Lu Liang Qiu Wenhao Yu Sean Welleck Kai-Wei Chang ReLM LRM 133 150 0 20 Dec 2022
When Do Decompositions Help for Machine Reading? Kangda Wei Dawn J Lawrie Benjamin Van Durme Yunmo Chen Orion Weller ReLM 152 3 0 20 Dec 2022
MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derendering Fangyu Liu Francesco Piccinno Syrine Krichene Chenxi Pang Kenton Lee Mandar Joshi Yasemin Altun Nigel Collier Julian Martin Eisenschlos VLM LRM 61 102 0 19 Dec 2022
Reasoning with Language Model Prompting: A Survey Shuofei Qiao Yixin Ou Ningyu Zhang Xiang Chen Yunzhi Yao Shumin Deng Chuanqi Tan Fei Huang Huajun Chen ReLM ELM LRM 234 327 0 19 Dec 2022
Enhancing Multi-modal and Multi-hop Question Answering via Structured Knowledge and Unified Retrieval-Generation Qian Yang Qian Chen Wen Wang Baotian Hu Min Zhang 103 27 0 16 Dec 2022
ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning O. Yu. Golovneva Moya Chen Spencer Poff Martin Corredor Luke Zettlemoyer Maryam Fazel-Zarandi Asli Celikyilmaz ReLM LRM 107 152 0 15 Dec 2022
Successive Prompting for Decomposing Complex Questions Dheeru Dua Shivanshu Gupta Sameer Singh Matt Gardner ReLM LRM 111 118 0 08 Dec 2022
Data-Efficient Finetuning Using Cross-Task Nearest Neighbors Hamish Ivison Noah A. Smith Hannaneh Hajishirzi Pradeep Dasigi 125 23 0 01 Dec 2022
Chaining Simultaneous Thoughts for Numerical Reasoning Zhihong Shao Fei Huang Minlie Huang AIMat AI4CE 71 18 0 29 Nov 2022
DyRRen: A Dynamic Retriever-Reranker-Generator Model for Numerical Reasoning over Tabular and Textual Data Xiao Li Sichen Liu Kaiwen Shi Jiangzhou Ju Yuzhong Qu Gong Cheng AIMat RALM LRM 70 16 0 23 Nov 2022
Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Tasks Wenhu Chen Xueguang Ma Xinyi Wang William W. Cohen ReLM ReCod LRM 368 829 0 22 Nov 2022
NAPG: Non-Autoregressive Program Generation for Hybrid Tabular-Textual Question Answering Tengxun Zhang Hongfei Xu Josef van Genabith Deyi Xiong Hongying Zan AIMat LRM 65 5 0 07 Nov 2022
Complex Reading Comprehension Through Question Decomposition Xiao-Yu Guo Yuan-Fang Li Gholamreza Haffari ReLM 76 10 0 07 Nov 2022
Overcoming Barriers to Skill Injection in Language Modeling: Case Study in Arithmetic Mandar Sharma Nikhil Muralidhar Naren Ramakrishnan 62 6 0 03 Nov 2022
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question Alireza Mohammadshahi Thomas Scialom Majid Yazdani Pouya Yanki Angela Fan James Henderson Marzieh Saeidi 94 20 0 02 Nov 2022
Analyzing Multi-Task Learning for Abstractive Text Summarization Frederic Kirstein Jan Philip Wahle Terry Ruas Bela Gipp 81 4 0 26 Oct 2022
Exploring The Landscape of Distributional Robustness for Question Answering Models Anas Awadalla Mitchell Wortsman Gabriel Ilharco Sewon Min Ian H. Magnusson Hannaneh Hajishirzi Ludwig Schmidt ELM OOD KELM 119 21 0 22 Oct 2022
Efficiently Tuned Parameters are Task Embeddings Wangchunshu Zhou Canwen Xu Julian McAuley 58 8 0 21 Oct 2022
Large Language Models Can Self-Improve Jiaxin Huang S. Gu Le Hou Yuexin Wu Xuezhi Wang Hongkun Yu Jiawei Han ReLM AI4MH LRM 228 618 0 20 Oct 2022
ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler Jiaxin Zhang Yashar Moshfeghi AIMat 68 18 0 18 Oct 2022
PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Finance Yang Deng Wenqiang Lei Wenxuan Zhang W. Lam Tat-Seng Chua 104 56 0 17 Oct 2022
ReasonChainQA: Text-based Complex Question Answering with Explainable Evidence Chains Minjun Zhu Yixuan Weng Shizhu He Kang Liu Jun Zhao LRM 66 6 0 17 Oct 2022
UniRPG: Unified Discrete Reasoning over Table and Text as Program Generation Yongwei Zhou Junwei Bao Chaoqun Duan Youzheng Wu Xiaodong He Tiejun Zhao ReLM RALM LMTD LRM 57 21 0 15 Oct 2022
"John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibility Himanshu Gupta Neeraj Varshney Swaroop Mishra Kuntal Kumar Pal Saurabh Arjun Sawant Kevin Scaria Siddharth Goyal Chitta Baral ELM 104 14 0 14 Oct 2022
How Well Do Multi-hop Reading Comprehension Models Understand Date Information? Xanh Ho Saku Sugawara Akiko Aizawa 81 2 0 11 Oct 2022
Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems Fan Zhou Haoyu Dong Qian Liu Zhoujun Cheng Shi Han Dongmei Zhang ReLM LRM 87 6 0 11 Oct 2022
Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering Zhengbao Jiang Jun Araki Haibo Ding Graham Neubig LRM 76 11 0 09 Oct 2022
ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answering Zhiyu Zoey Chen Shiyang Li Charese Smiley Zhiqiang Ma Sameena Shah William Yang Wang AIMat LRM AI4CE 150 116 0 07 Oct 2022
Teaching Neural Module Networks to Do Arithmetic Jiayi Chen Xiao-Yu Guo Yuan-Fang Li Gholamreza Haffari AIMat LRM 59 2 0 06 Oct 2022
U3E: Unsupervised and Erasure-based Evidence Extraction for Machine Reading Comprehension Suzhe He Shumin Shi Chenghao Wu 76 0 0 06 Oct 2022
Ask Me Anything: A simple strategy for prompting language models Simran Arora A. Narayan Mayee F. Chen Laurel J. Orr Neel Guha Kush S. Bhatia Ines Chami Frederic Sala Christopher Ré ReLM LRM 302 219 0 05 Oct 2022
Towards Faithful Model Explanation in NLP: A Survey Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 239 121 0 22 Sep 2022
Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoder Fangyu Lei Shizhu He Xiang Li Jun Zhao Kang Liu AIMat LMTD 88 23 0 16 Sep 2022
Domain Adaptation for Question Answering via Question Classification Zhenrui Yue Huimin Zeng Ziyi Kou Lanyu Shang Dong Wang OOD 90 11 0 12 Sep 2022
Activity report analysis with automatic single or multispan answer extraction R. Choudhary A. Sridhar Erik M. Visser 31 1 0 09 Sep 2022