v1v2 (latest)

QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension

27 July 2021

Papers citing "QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension"

50 / 223 papers shown

Title
Machine Reading, Fast and Slow: When Do Models "Understand" Language? Sagnik Ray Choudhury Anna Rogers Isabelle Augenstein LRM 59 18 0 15 Sep 2022
Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehension Ying Xu Dakuo Wang Mo Yu Daniel E. Ritchie Bingsheng Yao ... Xiaojuan Ma Diyi Yang Nanyun Peng Zhou Yu M. Warschauer AI4Ed 66 101 0 26 Mar 2022
ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning Ahmed Masry Do Xuan Long J. Tan Shafiq Joty Enamul Hoque AIMat 132 660 0 19 Mar 2022
CARETS: A Consistency And Robustness Evaluative Test Suite for VQA Carlos E. Jimenez Olga Russakovsky Karthik Narasimhan CoGe 62 14 0 15 Mar 2022
QuALITY: Question Answering with Long Input Texts, Yes! Richard Yuanzhe Pang Alicia Parrish Nitish Joshi Nikita Nangia Jason Phang ... Vishakh Padmakumar Johnny Ma Jana Thompson He He Sam Bowman RALM 71 154 0 16 Dec 2021
ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answers Haitian Sun William W. Cohen Ruslan Salakhutdinov 74 33 0 13 Oct 2021
Perhaps PTLMs Should Go to School -- A Task to Assess Open Book and Closed Book QA Manuel R. Ciosici Joe Cecil Alex Hedges Dong-Ho Lee Marjorie Freedman R. Weischedel 48 10 0 04 Oct 2021
TopiOCQA: Open-domain Conversational Question Answering with Topic Switching Vaibhav Adlakha Shehzaad Dhuliawala Kaheer Suleman H. D. Vries Siva Reddy BDL 81 91 0 02 Oct 2021
SituatedQA: Incorporating Extra-Linguistic Contexts into QA Michael J.Q. Zhang Eunsol Choi RALM 81 152 0 13 Sep 2021
xGQA: Cross-Lingual Visual Question Answering Jonas Pfeiffer Gregor Geigle Aishwarya Kamath Jan-Martin O. Steitz Stefan Roth Ivan Vulić Iryna Gurevych 72 62 0 13 Sep 2021
TruthfulQA: Measuring How Models Mimic Human Falsehoods Stephanie C. Lin Jacob Hilton Owain Evans HILM 140 1,904 0 08 Sep 2021
ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Historical News Collections Jiexin Wang Adam Jatowt Masatoshi Yoshikawa 101 35 0 08 Sep 2021
FinQA: A Dataset of Numerical Reasoning over Financial Data Zhiyu Chen Wenhu Chen Charese Smiley Sameena Shah Iana Borova ... Reema N Moussa Matthew I. Beane Ting-Hao 'Kenneth' Huang Bryan R. Routledge Wenjie Wang AIMat 118 346 0 01 Sep 2021
A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers Shen-Yun Miao Chao-Chun Liang Keh-Yih Su 66 341 0 30 Jun 2021
On the Interaction of Belief Bias and Explanations Ana Valeria González Anna Rogers Anders Søgaard FAtt 73 19 0 29 Jun 2021
AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industry Yannis Katsis Saneem A. Chemmengath Vishwajeet Kumar Samarth Bharadwaj Mustafa Canim ... A. Gliozzo FeiFei Pan Jaydeep Sen Karthik Sankaranarayanan Soumen Chakrabarti LMTD RALM 56 34 0 24 Jun 2021
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP Anthony Chen Pallavi Gudipati Shayne Longpre Xiao Ling Sameer Singh 48 40 0 12 Jun 2021
TIMEDIAL: Temporal Commonsense Reasoning in Dialog Lianhui Qin Aditya Gupta Shyam Upadhyay Luheng He Yejin Choi Manaal Faruqui LRM 86 70 0 08 Jun 2021
Disfl-QA: A Benchmark Dataset for Understanding Disfluencies in Question Answering Aditya Gupta Jiacheng Xu Shyam Upadhyay Diyi Yang Manaal Faruqui 72 33 0 08 Jun 2021
Changing the World by Changing the Data Anna Rogers 65 73 0 28 May 2021
TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Finance Fengbin Zhu Wenqiang Lei Youcheng Huang Chao Wang Shuo Zhang Jiancheng Lv Fuli Feng Tat-Seng Chua AIMat 111 303 0 17 May 2021
A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers Pradeep Dasigi Kyle Lo Iz Beltagy Arman Cohan Noah A. Smith Matt Gardner RALM 100 304 0 07 May 2021
BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models Nandan Thakur Nils Reimers Andreas Rucklé Abhishek Srivastava Iryna Gurevych VLM 425 1,041 0 17 Apr 2021
Competency Problems: On Finding and Removing Artifacts in Language Data Matt Gardner William Merrill Jesse Dodge Matthew E. Peters Alexis Ross Sameer Singh Noah A. Smith 201 111 0 17 Apr 2021
ESTER: A Machine Reading Comprehension Dataset for Event Semantic Relation Reasoning Rujun Han I-Hung Hsu Jiao Sun J. Baylón Qiang Ning Dan Roth Nanyun Peng 63 46 0 16 Apr 2021
MultiModalQA: Complex Question Answering over Text, Tables and Images Alon Talmor Ori Yoran Amnon Catav Dan Lahav Yizhong Wang Akari Asai Gabriel Ilharco Hannaneh Hajishirzi Jonathan Berant LMTD 78 159 0 13 Apr 2021
SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning Roshanak Mirzaee Hossein Rajaby Faghihi Qiang Ning Parisa Kordjmashidi 51 81 0 12 Apr 2021
Hurdles to Progress in Long-form Question Answering Kalpesh Krishna Aurko Roy Mohit Iyyer 60 198 0 10 Mar 2021
Decontextualization: Making Sentences Stand-Alone Eunsol Choi J. Palomaki Matthew Lamm Tom Kwiatkowski Dipanjan Das Michael Collins 43 98 0 09 Feb 2021
English Machine Reading Comprehension Datasets: A Survey Daria Dzendzik Carl Vogel Jennifer Foster RALM AIMat 67 49 0 25 Jan 2021
WebSRC: A Dataset for Web-Based Structural Reading Comprehension Xingyu Chen Zihan Zhao Lu Chen Danyang Zhang Jiabao Ji Ao Luo Yuxuan Xiong Kai Yu RALM 57 98 0 23 Jan 2021
Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering Fengbin Zhu Wenqiang Lei Chao Wang Jianming Zheng Soujanya Poria Tat-Seng Chua RALM 250 256 0 04 Jan 2021
Generating Natural Questions from Images for Multimodal Assistants Alkesh Patel Akanksha Bindal Hadas Kotek Christopher Klein Jason D. Williams VGen 81 7 0 17 Nov 2020
Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Bases Yu Gu Sue E. Kase M. Vanni Brian M. Sadler Percy Liang Xifeng Yan Yu-Chuan Su 44 214 0 16 Nov 2020
IIRC: A Dataset of Incomplete Information Reading Comprehension Questions James Ferguson Matt Gardner Hannaneh Hajishirzi Tushar Khot Pradeep Dasigi RALM 35 55 0 13 Nov 2020
When Do You Need Billions of Words of Pretraining Data? Yian Zhang Alex Warstadt Haau-Sing Li Samuel R. Bowman 58 141 0 10 Nov 2020
Challenges in Information-Seeking QA: Unanswerable Questions and Paragraph Retrieval Akari Asai Eunsol Choi RALM 96 53 0 22 Oct 2020
XOR QA: Cross-lingual Open-Retrieval Question Answering Akari Asai Jungo Kasai J. Clark Kenton Lee Eunsol Choi Hannaneh Hajishirzi 109 151 0 22 Oct 2020
Explaining and Improving Model Behavior with k Nearest Neighbor Representations Nazneen Rajani Ben Krause Wengpeng Yin Tong Niu R. Socher Caiming Xiong FAtt 51 33 0 18 Oct 2020
Towards Data Distillation for End-to-end Spoken Conversational Question Answering Chenyu You Nuo Chen Fenglin Liu Dongchao Yang Yuexian Zou 56 48 0 18 Oct 2020
Open-Domain Question Answering Goes Conversational via Question Rewriting R. Anantha Svitlana Vakulenko Zhucheng Tu Shayne Longpre S. Pulman Srinivas Chappidi LRM 61 171 0 10 Oct 2020
What Can We Do to Improve Peer Review in NLP? Anna Rogers Isabelle Augenstein 53 49 0 08 Oct 2020
MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics Anthony Chen Gabriel Stanovsky Sameer Singh Matt Gardner 66 50 0 07 Oct 2020
DaNetQA: a yes/no Question Answering Dataset for the Russian Language T. Glushkova Alexey Machnev Alena Fenogenova Tatiana Shavrina Ekaterina Artemova D. Ignatov 34 11 0 06 Oct 2020
A Vietnamese Dataset for Evaluating Machine Reading Comprehension Kiet Van Nguyen Duc-Vu Nguyen A. Nguyen Ngan Luu-Thuy Nguyen 73 57 0 30 Sep 2020
A Dataset and Baselines for Visual Question Answering on Art Noa Garcia Chentao Ye Zihua Liu Qingtao Hu Mayu Otani Chenhui Chu Yuta Nakashima Teruko Mitamura CoGe 40 55 0 28 Aug 2020
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering Shayne Longpre Yi Lu Joachim Daiber ELM HILM 86 158 0 30 Jul 2020
LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoning Jian Liu Leyang Cui Hanmeng Liu Dandan Huang Yile Wang Yue Zhang RALM 103 372 0 16 Jul 2020
KQA Pro: A Dataset with Explicit Compositional Programs for Complex Question Answering over Knowledge Base S. Cao Jiaxin Shi Liangming Pan L. Nie Yutong Xiang Lei Hou Juanzi Li Bin He Hanwang Zhang LMTD CoGe 69 101 0 08 Jul 2020
Project PIAF: Building a Native French Question-Answering Dataset Rachel Keraron Guillaume Lancrenon M. Bras Frédéric Allary Gilles Moyse Thomas Scialom Edmundo-Pavel Soriano-Morales Jacopo Staiano 30 21 0 02 Jul 2020