Adversarial Examples for Evaluating Reading Comprehension Systems

23 July 2017

Robin Jia

Papers citing "Adversarial Examples for Evaluating Reading Comprehension Systems"

50 / 890 papers shown

Title
Stress Test Evaluation of Biomedical Word Embeddings Vladimir Araujo Andrés Carvallo Carlos Aspillaga C. Thorne Denis Parra 17 8 0 24 Jul 2021
Bridging the Gap between Language Model and Reading Comprehension: Unsupervised MRC via Self-Supervision Ning Bian Xianpei Han Bo Chen Hongyu Lin Xianpei Han Le Sun SSL LRM 32 5 0 19 Jul 2021
Probabilistic Verification of Neural Networks Against Group Fairness Bing-Jie Sun Jun Sun Ting Dai Lijun Zhang AAML 21 22 0 18 Jul 2021
Self-Supervised Contrastive Learning with Adversarial Perturbations for Defending Word Substitution-based Attacks Zhao Meng Yihan Dong Mrinmaya Sachan Roger Wattenhofer AAML 66 10 0 15 Jul 2021
Automatic Task Requirements Writing Evaluation via Machine Reading Comprehension Shiting Xu Guowei Xu Peilei Jia Wenbiao Ding Zhongqin Wu Zitao Liu 21 1 0 15 Jul 2021
Uncertainty-Aware Reliable Text Classification Yibo Hu Latifur Khan EDL UQCV 38 33 0 15 Jul 2021
Controlled Caption Generation for Images Through Adversarial Attacks Nayyer Aafaq Naveed Akhtar Wei Liu M. Shah Ajmal Mian AAML 41 9 0 07 Jul 2021
Doing Good or Doing Right? Exploring the Weakness of Commonsense Causal Reasoning Models Mingyue Han Yinglin Wang LRM 21 10 0 05 Jul 2021
On the Interaction of Belief Bias and Explanations Ana Valeria González Anna Rogers Anders Søgaard FAtt 28 19 0 29 Jun 2021
Fairness via Representation Neutralization Mengnan Du Subhabrata Mukherjee Guanchu Wang Ruixiang Tang Ahmed Hassan Awadallah Xia Hu 25 78 0 23 Jun 2021
Does Robustness Improve Fairness? Approaching Fairness with Word Substitution Robustness Methods for Text Classification Yada Pruksachatkun Satyapriya Krishna Jwala Dhamala Rahul Gupta Kai-Wei Chang 22 32 0 21 Jun 2021
CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothing Fan Wu Linyi Li Zijian Huang Yevgeniy Vorobeychik Ding Zhao Bo-wen Li AAML OffRL 21 59 0 17 Jun 2021
Automatic Construction of Evaluation Suites for Natural Language Generation Datasets Simon Mille Kaustubh D. Dhole Saad Mahamood Laura Perez-Beltrachini Varun Gangal Mihir Kale Emiel van Miltenburg Sebastian Gehrmann ELM 47 22 0 16 Jun 2021
Improving Paraphrase Detection with the Adversarial Paraphrasing Task Animesh Nighojkar John Licato 25 39 0 14 Jun 2021
An Empirical Survey of Data Augmentation for Limited Data Learning in NLP Jiaao Chen Derek Tam Colin Raffel Joey Tianyi Zhou Diyi Yang 30 172 0 14 Jun 2021
Target Model Agnostic Adversarial Attacks with Query Budgets on Language Understanding Models Jatin Chauhan Karan Bhukar Manohar Kaul AAML 20 1 0 13 Jun 2021
Synthesizing Adversarial Negative Responses for Robust Response Ranking and Evaluation Prakhar Gupta Yulia Tsvetkov Jeffrey P. Bigham 42 22 0 10 Jun 2021
How Robust are Model Rankings: A Leaderboard Customization Approach for Equitable Evaluation Swaroop Mishra Anjana Arunkumar 34 24 0 10 Jun 2021
Adversarial Training for Machine Reading Comprehension with Virtual Embeddings Ziqing Yang Yiming Cui Chenglei Si Wanxiang Che Ting Liu Shijin Wang Guoping Hu 32 8 0 08 Jun 2021
Disfl-QA: A Benchmark Dataset for Understanding Disfluencies in Question Answering Aditya Gupta Jiacheng Xu Shyam Upadhyay Diyi Yang Manaal Faruqui 37 33 0 08 Jun 2021
Adversarially Regularized Graph Attention Networks for Inductive Learning on Partially Labeled Graphs Jiaren Xiao Quanyu Dai Xiaochen Xie J. Lam Ka-Wai Kwok GNN 29 6 0 07 Jun 2021
Knowing More About Questions Can Help: Improving Calibration in Question Answering Shujian Zhang Chengyue Gong Eunsol Choi UQLM 33 58 0 02 Jun 2021
Why Machine Reading Comprehension Models Learn Shortcuts? Yuxuan Lai Chen Zhang Yansong Feng Quzhe Huang Dongyan Zhao SyDa 30 53 0 02 Jun 2021
COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentences Shikhar Singh Nuan Wen Yu Hou Pegah Alipoormolabashi Te-Lin Wu Xuezhe Ma Nanyun Peng LRM 26 57 0 02 Jun 2021
Exploration and Exploitation: Two Ways to Improve Chinese Spelling Correction Models Chong Li Ce Zhang Xiaoqing Zheng Xuanjing Huang 11 28 0 31 May 2021
On the Interplay Between Fine-tuning and Composition in Transformers Lang-Chi Yu Allyson Ettinger 33 14 0 31 May 2021
Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learning Zhiyuan Zeng Keqing He Yuanmeng Yan Zijun Liu Yanan Wu Hong Xu Huixing Jiang Weiran Xu 19 64 0 29 May 2021
Changing the World by Changing the Data Anna Rogers 24 71 0 28 May 2021
Using Adversarial Attacks to Reveal the Statistical Bias in Machine Reading Comprehension Models Jieyu Lin Jiajie Zou Nai Ding AAML 18 42 0 24 May 2021
Adversarially robust change point detection Mengchu Li Yi Yu AAML 27 10 0 21 May 2021
Dynaboard: An Evaluation-As-A-Service Platform for Holistic Next-Generation Benchmarking Zhiyi Ma Kawin Ethayarajh Tristan Thrush Somya Jain Ledell Yu Wu Robin Jia Christopher Potts Adina Williams Douwe Kiela ELM 35 57 0 21 May 2021
Evaluating Gender Bias in Natural Language Inference Shanya Sharma Manan Dey Koustuv Sinha 28 41 0 12 May 2021
Reconstructive Sequence-Graph Network for Video Summarization Bin Zhao Haopeng Li Xiaoqiang Lu Xuelong Li 18 101 0 10 May 2021
Certified Robustness to Text Adversarial Attacks by Randomized [MASK] Jiehang Zeng Xiaoqing Zheng Jianhan Xu Linyang Li Liping Yuan Xuanjing Huang AAML 26 67 0 08 May 2021
Learning to Perturb Word Embeddings for Out-of-distribution QA Seanie Lee Minki Kang Juho Lee Sung Ju Hwang OOD 16 17 0 06 May 2021
Reliability Testing for Natural Language Processing Systems Samson Tan Shafiq Joty K. Baxter Araz Taeihagh G. Bennett Min-Yen Kan 22 38 0 06 May 2021
Explanation-Based Human Debugging of NLP Models: A Survey Piyawat Lertvittayakumjorn Francesca Toni LRM 42 79 0 30 Apr 2021
Sensitivity as a Complexity Measure for Sequence Classification Tasks Michael Hahn Dan Jurafsky Richard Futrell 150 22 0 21 Apr 2021
Robustness Tests of NLP Machine Learning Models: Search and Semantically Replace Rahul Singh Karan Jindal Yufei Yu Hanyu Yang Tarun Joshi Matthew A. Campbell Wayne B. Shoumaker 58 2 0 20 Apr 2021
Generative Context Pair Selection for Multi-hop Question Answering Dheeru Dua Cicero Nogueira dos Santos Patrick Ng Ben Athiwaratkun Bing Xiang Matt Gardner Sameer Singh LRM 25 2 0 18 Apr 2021
Learning with Instance Bundles for Reading Comprehension Dheeru Dua Pradeep Dasigi Sameer Singh Matt Gardner 37 11 0 18 Apr 2021
Can NLI Models Verify QA Systems' Predictions? Jifan Chen Eunsol Choi Greg Durrett 31 54 0 18 Apr 2021
A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation Tianyu Liu Yizhe Zhang Chris Brockett Yi Mao Zhifang Sui Weizhu Chen W. Dolan HILM 228 144 0 18 Apr 2021
Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation Max Bartolo Tristan Thrush Robin Jia Sebastian Riedel Pontus Stenetorp Douwe Kiela AAML 28 103 0 18 Apr 2021
Competency Problems: On Finding and Removing Artifacts in Language Data Matt Gardner William Merrill Jesse Dodge Matthew E. Peters Alexis Ross Sameer Singh Noah A. Smith 171 107 0 17 Apr 2021
AM2iCo: Evaluating Word Meaning in Context across Low-Resource Languages with Adversarial Examples Qianchu Liu Edoardo Ponti Diana McCarthy Ivan Vulić Anna Korhonen 30 17 0 17 Apr 2021
Are Multilingual BERT models robust? A Case Study on Adversarial Attacks for Multilingual Question Answering Sara Rosenthal Mihaela A. Bornea Avirup Sil AAML 36 10 0 15 Apr 2021
Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models Matteo Alleman J. Mamou Miguel Rio Hanlin Tang Yoon Kim SueYeon Chung NAI 38 17 0 15 Apr 2021
Consistency Training with Virtual Adversarial Discrete Perturbation Jungsoo Park Gyuwan Kim Jaewoo Kang 17 15 0 15 Apr 2021
Regularization for Long Named Entity Recognition Minbyul Jeong Jaewoo Kang 54 4 0 15 Apr 2021