Adversarial Examples for Evaluating Reading Comprehension Systems

23 July 2017

Robin Jia

Papers citing "Adversarial Examples for Evaluating Reading Comprehension Systems"

50 / 890 papers shown

Title
On the Robustness of Intent Classification and Slot Labeling in Goal-oriented Dialog Systems to Real-world Noise Sailik Sengupta Jason Krone Saab Mansour NoLa 19 12 0 14 Apr 2021
Double Perturbation: On the Robustness of Robustness and Counterfactual Bias Evaluation Chong Zhang Jieyu Zhao Huan Zhang Kai-Wei Chang Cho-Jui Hsieh AAML 27 10 0 12 Apr 2021
Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach Simiao Zuo Chen Liang Haoming Jiang Xiaodong Liu Pengcheng He Jianfeng Gao Weizhu Chen T. Zhao 58 9 0 11 Apr 2021
Connecting Attributions and QA Model Behavior on Realistic Counterfactuals Xi Ye Rohan Nair Greg Durrett 24 24 0 09 Apr 2021
Dynabench: Rethinking Benchmarking in NLP Douwe Kiela Max Bartolo Yixin Nie Divyansh Kaushik Atticus Geiger ... Pontus Stenetorp Robin Jia Joey Tianyi Zhou Christopher Potts Adina Williams 24 391 0 07 Apr 2021
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Corentin Dancette Rémi Cadène Damien Teney Matthieu Cord CML 30 76 0 07 Apr 2021
Exploring Targeted Universal Adversarial Perturbations to End-to-end ASR Models Zhiyun Lu Wei Han Yu Zhang Liangliang Cao AAML 60 17 0 06 Apr 2021
What Will it Take to Fix Benchmarking in Natural Language Understanding? Samuel R. Bowman George E. Dahl ELM ALM 30 157 0 05 Apr 2021
Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension Damai Dai Hua Zheng Zhifang Sui Baobao Chang KELM LRM 9 2 0 26 Mar 2021
Self-Supervised Test-Time Learning for Reading Comprehension Pratyay Banerjee Tejas Gokhale Chitta Baral SSL 17 28 0 20 Mar 2021
Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA Yonatan Bitton Gabriel Stanovsky Roy Schwartz Michael Elhadad CoGe 25 33 0 17 Mar 2021
Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models Mengnan Du Varun Manjunatha R. Jain Ruchi Deshpande Franck Dernoncourt Jiuxiang Gu Tong Sun Xia Hu 59 105 0 11 Mar 2021
Rissanen Data Analysis: Examining Dataset Characteristics via Description Length Ethan Perez Douwe Kiela Kyunghyun Cho 30 24 0 05 Mar 2021
Token-Modification Adversarial Attacks for Natural Language Processing: A Survey Tom Roth Yansong Gao A. Abuadbba Surya Nepal Wei Liu AAML 46 12 0 01 Mar 2021
NoiseQA: Challenge Set Evaluation for User-Centric Question Answering Abhilasha Ravichander Siddharth Dalmia Maria Ryskina Florian Metze Eduard H. Hovy A. Black ELM 29 32 0 16 Feb 2021
Text Compression-aided Transformer Encoding Z. Li ZhuoSheng Zhang Hai Zhao Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita AI4CE 27 45 0 11 Feb 2021
Model Agnostic Answer Reranking System for Adversarial Question Answering Sagnik Majumder Chinmoy Samant Greg Durrett OOD AAML 16 5 0 05 Feb 2021
PredCoin: Defense against Query-based Hard-label Attack Junfeng Guo Yaswanth Yadlapalli Lothar Thiele Ang Li Cong Liu AAML 23 0 0 04 Feb 2021
On Robustness of Neural Semantic Parsers Shuo Huang Zhuang Li Lizhen Qu Lei Pan AAML 23 16 0 02 Feb 2021
Do Question Answering Modeling Improvements Hold Across Benchmarks? Nelson F. Liu Tony Lee Robin Jia Percy Liang 28 13 0 01 Feb 2021
Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar Nora Kassner Shauli Ravfogel Abhilasha Ravichander Eduard H. Hovy Hinrich Schütze Yoav Goldberg HILM 272 347 0 01 Feb 2021
Unanswerable Questions about Images and Texts E. Davis 53 12 0 25 Jan 2021
Adv-OLM: Generating Textual Adversaries via OLM Vijit Malik A. Bhat Ashutosh Modi 35 6 0 21 Jan 2021
Towards Confident Machine Reading Comprehension Rishav Chakravarti Avirup Sil 30 4 0 20 Jan 2021
Mitigating the Position Bias of Transformer Models in Passage Re-Ranking Sebastian Hofstatter Aldo Lipani Sophia Althammer Markus Zlabinger Allan Hanbury 60 15 0 18 Jan 2021
Adversarial Machine Learning in Text Analysis and Generation I. Alsmadi AAML 24 5 0 14 Jan 2021
Understanding the Effect of Out-of-distribution Examples and Interactive Explanations on Human-AI Decision Making Han Liu Vivian Lai Chenhao Tan 33 117 0 13 Jan 2021
Robustness Gym: Unifying the NLP Evaluation Landscape Karan Goel Nazneen Rajani Jesse Vig Samson Tan Jason M. Wu Stephan Zheng Caiming Xiong Joey Tianyi Zhou Christopher Ré AAML OffRL OOD 154 137 0 13 Jan 2021
Adversarially Robust and Explainable Model Compression with On-Device Personalization for Text Classification Yao Qiang Supriya Tumkur Suresh Kumar Marco Brocanelli D. Zhu AAML 28 0 0 10 Jan 2021
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned Sewon Min Jordan L. Boyd-Graber Chris Alberti Danqi Chen Eunsol Choi ... Dmytro Okhonko M. Schlichtkrull Sonal Gupta Yashar Mehdad Wen-tau Yih 22 61 0 01 Jan 2021
Promoting Graph Awareness in Linearized Graph-to-Text Generation Alexander Miserlis Hoyle Ana Marasović Noah A. Smith AI4CE 29 31 0 31 Dec 2020
Coreference Reasoning in Machine Reading Comprehension Mingzhu Wu N. Moosavi Dan Roth Iryna Gurevych LRM 23 8 0 31 Dec 2020
DynaSent: A Dynamic Benchmark for Sentiment Analysis Christopher Potts Zhengxuan Wu Atticus Geiger Douwe Kiela 230 77 0 30 Dec 2020
Generating Adversarial Examples in Chinese Texts Using Sentence-Pieces Linyang Li Yunfan Shao Demin Song Xipeng Qiu Xuanjing Huang AAML GAN 8 7 0 29 Dec 2020
Explaining NLP Models via Minimal Contrastive Editing (MiCE) Alexis Ross Ana Marasović Matthew E. Peters 33 121 0 27 Dec 2020
Demystifying Deep Neural Networks Through Interpretation: A Survey Giang Dao Minwoo Lee FaML FAtt 22 1 0 13 Dec 2020
Bew: Towards Answering Business-Entity-Related Web Questions Qingqing Cao Oriana Riva A. Balasubramanian Niranjan Balasubramanian 21 0 0 10 Dec 2020
Generate Your Counterfactuals: Towards Controlled Counterfactual Generation for Text Nishtha Madaan Inkit Padhi Naveen Panwar Diptikalyan Saha CML 44 99 0 08 Dec 2020
In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustness Sang Michael Xie Ananya Kumar Robbie Jones Fereshte Khani Tengyu Ma Percy Liang OOD 174 62 0 08 Dec 2020
Semantics Altering Modifications for Evaluating Comprehension in Machine Reading Viktor Schlegel Goran Nenadic Riza Batista-Navarro 24 18 0 07 Dec 2020
Learning from others' mistakes: Avoiding dataset biases without modeling them Victor Sanh Thomas Wolf Yonatan Belinkov Alexander M. Rush 25 115 0 02 Dec 2020
Nudge Attacks on Point-Cloud DNNs Yiren Zhao Ilia Shumailov Robert D. Mullins Ross J. Anderson 3DPC AAML 6 8 0 22 Nov 2020
What do we expect from Multiple-choice QA Systems? Krunal Shah Nitish Gupta Dan Roth AAML 17 13 0 20 Nov 2020
On the Transferability of Adversarial Attacksagainst Neural Text Classifier Liping Yuan Xiaoqing Zheng Yi Zhou Cho-Jui Hsieh Kai-Wei Chang SILM AAML 11 26 0 17 Nov 2020
Golden Grain: Building a Secure and Decentralized Model Marketplace for MLaaS Jiasi Weng Jian Weng Chengjun Cai Hongwei Huang Cong Wang AI4TS 21 21 0 12 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey Congbo Ma W. Zhang Mingyu Guo Hu Wang Quan Z. Sheng 13 126 0 10 Nov 2020
Adversarial Semantic Collisions Congzheng Song Alexander M. Rush Vitaly Shmatikov AAML 16 52 0 09 Nov 2020
VisBERT: Hidden-State Visualizations for Transformers Betty van Aken B. Winter Alexander Loser Felix Alexander Gers 8 26 0 09 Nov 2020
Adversarial Black-Box Attacks On Text Classifiers Using Multi-Objective Genetic Optimization Guided By Deep Networks Alex Mathai Shreya Khare Srikanth G. Tamilselvam Senthil Mani AAML 36 6 0 08 Nov 2020
Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles Christopher Clark Mark Yatskar Luke Zettlemoyer 26 61 0 07 Nov 2020