Adversarial Examples for Evaluating Reading Comprehension Systems

23 July 2017

Robin Jia

Papers citing "Adversarial Examples for Evaluating Reading Comprehension Systems"

50 / 890 papers shown

Title
A Survey of Evaluation Metrics Used for NLG Systems Ananya B. Sai Akash Kumar Mohankumar Mitesh M. Khapra ELM 33 230 0 27 Aug 2020
Discrete Word Embedding for Logical Natural Language Understanding Masataro Asai Zilu Tang 7 3 0 26 Aug 2020
Model Robustness with Text Classification: Semantic-preserving adversarial attacks Rahul Singh Tarun Joshi V. Nair Agus Sudjianto VLM AAML 10 1 0 12 Aug 2020
The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models Ian Tenney James Wexler Jasmijn Bastings Tolga Bolukbasi Andy Coenen ... Ellen Jiang Mahima Pushkarna Carey Radebaugh Emily Reif Ann Yuan VLM 40 191 0 12 Aug 2020
Word meaning in minds and machines Brenden M. Lake G. Murphy NAI 15 117 0 04 Aug 2020
On the Generalizability of Neural Program Models with respect to Semantic-Preserving Program Transformations Md Rafiqul Islam Rabin Nghi D. Q. Bui Ke Wang Yijun Yu Lingxiao Jiang Mohammad Amin Alipour 30 90 0 31 Jul 2020
Neural Language Generation: Formulation, Methods, and Evaluation Cristina Garbacea Qiaozhu Mei 45 30 0 31 Jul 2020
A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challenges Bin Fu Yunqi Qiu Chengguang Tang Yang Li Haiyang Yu Jian Sun 161 95 0 26 Jul 2020
Coupling Distant Annotation and Adversarial Training for Cross-Domain Chinese Word Segmentation Ning Ding Dingkun Long Guangwei Xu Muhua Zhu Pengjun Xie Xiaobin Wang Haitao Zheng 9 18 0 16 Jul 2020
Adversarial Attacks against Neural Networks in Audio Domain: Exploiting Principal Components Ken Alparslan Yigit Can Alparslan Matthew Burlick AAML 24 8 0 14 Jul 2020
Our Evaluation Metric Needs an Update to Encourage Generalization Swaroop Mishra Anjana Arunkumar Chris Bryan Chitta Baral 38 16 0 14 Jul 2020
What's in a Name? Are BERT Named Entity Representations just as Good for any other Name? S. Balasubramanian Naman Jain G. Jindal Abhijeet Awasthi Sunita Sarawagi OOD 23 25 0 14 Jul 2020
Learning Reasoning Strategies in End-to-End Differentiable Proving Pasquale Minervini Sebastian Riedel Pontus Stenetorp Edward Grefenstette Tim Rocktaschel LRM 45 96 0 13 Jul 2020
ReCO: A Large Scale Chinese Reading Comprehension Dataset on Opinion Bingning Wang Ting Yao Qi Zhang Jingfang Xu Xiaochuan Wang RALM 20 21 0 22 Jun 2020
A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasets Chengchang Zeng Shaobo Li Qin Li Jie Hu Jianjun Hu 8 101 0 21 Jun 2020
Defense against Adversarial Attacks in NLP via Dirichlet Neighborhood Ensemble Yi Zhou Xiaoqing Zheng Cho-Jui Hsieh Kai-Wei Chang Xuanjing Huang SILM 39 48 0 20 Jun 2020
Adversarial Attacks for Multi-view Deep Models Xuli Sun Shiliang Sun AAML 4 0 0 19 Jun 2020
Selective Question Answering under Domain Shift Amita Kamath Robin Jia Percy Liang OOD 19 206 0 16 Jun 2020
GNNGuard: Defending Graph Neural Networks against Adversarial Attacks Xiang Zhang Marinka Zitnik AAML 27 291 0 15 Jun 2020
Relational reasoning and generalization using non-symbolic neural networks Atticus Geiger Alexandra Carstensen Michael C. Frank Michael C. Frank Christopher Potts NAI 25 20 0 14 Jun 2020
Detecting Audio Attacks on ASR Systems with Dropout Uncertainty T. Jayashankar Jonathan Le Roux P. Moulin AAML 11 17 0 02 Jun 2020
Beyond Leaderboards: A survey of methods for revealing weaknesses in Natural Language Inference data and models Viktor Schlegel Goran Nenadic R. Batista-Navarro ELM 33 18 0 29 May 2020
Adversarial Attacks and Defense on Texts: A Survey A. Huq Mst. Tasnim Pervin AAML 14 21 0 28 May 2020
Generating Semantically Valid Adversarial Questions for TableQA Yi Zhu Yiwei Zhou Menglin Xia AAML 18 5 0 26 May 2020
SINVAD: Search-based Image Space Navigation for DNN Image Classifier Test Input Generation Sungmin Kang R. Feldt S. Yoo AAML 26 32 0 19 May 2020
On the Value of Out-of-Distribution Testing: An Example of Goodhart's Law Damien Teney Kushal Kafle Robik Shrestha Ehsan Abbasnejad Christopher Kanan Anton Van Den Hengel OODD OOD 27 145 0 19 May 2020
Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond Zhuosheng Zhang Hai Zhao Rui Wang 18 62 0 13 May 2020
Towards Robustifying NLI Models Against Lexical Dataset Biases Xiang Zhou Joey Tianyi Zhou 25 57 0 10 May 2020
It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations Samson Tan Chenyu You Min-Yen Kan R. Socher 166 103 0 09 May 2020
Learning Robust Models for e-Commerce Product Search Thanh V. Nguyen Nikhil S. Rao Karthik Subbian CML NoLa OOD 24 20 0 07 May 2020
Robust Encodings: A Framework for Combating Adversarial Typos Erik Jones Robin Jia Aditi Raghunathan Percy Liang AAML 142 102 0 04 May 2020
How Can We Accelerate Progress Towards Human-like Linguistic Generalization? Tal Linzen 220 190 0 03 May 2020
DQI: Measuring Data Quality in NLP Swaroop Mishra Anjana Arunkumar Bhavdeep Singh Sachdeva Chris Bryan Chitta Baral 36 30 0 02 May 2020
Is Multihop QA in DiRe Condition? Measuring and Reducing Disconnected Reasoning H. Trivedi Niranjan Balasubramanian Tushar Khot Ashish Sabharwal AAML 6 1 0 02 May 2020
Evaluating Neural Machine Comprehension Model Robustness to Noisy Inputs and Adversarial Attacks Winston Wu Dustin L. Arendt Svitlana Volkova AAML 20 5 0 01 May 2020
Universal Adversarial Attacks with Natural Triggers for Text Classification Liwei Song Xinwei Yu Hsuan-Tung Peng Karthik R. Narasimhan SILM AAML 30 75 0 01 May 2020
Does Data Augmentation Improve Generalization in NLP? Rohan Jha Charles Lovering Ellie Pavlick 25 10 0 30 Apr 2020
Mind Your Inflections! Improving NLP for Non-Standard Englishes with Base-Inflection Encoding Samson Tan Chenyu You L. Varshney Min-Yen Kan 17 34 0 30 Apr 2020
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task Christoph Alt Aleksandra Gabryszak Leonhard Hennig 19 153 0 30 Apr 2020
Question Rewriting for Conversational Question Answering Svitlana Vakulenko Shayne Longpre Zhucheng Tu R. Anantha 20 175 0 30 Apr 2020
Robust Question Answering Through Sub-part Alignment Jifan Chen Greg Durrett OOD 19 13 0 30 Apr 2020
Neural Natural Language Inference Models Partially Embed Theories of Lexical Entailment and Negation Atticus Geiger Kyle Richardson Christopher Potts 21 4 0 30 Apr 2020
Look at the First Sentence: Position Bias in Question Answering Miyoung Ko Jinhyuk Lee Hyunjae Kim Gangwoo Kim Jaewoo Kang FaML OOD 27 100 0 30 Apr 2020
WT5?! Training Text-to-Text Models to Explain their Predictions Sharan Narang Colin Raffel Katherine Lee Adam Roberts Noah Fiedel Karishma Malkan 22 197 0 30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual Representations Julian Michael Jan A. Botha Ian Tenney 31 42 0 29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning? Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 20 176 0 29 Apr 2020
The Effect of Natural Distribution Shift on Question Answering Models John Miller K. Krauth Benjamin Recht Ludwig Schmidt OOD 23 143 0 29 Apr 2020
Adversarial Subword Regularization for Robust Neural Machine Translation Jungsoo Park Mujeen Sung Jinhyuk Lee Jaewoo Kang 22 8 0 29 Apr 2020
Enhancing Answer Boundary Detection for Multilingual Machine Reading Comprehension Fei Yuan Linjun Shou X. Bai Ming Gong Yaobo Liang Nan Duan Yan Fu Daxin Jiang 22 23 0 29 Apr 2020
Benchmarking Robustness of Machine Reading Comprehension Models Chenglei Si Ziqing Yang Yiming Cui Wentao Ma Ting Liu Shijin Wang ELM AAML 21 42 0 29 Apr 2020