Adversarial Examples for Evaluating Reading Comprehension Systems

23 July 2017

Robin Jia

Papers citing "Adversarial Examples for Evaluating Reading Comprehension Systems"

50 / 890 papers shown

Title
The Curse of Performance Instability in Analysis Datasets: Consequences, Source, and Suggestions Xiang Zhou Yixin Nie Hao Tan Joey Tianyi Zhou 20 40 0 28 Apr 2020
DeSePtion: Dual Sequence Prediction and Adversarial Examples for Improved Fact-Checking Christopher Hidey Tuhin Chakrabarty Tariq Alhindi Siddharth Varia K. Krstovski Mona T. Diab Smaranda Muresan AAML 20 43 0 27 Apr 2020
Reevaluating Adversarial Examples in Natural Language John X. Morris Eli Lifland Jack Lanchantin Yangfeng Ji Yanjun Qi SILM AAML 20 111 0 25 Apr 2020
Syntactic Data Augmentation Increases Robustness to Inference Heuristics Junghyun Min R. Thomas McCoy Dipanjan Das Emily Pitler Tal Linzen 30 175 0 24 Apr 2020
Generative Data Augmentation for Commonsense Reasoning Yiben Yang Chaitanya Malaviya Jared Fernandez Swabha Swayamdipta Ronan Le Bras Ji-ping Wang Chandra Bhagavatula Yejin Choi Doug Downey LRM 27 91 0 24 Apr 2020
On Adversarial Examples for Biomedical NLP Tasks Vladimir Araujo Andrés Carvallo Carlos Aspillaga Denis Parra MedIm AAML OOD 11 13 0 23 Apr 2020
DuReader_robust: A Chinese Dataset Towards Evaluating Robustness and Generalization of Machine Reading Comprehension in Real-World Applications Hongxuan Tang Hongyu Li Jing Liu Yu Hong Hua Wu Haifeng Wang 13 18 0 23 Apr 2020
Answer Generation through Unified Memories over Multiple Passages M. Nakatsuji Sohei Okui RALM 8 3 0 22 Apr 2020
Testing Machine Translation via Referential Transparency Pinjia He Clara Meister Z. Su 13 49 0 22 Apr 2020
Learning What Makes a Difference from Counterfactual Examples and Gradient Supervision Damien Teney Ehsan Abbasnejad Anton Van Den Hengel OOD SSL CML 34 118 0 20 Apr 2020
Adversarial Training for Large Neural Language Models Xiaodong Liu Hao Cheng Pengcheng He Weizhu Chen Yu-Chiang Frank Wang Hoifung Poon Jianfeng Gao AAML 34 183 0 20 Apr 2020
Avoiding the Hypothesis-Only Bias in Natural Language Inference via Ensemble Adversarial Training Joe Stacey Pasquale Minervini Haim Dubossarsky Sebastian Riedel Tim Rocktaschel AI4CE 20 8 0 16 Apr 2020
Shortcut Learning in Deep Neural Networks Robert Geirhos J. Jacobsen Claudio Michaelis R. Zemel Wieland Brendel Matthias Bethge Felix Wichmann 55 1,991 0 16 Apr 2020
Evaluation of Generalizability of Neural Program Analyzers under Semantic-Preserving Transformations Md Rafiqul Islam Rabin Mohammad Amin Alipour NAI 37 20 0 15 Apr 2020
Pretrained Transformers Improve Out-of-Distribution Robustness Dan Hendrycks Xiaoyuan Liu Eric Wallace Adam Dziedzic R. Krishnan D. Song OOD 21 429 0 13 Apr 2020
Adversarial Augmentation Policy Search for Domain and Cross-Lingual Generalization in Reading Comprehension A. Maharana Joey Tianyi Zhou AAML 17 13 0 13 Apr 2020
Frequency-Guided Word Substitutions for Detecting Textual Adversarial Examples Maximilian Mozes Pontus Stenetorp Bennett Kleinberg Lewis D. Griffin AAML 30 99 0 13 Apr 2020
Overestimation of Syntactic Representationin Neural Language Models Jordan Kodner Nitish Gupta 26 12 0 10 Apr 2020
More Bang for Your Buck: Natural Perturbation for Robust Question Answering Daniel Khashabi Tushar Khot Ashish Sabharwal AAML OOD 33 4 0 09 Apr 2020
Translation Artifacts in Cross-lingual Transfer Learning Mikel Artetxe Gorka Labaka Eneko Agirre 27 115 0 09 Apr 2020
BLEURT: Learning Robust Metrics for Text Generation Thibault Sellam Dipanjan Das Ankur P. Parikh 46 1,446 0 09 Apr 2020
Towards Evaluating the Robustness of Chinese BERT Classifiers Wei Ping Boyuan Pan Xin Li Bo-wen Li AAML 28 8 0 07 Apr 2020
What do Models Learn from Question Answering Datasets? Priyanka Sen Amir Saffari RALM ELM 10 74 0 07 Apr 2020
Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation Kazutoshi Shinoda Saku Sugawara Akiko Aizawa OOD 36 12 0 07 Apr 2020
Evaluating Models' Local Decision Boundaries via Contrast Sets Matt Gardner Yoav Artzi Victoria Basmova Jonathan Berant Ben Bogin ... Sanjay Subramanian Reut Tsarfaty Eric Wallace Ally Zhang Ben Zhou ELM 43 84 0 06 Apr 2020
Benchmarking Machine Reading Comprehension: A Psychological Perspective Saku Sugawara Pontus Stenetorp Akiko Aizawa 16 2 0 04 Apr 2020
R3: A Reading Comprehension Benchmark Requiring Reasoning Processes Ran Wang Kun Tao Dingjie Song Zhilong Zhang Xiao Ma Xiáo Su Xinyu Dai 37 3 0 02 Apr 2020
Investigating Image Applications Based on Spatial-Frequency Transform and Deep Learning Techniques Qinkai Zheng Han Qiu G. Memmi Isabelle Bloch 18 0 0 20 Mar 2020
Topological Effects on Attacks Against Vertex Classification B. A. Miller Mustafa Çamurcu Alexander J. Gomez Kevin S. Chan Tina Eliassi-Rad AAML 19 2 0 12 Mar 2020
ConAML: Constrained Adversarial Machine Learning for Cyber-Physical Systems Jiangnan Li Yingyuan Yang Jinyuan Stella Sun K. Tomsovic Jin Young Lee AAML 28 52 0 12 Mar 2020
A Framework for Evaluation of Machine Reading Comprehension Gold Standards Viktor Schlegel Marco Valentino André Freitas Goran Nenadic R. Batista-Navarro 17 31 0 10 Mar 2020
Practical Annotation Strategies for Question Answering Datasets Bernhard Kratzwald Xiang Yue Huan Sun Stefan Feuerriegel 18 0 0 06 Mar 2020
Robust Unsupervised Neural Machine Translation with Adversarial Denoising Training Haipeng Sun Rui Wang Kehai Chen Xugang Lu Masao Utiyama Eiichiro Sumita T. Zhao 4 4 0 28 Feb 2020
Unshuffling Data for Improved Generalization Damien Teney Ehsan Abbasnejad Anton Van Den Hengel OOD 31 76 0 27 Feb 2020
Understanding and Mitigating the Tradeoff Between Robustness and Accuracy Aditi Raghunathan Sang Michael Xie Fanny Yang John C. Duchi Percy Liang AAML 48 223 0 25 Feb 2020
Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions? Yixuan Tang Hwee Tou Ng A. Tung 8 31 0 23 Feb 2020
Robustness Verification for Transformers Zhouxing Shi Huan Zhang Kai-Wei Chang Minlie Huang Cho-Jui Hsieh AAML 24 105 0 16 Feb 2020
Exploring Neural Models for Parsing Natural Language into First-Order Logic Hrituraj Singh Milan Aggarwal Balaji Krishnamurthy LRM 29 19 0 16 Feb 2020
Undersensitivity in Neural Reading Comprehension Johannes Welbl Pasquale Minervini Max Bartolo Pontus Stenetorp Sebastian Riedel AAML 13 18 0 15 Feb 2020
Stress Test Evaluation of Transformer-based Models in Natural Language Understanding Tasks Carlos Aspillaga Andrés Carvallo Vladimir Araujo ELM 44 31 0 14 Feb 2020
The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence G. Marcus VLM 32 355 0 14 Feb 2020
Adversarial Filters of Dataset Biases Ronan Le Bras Swabha Swayamdipta Chandra Bhagavatula Rowan Zellers Matthew E. Peters Ashish Sabharwal Yejin Choi 36 220 0 10 Feb 2020
Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension Max Bartolo A. Roberts Johannes Welbl Sebastian Riedel Pontus Stenetorp AAML 28 167 0 02 Feb 2020
Benchmarking Popular Classification Models' Robustness to Random and Targeted Corruptions Utkarsh Desai Srikanth G. Tamilselvam Jassimran Kaur Senthil Mani Shreya Khare 6 1 0 31 Jan 2020
Tiny noise, big mistakes: Adversarial perturbations induce errors in Brain-Computer Interface spellers Xiao Zhang Dongrui Wu L. Ding Hanbin Luo Chin-Teng Lin T. Jung Ricardo Chavarriaga AAML 20 59 0 30 Jan 2020
A Study of the Tasks and Models in Machine Reading Comprehension Chao Wang LRM 21 1 0 23 Jan 2020
Humpty Dumpty: Controlling Word Meanings via Corpus Poisoning R. Schuster Tal Schuster Yoav Meri Vitaly Shmatikov AAML 6 38 0 14 Jan 2020
Rethinking Generalization of Neural Models: A Named Entity Recognition Case Study Jinlan Fu Pengfei Liu Qi Zhang Xuanjing Huang AI4CE 33 73 0 12 Jan 2020
A Survey on Machine Reading Comprehension Systems Razieh Baradaran Razieh Ghiasi Hossein Amirkhani FaML 13 85 0 06 Jan 2020
What Does My QA Model Know? Devising Controlled Probes using Expert Knowledge Kyle Richardson Ashish Sabharwal 27 45 0 31 Dec 2019