Measure and Improve Robustness in NLP Models: A Survey

15 December 2021

Diyi Yang

Papers citing "Measure and Improve Robustness in NLP Models: A Survey"

50 / 150 papers shown

Title
Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets Nelson F. Liu Roy Schwartz Noah A. Smith AAML 68 106 0 04 Apr 2019
PAWS: Paraphrase Adversaries from Word Scrambling Yuan Zhang Jason Baldridge Luheng He 71 543 0 01 Apr 2019
Learning Robust Representations by Projecting Superficial Statistics Out Haohan Wang Zexue He Zachary Chase Lipton Eric Xing OOD 70 235 0 02 Mar 2019
Improving Robustness of Machine Translation with Synthetic Noise Vaibhav Sumeet Singh Craig Alan Stewart Graham Neubig 51 83 0 25 Feb 2019
Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation Vladimir Karpukhin Omer Levy Jacob Eisenstein Marjan Ghazvininejad 47 117 0 05 Feb 2019
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference R. Thomas McCoy Ellie Pavlick Tal Linzen 131 1,239 0 04 Feb 2019
Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting Maria De-Arteaga Alexey Romanov Hanna M. Wallach J. Chayes C. Borgs Alexandra Chouldechova S. Geyik K. Kenthapadi Adam Tauman Kalai 183 458 0 27 Jan 2019
Theoretically Principled Trade-off between Robustness and Accuracy Hongyang R. Zhang Yaodong Yu Jiantao Jiao Eric Xing L. Ghaoui Michael I. Jordan 134 2,551 0 24 Jan 2019
Equalizing Gender Biases in Neural Machine Translation with Word Embeddings Techniques Joel Escudé Font Marta R. Costa-jussá 53 170 0 10 Jan 2019
TextBugger: Generating Adversarial Text Against Real-world Applications Jinfeng Li S. Ji Tianyu Du Bo Li Ting Wang SILM AAML 211 738 0 13 Dec 2018
A Survey of Unsupervised Deep Domain Adaptation Garrett Wilson D. Cook OOD 112 816 0 06 Dec 2018
Discrete Adversarial Attacks and Submodular Optimization with Applications to Text Classification Qi Lei Lingfei Wu Pin-Yu Chen A. Dimakis Inderjit S. Dhillon Michael Witbrock AAML 60 92 0 01 Dec 2018
ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness Robert Geirhos Patricia Rubisch Claudio Michaelis Matthias Bethge Felix Wichmann Wieland Brendel 100 2,670 0 29 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 94,891 0 11 Oct 2018
Assessing Gender Bias in Machine Translation -- A Case Study with Google Translate Marcelo O. R. Prates Pedro H. C. Avelar Luís C. Lamb 61 349 0 06 Sep 2018
Adversarially Regularising Neural NLI Models to Integrate Logical Background Knowledge Pasquale Minervini Sebastian Riedel AAML NAI GAN 59 119 0 26 Aug 2018
Neural Machine Translation of Text from Non-Native Speakers Antonios Anastasopoulos Alison Lui Toan Q. Nguyen David Chiang 54 32 0 19 Aug 2018
SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference Rowan Zellers Yonatan Bisk Roy Schwartz Yejin Choi 104 718 0 16 Aug 2018
Hallucinating Agnostic Images to Generalize Across Domains Fabio Maria Carlucci P. Russo Tatiana Tommasi Barbara Caputo OOD 87 14 0 03 Aug 2018
Stress Test Evaluation for Natural Language Inference Aakanksha Naik Abhilasha Ravichander Norman M. Sadeh Carolyn Rose Graham Neubig ELM 70 377 0 02 Jun 2018
Robustness May Be at Odds with Accuracy Dimitris Tsipras Shibani Santurkar Logan Engstrom Alexander Turner Aleksander Madry AAML 104 1,781 0 30 May 2018
Hypothesis Only Baselines in Natural Language Inference Adam Poliak Jason Naradowsky Aparajita Haldar Rachel Rudinger Benjamin Van Durme 231 579 0 02 May 2018
Gender Bias in Coreference Resolution Rachel Rudinger Jason Naradowsky Brian Leonard Benjamin Van Durme 65 642 0 25 Apr 2018
Generating Natural Language Adversarial Examples M. Alzantot Yash Sharma Ahmed Elgohary Bo-Jhang Ho Mani B. Srivastava Kai-Wei Chang AAML 412 930 0 21 Apr 2018
Pathologies of Neural Models Make Interpretations Difficult Shi Feng Eric Wallace Alvin Grissom II Mohit Iyyer Pedro Rodriguez Jordan L. Boyd-Graber AAML FAtt 79 321 0 20 Apr 2018
Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods Jieyu Zhao Tianlu Wang Mark Yatskar Vicente Ordonez Kai-Wei Chang 119 936 0 18 Apr 2018
Adversarial Example Generation with Syntactically Controlled Paraphrase Networks Mohit Iyyer John Wieting Kevin Gimpel Luke Zettlemoyer AAML GAN 329 719 0 17 Apr 2018
Removing Confounding Factors Associated Weights in Deep Neural Networks Improves the Prediction Accuracy for Healthcare Applications Haohan Wang Zhenglin Wu Eric Xing OOD 62 41 0 20 Mar 2018
Annotation Artifacts in Natural Language Inference Data Suchin Gururangan Swabha Swayamdipta Omer Levy Roy Schwartz Samuel R. Bowman Noah A. Smith 150 1,176 0 06 Mar 2018
Black-box Generation of Adversarial Text Sequences to Evade Deep Learning Classifiers Ji Gao Jack Lanchantin M. Soffa Yanjun Qi AAML 137 721 0 13 Jan 2018
From Lifestyle Vlogs to Everyday Interactions David Fouhey Weicheng Kuo Alexei A. Efros Jitendra Malik 60 125 0 06 Dec 2017
Synthetic and Natural Noise Both Break Neural Machine Translation Yonatan Belinkov Yonatan Bisk 111 742 0 06 Nov 2017
Generating Natural Adversarial Examples Zhengli Zhao Dheeru Dua Sameer Singh GAN AAML 169 601 0 31 Oct 2017
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 280 9,764 0 25 Oct 2017
Unified Deep Supervised Domain Adaptation and Generalization Saeid Motiian Marco Piccirilli Donald Adjeroh Gianfranco Doretto OOD 95 789 0 28 Sep 2017
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 114 3,765 0 15 Aug 2017
Adversarial Examples for Evaluating Reading Comprehension Systems Robin Jia Percy Liang AAML ELM 199 1,605 0 23 Jul 2017
On Calibration of Modern Neural Networks Chuan Guo Geoff Pleiss Yu Sun Kilian Q. Weinberger UQCV 299 5,833 0 14 Jun 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 840 5,821 0 05 Dec 2016
Statistics of Robust Optimization: A Generalized Empirical Likelihood Approach John C. Duchi Peter Glynn Hongseok Namkoong 104 322 0 11 Oct 2016
Select-Additive Learning: Improving Generalization in Multimodal Sentiment Analysis Haohan Wang Aaksha Meghawat Louis-Philippe Morency Eric Xing 76 154 0 16 Sep 2016
Demographic Dialectal Variation in Social Media: A Case Study of African-American English Su Lin Blodgett Lisa Green Brendan O'Connor 91 354 0 31 Aug 2016
Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation Muhammad Ghifary W. Kleijn Mengjie Zhang David Balduzzi Wen Li 88 865 0 12 Jul 2016
Adversarial Training Methods for Semi-Supervised Text Classification Takeru Miyato Andrew M. Dai Ian Goodfellow GAN 75 1,061 0 25 May 2016
Beyond Sharing Weights for Deep Domain Adaptation Artem Rozantsev Mathieu Salzmann Pascal Fua 59 443 0 21 Mar 2016
Variational Dropout and the Local Reparameterization Trick Diederik P. Kingma Tim Salimans Max Welling BDL 226 1,514 0 08 Jun 2015
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 821 9,318 0 06 Jun 2015
Domain-Adversarial Training of Neural Networks Yaroslav Ganin E. Ustinova Hana Ajakan Pascal Germain Hugo Larochelle François Laviolette M. Marchand Victor Lempitsky GAN OOD 378 9,497 0 28 May 2015
Intriguing properties of neural networks Christian Szegedy Wojciech Zaremba Ilya Sutskever Joan Bruna D. Erhan Ian Goodfellow Rob Fergus AAML 270 14,927 1 21 Dec 2013
Domain Generalization via Invariant Feature Representation Krikamol Muandet David Balduzzi Bernhard Schölkopf OOD 132 1,180 0 10 Jan 2013