Measure and Improve Robustness in NLP Models: A Survey

15 December 2021

Diyi Yang

Papers citing "Measure and Improve Robustness in NLP Models: A Survey"

50 / 150 papers shown

Title
Fairness without Demographics through Adversarially Reweighted Learning Preethi Lahoti Alex Beutel Jilin Chen Kang Lee Flavien Prost Nithum Thain Xuezhi Wang Ed H. Chi FaML 114 337 0 23 Jun 2020
It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations Samson Tan Shafiq Joty Min-Yen Kan R. Socher 213 105 0 09 May 2020
An Investigation of Why Overparameterization Exacerbates Spurious Correlations Shiori Sagawa Aditi Raghunathan Pang Wei Koh Percy Liang 188 381 0 09 May 2020
Beyond Accuracy: Behavioral Testing of NLP models with CheckList Marco Tulio Ribeiro Tongshuang Wu Carlos Guestrin Sameer Singh ELM 208 1,104 0 08 May 2020
Towards Faithful Neural Table-to-Text Generation with Content-Matching Constraints Zhenyi Wang Xiaoyang Wang Bang An Dong Yu Changyou Chen LMTD 213 84 0 03 May 2020
How Can We Accelerate Progress Towards Human-like Linguistic Generalization? Tal Linzen 272 194 0 03 May 2020
On Faithfulness and Factuality in Abstractive Summarization Joshua Maynez Shashi Narayan Bernd Bohnet Ryan T. McDonald HILM 79 1,035 0 02 May 2020
Evaluating Robustness to Input Perturbations for Neural Machine Translation Xing Niu Prashant Mathur Georgiana Dinu Yaser Al-Onaizan AAML 52 64 0 01 May 2020
Mind the Trade-off: Debiasing NLU Models without Degrading the In-distribution Performance Prasetya Ajie Utama N. Moosavi Iryna Gurevych OODD 119 127 0 01 May 2020
Universal Adversarial Attacks with Natural Triggers for Text Classification Liwei Song Xinwei Yu Hsuan-Tung Peng Karthik Narasimhan SILM AAML 70 76 0 01 May 2020
Mind Your Inflections! Improving NLP for Non-Standard Englishes with Base-Inflection Encoding Samson Tan Shafiq Joty Lav Varshney Min-Yen Kan 72 35 0 30 Apr 2020
The Effect of Natural Distribution Shift on Question Answering Models John Miller K. Krauth Benjamin Recht Ludwig Schmidt OOD 91 145 0 29 Apr 2020
ToTTo: A Controlled Table-To-Text Generation Dataset Ankur P. Parikh Xuezhi Wang Sebastian Gehrmann Manaal Faruqui Bhuwan Dhingra Diyi Yang Dipanjan Das LMTD 95 367 0 29 Apr 2020
MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification Jiaao Chen Zichao Yang Diyi Yang VLM 90 363 0 25 Apr 2020
Reevaluating Adversarial Examples in Natural Language John X. Morris Eli Lifland Jack Lanchantin Yangfeng Ji Yanjun Qi SILM AAML 173 114 0 25 Apr 2020
Adversarial Training for Large Neural Language Models Xiaodong Liu Hao Cheng Pengcheng He Weizhu Chen Yu Wang Hoifung Poon Jianfeng Gao AAML 76 185 0 20 Apr 2020
Shortcut Learning in Deep Neural Networks Robert Geirhos J. Jacobsen Claudio Michaelis R. Zemel Wieland Brendel Matthias Bethge Felix Wichmann 206 2,052 0 16 Apr 2020
Weight Poisoning Attacks on Pre-trained Models Keita Kurita Paul Michel Graham Neubig AAML SILM 134 451 0 14 Apr 2020
Pretrained Transformers Improve Out-of-Distribution Robustness Dan Hendrycks Xiaoyuan Liu Eric Wallace Adam Dziedzic R. Krishnan D. Song OOD 188 434 0 13 Apr 2020
An Empirical Study of Invariant Risk Minimization Yo Joong Choe Jiyeon Ham Kyubyong Park OOD 52 50 0 10 Apr 2020
BLEURT: Learning Robust Metrics for Text Generation Thibault Sellam Dipanjan Das Ankur P. Parikh 99 1,498 0 09 Apr 2020
BAE: BERT-based Adversarial Examples for Text Classification Siddhant Garg Goutham Ramakrishnan AAML SILM 196 556 0 04 Apr 2020
Adversarial Filters of Dataset Biases Ronan Le Bras Swabha Swayamdipta Chandra Bhagavatula Rowan Zellers Matthew E. Peters Ashish Sabharwal Yejin Choi 100 222 0 10 Feb 2020
Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension Max Bartolo A. Roberts Johannes Welbl Sebastian Riedel Pontus Stenetorp AAML 107 175 0 02 Feb 2020
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty Dan Hendrycks Norman Mu E. D. Cubuk Barret Zoph Justin Gilmer Balaji Lakshminarayanan OOD UQCV 103 1,300 0 05 Dec 2019
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao T. Zhao 91 561 0 08 Nov 2019
Adversarial NLI: A New Benchmark for Natural Language Understanding Yixin Nie Adina Williams Emily Dinan Joey Tianyi Zhou Jason Weston Douwe Kiela 125 1,006 0 31 Oct 2019
Robust Semantic Parsing with Adversarial Learning for Domain Generalization Gabriel Marzinotto Géraldine Damnati Frédéric Béchet Benoit Favre 38 13 0 01 Oct 2019
Learning the Difference that Makes a Difference with Counterfactually-Augmented Data Divyansh Kaushik Eduard H. Hovy Zachary Chase Lipton CML 88 569 0 26 Sep 2019
AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models Eric Wallace Jens Tuyls Junlin Wang Sanjay Subramanian Matt Gardner Sameer Singh MILM 63 138 0 19 Sep 2019
End-to-End Bias Mitigation by Modelling Biases in Corpora Rabeeh Karimi Mahabadi Yonatan Belinkov James Henderson 120 180 0 13 Sep 2019
Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases Christopher Clark Mark Yatskar Luke Zettlemoyer OOD 71 465 0 09 Sep 2019
Distributionally Robust Language Modeling Yonatan Oren Shiori Sagawa Tatsunori B. Hashimoto Percy Liang OOD 70 172 0 04 Sep 2019
Certified Robustness to Adversarial Word Substitutions Robin Jia Aditi Raghunathan Kerem Göksel Percy Liang AAML 335 294 0 03 Sep 2019
PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identification Yinfei Yang Y. Zhang Chris Tar Jason Baldridge AAML 75 368 0 30 Aug 2019
Earlier Isn't Always Better: Sub-aspect Analysis on Corpus and System Biases in Summarization Taehee Jung Dongyeop Kang L. Mentch Eduard H. Hovy 54 51 0 30 Aug 2019
Unlearn Dataset Bias in Natural Language Inference by Fitting the Residual He He Sheng Zha Haohan Wang 62 199 0 28 Aug 2019
Adversarial Domain Adaptation for Machine Reading Comprehension Huazheng Wang Zhe Gan Xiaodong Liu Jingjing Liu Jianfeng Gao Hongning Wang 48 65 0 24 Aug 2019
Neural Text Summarization: A Critical Evaluation Wojciech Kry'sciñski N. Keskar Bryan McCann Caiming Xiong R. Socher 78 366 0 23 Aug 2019
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 320 326 0 21 Aug 2019
Universal Adversarial Triggers for Attacking and Analyzing NLP Eric Wallace Shi Feng Nikhil Kandpal Matt Gardner Sameer Singh AAML SILM 114 866 0 20 Aug 2019
Natural Adversarial Examples Dan Hendrycks Kevin Zhao Steven Basart Jacob Steinhardt D. Song OODD 203 1,472 0 16 Jul 2019
Invariant Risk Minimization Martín Arjovsky Léon Bottou Ishaan Gulrajani David Lopez-Paz OOD 186 2,229 0 05 Jul 2019
Mitigating Gender Bias in Natural Language Processing: Literature Review Tony Sun Andrew Gaut Shirlyn Tang Yuxin Huang Mai Elsherief Jieyu Zhao Diba Mirza E. Belding-Royer Kai-Wei Chang William Yang Wang AI4CE 108 559 0 21 Jun 2019
Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift Yaniv Ovadia Emily Fertig Jie Jessie Ren Zachary Nado D. Sculley Sebastian Nowozin Joshua V. Dillon Balaji Lakshminarayanan Jasper Snoek UQCV 167 1,695 0 06 Jun 2019
Learning Robust Global Representations by Penalizing Local Predictive Power Haohan Wang Songwei Ge Eric Xing Zachary Chase Lipton OOD 122 962 0 29 May 2019
High Frequency Component Helps Explain the Generalization of Convolutional Neural Networks Haohan Wang Xindi Wu Pengcheng Yin Eric Xing 61 523 0 28 May 2019
Combating Adversarial Misspellings with Robust Word Recognition Danish Pruthi Bhuwan Dhingra Zachary Chase Lipton 172 305 0 27 May 2019
Adversarial Examples Are Not Bugs, They Are Features Andrew Ilyas Shibani Santurkar Dimitris Tsipras Logan Engstrom Brandon Tran Aleksander Madry SILM 89 1,838 0 06 May 2019
BERTScore: Evaluating Text Generation with BERT Tianyi Zhang Varsha Kishore Felix Wu Kilian Q. Weinberger Yoav Artzi 324 5,814 0 21 Apr 2019