Interpretation of Black Box NLP Models: A Survey

31 March 2022

Papers citing "Interpretation of Black Box NLP Models: A Survey"

50 / 84 papers shown

Title
Post-hoc Interpretability for Neural NLP: A Survey Andreas Madsen Siva Reddy A. Chandar XAI 64 229 0 10 Aug 2021
Tailor: Generating and Perturbing Text with Semantic Controls Alexis Ross Tongshuang Wu Hao Peng Matthew E. Peters Matt Gardner 172 78 0 15 Jul 2021
S-LIME: Stabilized-LIME for Model Explanation Zhengze Zhou Giles Hooker Fei Wang FAtt 113 89 0 15 Jun 2021
Counterfactual Explanations for Machine Learning: Challenges Revisited Sahil Verma John P Dickerson Keegan E. Hines LRM 37 27 0 14 Jun 2021
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models Matthew Finlayson Aaron Mueller Sebastian Gehrmann Stuart M. Shieber Tal Linzen Yonatan Belinkov 100 110 0 10 Jun 2021
Contrastive Explanations for Model Interpretability Alon Jacovi Swabha Swayamdipta Shauli Ravfogel Yanai Elazar Yejin Choi Yoav Goldberg 84 98 0 02 Mar 2021
Probing Classifiers: Promises, Shortcomings, and Advances Yonatan Belinkov 256 440 0 24 Feb 2021
Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models Tongshuang Wu Marco Tulio Ribeiro Jeffrey Heer Daniel S. Weld 89 247 0 01 Jan 2021
A Survey on Neural Network Interpretability Yu Zhang Peter Tiño A. Leonardis K. Tang FaML XAI 189 676 0 28 Dec 2020
Explaining NLP Models via Minimal Contrastive Editing (MiCE) Alexis Ross Ana Marasović Matthew E. Peters 66 122 0 27 Dec 2020
Semantics and explanation: why counterfactual explanations produce adversarial examples in deep neural networks Kieran Browne Ben Swift AAML GAN 45 30 0 18 Dec 2020
Understanding Pure Character-Based Neural Machine Translation: The Case of Translating Finnish into English Gongbo Tang Rico Sennrich Joakim Nivre 40 7 0 06 Nov 2020
Explain2Attack: Text Adversarial Attacks via Cross-Domain Interpretability M. Hossam Trung Le He Zhao Dinh Q. Phung SILM AAML 28 6 0 14 Oct 2020
Gradient-based Analysis of NLP Models is Manipulable Junlin Wang Jens Tuyls Eric Wallace Sameer Singh AAML FAtt 60 58 0 12 Oct 2020
Assessing Phrasal Representation and Composition in Transformers Lang-Chi Yu Allyson Ettinger CoGe 65 67 0 08 Oct 2020
The Intriguing Relation Between Counterfactual Explanations and Adversarial Examples Timo Freiesleben GAN 79 64 0 11 Sep 2020
SHAP values for Explaining CNN-based Text Classification Models Wei Zhao Tarun Joshi V. Nair Agus Sudjianto FAtt 38 36 0 26 Aug 2020
CausaLM: Causal Model Explanation Through Counterfactual Language Models Amir Feder Nadav Oved Uri Shalit Roi Reichart CML LRM 74 160 0 27 May 2020
NILE : Natural Language Inference with Faithful Natural Language Explanations Sawan Kumar Partha P. Talukdar XAI LRM 74 163 0 25 May 2020
Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance? Abhilasha Ravichander Yonatan Belinkov Eduard H. Hovy 61 128 0 02 May 2020
Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness? Alon Jacovi Yoav Goldberg XAI 98 596 0 07 Apr 2020
Information-Theoretic Probing with Minimum Description Length Elena Voita Ivan Titov 65 274 0 27 Mar 2020
Causal Interpretability for Machine Learning -- Problems, Methods and Evaluation Raha Moraffah Mansooreh Karami Ruocheng Guo A. Raglin Huan Liu CML ELM XAI 52 217 0 09 Mar 2020
Toward Interpretability of Dual-Encoder Models for Dialogue Response Suggestions Yitong Li Dianqi Li Sushant Prakash Peng Wang 42 2 0 02 Mar 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 83 1,496 0 27 Feb 2020
Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methods Dylan Slack Sophie Hilgard Emily Jia Sameer Singh Himabindu Lakkaraju FAtt AAML MLAU 66 817 0 06 Nov 2019
Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documents Ming Tu Kevin Huang Guangtao Wang Jing-ling Huang Xiaodong He Bowen Zhou RALM 67 145 0 01 Nov 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 369 20,053 0 23 Oct 2019
Attention Interpretability Across NLP Tasks Shikhar Vashishth Shyam Upadhyay Gaurav Singh Tomar Manaal Faruqui XAI MILM 83 176 0 24 Sep 2019
Learning to Deceive with Attention-Based Explanations Danish Pruthi Mansi Gupta Bhuwan Dhingra Graham Neubig Zachary Chase Lipton 72 193 0 17 Sep 2019
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 58 536 0 08 Sep 2019
Towards Understanding Neural Machine Translation with Word Importance Shilin He Zhaopeng Tu Xing Wang Longyue Wang Michael R. Lyu Shuming Shi AAML 83 40 0 01 Sep 2019
Attention is not not Explanation Sarah Wiegreffe Yuval Pinter XAI AAML FAtt 98 908 0 13 Aug 2019
Interpretable Question Answering on Knowledge Bases and Text A. Sydorova Nina Poerner Benjamin Roth 31 26 0 26 Jun 2019
DLIME: A Deterministic Local Interpretable Model-Agnostic Explanations Approach for Computer-Aided Diagnosis Systems Muhammad Rehman Zafar N. Khan FAtt 80 155 0 24 Jun 2019
Generating Counterfactual and Contrastive Explanations using SHAP Shubham Rathi 42 56 0 21 Jun 2019
A Multiscale Visualization of Attention in the Transformer Model Jesse Vig ViT 77 577 0 12 Jun 2019
Is Attention Interpretable? Sofia Serrano Noah A. Smith 101 683 0 09 Jun 2019
Explain Yourself! Leveraging Language Models for Commonsense Reasoning Nazneen Rajani Bryan McCann Caiming Xiong R. Socher ReLM LRM 74 564 0 06 Jun 2019
Open Sesame: Getting Inside BERT's Linguistic Knowledge Yongjie Lin Y. Tan Robert Frank 50 287 0 04 Jun 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 170 858 0 15 May 2019
"Why Should You Trust My Explanation?" Understanding Uncertainty in LIME Explanations Hui Fen Tan Kuangyan Song Yiming Sun Yujia Zhang Madeilene Udell FAtt 96 19 0 29 Apr 2019
LINSPECTOR: Multilingual Probing Tasks for Word Representations Gözde Gül Sahin Clara Vania Ilia Kuznetsov Iryna Gurevych 59 44 0 22 Mar 2019
Attention is not Explanation Sarthak Jain Byron C. Wallace FAtt 122 1,319 0 26 Feb 2019
Interpretable machine learning: definitions, methods, and applications W. James Murdoch Chandan Singh Karl Kumbier R. Abbasi-Asl Bin Yu XAI HAI 161 1,436 0 14 Jan 2019
e-SNLI: Natural Language Inference with Natural Language Explanations Oana-Maria Camburu Tim Rocktaschel Thomas Lukasiewicz Phil Blunsom LRM 404 637 0 04 Dec 2018
Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead Cynthia Rudin ELM FaML 50 219 0 26 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.5K 94,511 0 11 Oct 2018
How much should you ask? On the question structure in QA systems Dominika Basaj Barbara Rychalska P. Biecek Anna Wróblewska 52 6 0 11 Sep 2018
Dissecting Contextual Word Embeddings: Architecture and Representation Matthew E. Peters Mark Neumann Luke Zettlemoyer Wen-tau Yih 92 429 0 27 Aug 2018