v1v2v3 (latest)

Explainability for Large Language Models: A Survey

2 September 2023

Haiyan Zhao

Hanjie Chen

Fan Yang

Ninghao Liu

Papers citing "Explainability for Large Language Models: A Survey"

50 / 119 papers shown

Title
Rethinking Attention-Model Explainability through Faithfulness Violation Test Yebin Liu Haoliang Li Yangyang Guo Chen Kong Jing Li Shiqi Wang FAtt 166 43 0 28 Jan 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 859 9,714 0 28 Jan 2022
UNIREX: A Unified Learning Framework for Language Model Rationale Extraction Aaron Chan Maziar Sanjabi Lambert Mathias L Tan Shaoliang Nie Xiaochang Peng Xiang Ren Hamed Firooz 97 43 0 16 Dec 2021
Few-Shot Out-of-Domain Transfer Learning of Natural Language Explanations in a Label-Abundant Setup Yordan Yordanov Vid Kocijan Thomas Lukasiewicz Oana-Maria Camburu 77 19 0 12 Dec 2021
Ethical and social risks of harm from Language Models Laura Weidinger John F. J. Mellor Maribeth Rauh Conor Griffin J. Uesato ... Lisa Anne Hendricks William S. Isaac Sean Legassick G. Irving Iason Gabriel PILM 128 1,044 0 08 Dec 2021
Show Your Work: Scratchpads for Intermediate Computation with Language Models Maxwell Nye Anders Andreassen Guy Gur-Ari Henryk Michalewski Jacob Austin ... Aitor Lewkowycz Maarten Bosma D. Luan Charles Sutton Augustus Odena ReLM LRM 183 756 0 30 Nov 2021
On the Pitfalls of Analyzing Individual Neurons in Language Models Omer Antverg Yonatan Belinkov MILM 98 53 0 14 Oct 2021
ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality Marianna Apidianaki Aina Garí Soler 72 18 0 12 Oct 2021
Discretized Integrated Gradients for Explaining Language Models Soumya Sanyal Xiang Ren FAtt 65 54 0 31 Aug 2021
Resisting Out-of-Distribution Data Problem in Perturbation of XAI Luyu Qiu Yi Yang Caleb Chen Cao Jing Liu Yueyuan Zheng H. Ngai J. H. Hsiao Lei Chen 73 18 0 27 Jul 2021
Attention Flows are Shapley Value Explanations Kawin Ethayarajh Dan Jurafsky FAtt TDI 69 35 0 31 May 2021
How is BERT surprised? Layerwise detection of linguistic anomalies Bai Li Zining Zhu Guillaume Thomas Yang Xu Frank Rudzicz 76 31 0 16 May 2021
Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classification G. Chrysostomou Nikolaos Aletras 85 38 0 06 May 2021
Supervising Model Attention with Human Explanations for Robust Natural Language Inference Joe Stacey Yonatan Belinkov Marek Rei 62 47 0 16 Apr 2021
Factual Probing Is [MASK]: Learning vs. Learning to Recall Zexuan Zhong Dan Friedman Danqi Chen 58 412 0 12 Apr 2021
Local Interpretations for Explainable Natural Language Processing: A Survey Siwen Luo Hamish Ivison S. Han Josiah Poon MILM 108 50 0 20 Mar 2021
Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models Mengnan Du Varun Manjunatha R. Jain Ruchi Deshpande Franck Dernoncourt Jiuxiang Gu Tong Sun Helen Zhou 102 107 0 11 Mar 2021
Probing Classifiers: Promises, Shortcomings, and Advances Yonatan Belinkov 303 456 0 24 Feb 2021
Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models Tongshuang Wu Marco Tulio Ribeiro Jeffrey Heer Daniel S. Weld 111 250 0 01 Jan 2021
On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification Zhengxuan Wu Desmond C. Ong 72 22 0 01 Jan 2021
FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debugging Han Guo Nazneen Rajani Peter Hase Joey Tianyi Zhou Caiming Xiong TDI 126 116 0 31 Dec 2020
Transformer Feed-Forward Layers Are Key-Value Memories Mor Geva R. Schuster Jonathan Berant Omer Levy KELM 188 848 0 29 Dec 2020
Explaining NLP Models via Minimal Contrastive Editing (MiCE) Alexis Ross Ana Marasović Matthew E. Peters 73 122 0 27 Dec 2020
HateXplain: A Benchmark Dataset for Explainable Hate Speech Detection Binny Mathew Punyajoy Saha Seid Muhie Yimam Chris Biemann Pawan Goyal Animesh Mukherjee 125 581 0 18 Dec 2020
Transformer Interpretability Beyond Attention Visualization Hila Chefer Shir Gur Lior Wolf 141 673 0 17 Dec 2020
Analyzing the Source and Target Contributions to Predictions in Neural Machine Translation Elena Voita Rico Sennrich Ivan Titov 80 86 0 21 Oct 2020
Structured Self-Attention Weights Encode Semantics in Sentiment Analysis Zhengxuan Wu Thanh-Son Nguyen Desmond C. Ong MILM 71 19 0 10 Oct 2020
Intrinsic Probing through Dimension Selection Lucas Torroba Hennigen Adina Williams Ryan Cotterell 76 58 0 06 Oct 2020
Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Models Joseph F DeRose Jiayao Wang M. Berger 63 84 0 03 Sep 2020
Compositional Explanations of Neurons Jesse Mu Jacob Andreas FAtt CoGe MILM 87 179 0 24 Jun 2020
Why Attentions May Not Be Interpretable? Bing Bai Jian Liang Guanhua Zhang Hao Li Kun Bai Fei Wang FAtt 72 60 0 10 Jun 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 169 2,761 0 05 Jun 2020
Towards Transparent and Explainable Attention Models Akash Kumar Mohankumar Preksha Nema Sharan Narasimhan Mitesh M. Khapra Balaji Vasan Srinivasan Balaraman Ravindran 79 102 0 29 Apr 2020
Self-Attention Attribution: Interpreting Information Interactions Inside Transformer Y. Hao Li Dong Furu Wei Ke Xu ViT 90 227 0 23 Apr 2020
Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness? Alon Jacovi Yoav Goldberg XAI 134 600 0 07 Apr 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 111 1,505 0 27 Feb 2020
Estimating Training Data Influence by Tracing Gradient Descent G. Pruthi Frederick Liu Mukund Sundararajan Satyen Kale TDI 114 419 0 19 Feb 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 515 20,376 0 23 Oct 2019
Learning the Difference that Makes a Difference with Counterfactually-Augmented Data Divyansh Kaushik Eduard H. Hovy Zachary Chase Lipton CML 105 571 0 26 Sep 2019
How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations Betty van Aken B. Winter Alexander Loser Felix Alexander Gers 78 154 0 11 Sep 2019
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 89 538 0 08 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 587 2,680 0 03 Sep 2019
Attention is not not Explanation Sarah Wiegreffe Yuval Pinter XAI AAML FAtt 124 914 0 13 Aug 2019
Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailment Di Jin Zhijing Jin Qiufeng Wang Peter Szolovits SILM AAML 204 1,090 0 27 Jul 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 703 24,572 0 26 Jul 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 235 1,607 0 11 Jun 2019
Is Attention Interpretable? Sofia Serrano Noah A. Smith 110 686 0 09 Jun 2019
Explain Yourself! Leveraging Language Models for Commonsense Reasoning Nazneen Rajani Bryan McCann Caiming Xiong R. Socher ReLM LRM 99 566 0 06 Jun 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned Elena Voita David Talbot F. Moiseev Rico Sennrich Ivan Titov 122 1,149 0 23 May 2019
What do you learn from context? Probing for sentence structure in contextualized word representations Ian Tenney Patrick Xia Berlin Chen Alex Jinpeng Wang Adam Poliak ... Najoung Kim Benjamin Van Durme Samuel R. Bowman Dipanjan Das Ellie Pavlick 189 866 0 15 May 2019