Attention is not Explanation

26 February 2019

Papers citing "Attention is not Explanation"

50 / 58 papers shown

Title
LiDDA: Data Driven Attribution at LinkedIn John Bencina Erkut Aykutlug Yue Chen Zerui Zhang Stephanie Sorenson Shao Tang Changshuai Wei 54 0 0 14 May 2025
Exploring How LLMs Capture and Represent Domain-Specific Knowledge Mirian Hipolito Garcia Camille Couturier Daniel Madrigal Diaz Ankur Mallick Anastasios Kyrillidis Robert Sim Victor Rühle Saravan Rajmohan 55 1 0 23 Apr 2025
Neural ODE Transformers: Analyzing Internal Dynamics and Adaptive Fine-tuning Anh Tong Thanh Nguyen-Tang Dongeun Lee Duc Nguyen Toan M. Tran David Hall Cheongwoong Kang Jaesik Choi 98 1 0 03 Mar 2025
Disentangling Visual Transformers: Patch-level Interpretability for Image Classification Guillaume Jeanneret Loïc Simon F. Jurie ViT 118 0 0 24 Feb 2025
RTBAS: Defending LLM Agents Against Prompt Injection and Privacy Leakage Peter Yong Zhong Siyuan Chen Ruiqi Wang McKenna McCall Ben L. Titzer Heather Miller Phillip B. Gibbons LLMAG 124 6 0 17 Feb 2025
Self-Explaining Hypergraph Neural Networks for Diagnosis Prediction Leisheng Yu Yanxiao Cai Minxing Zhang Xia Hu FAtt 377 0 0 15 Feb 2025
A Self-Supervised Reinforcement Learning Approach for Fine-Tuning Large Language Models Using Cross-Attention Signals Andrew Kiruluta Andreas Lemos Priscilla Burity 119 1 0 14 Feb 2025
Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checking Greta Warren Irina Shklovski Isabelle Augenstein OffRL 123 9 0 13 Feb 2025
Making Sense Of Distributed Representations With Activation Spectroscopy Kyle Reing Greg Ver Steeg Aram Galstyan 59 0 0 28 Jan 2025
A Study of the Plausibility of Attention between RNN Encoders in Natural Language Inference Duc Hau Nguyen Duc Hau Nguyen Pascale Sébillot 86 5 0 23 Jan 2025
Regularization, Semi-supervision, and Supervision for a Plausible Attention-Based Explanation Duc Hau Nguyen Cyrielle Mallart Guillaume Gravier Pascale Sébillot 105 0 0 22 Jan 2025
Attention Mechanisms Don't Learn Additive Models: Rethinking Feature Importance for Transformers Tobias Leemann Alina Fastowski Felix Pfeiffer Gjergji Kasneci 110 5 0 10 Jan 2025
Multi-Head Explainer: A General Framework to Improve Explainability in CNNs and Transformers Bohang Sun Pietro Liò ViT AAML 94 1 0 02 Jan 2025
Dynamic Attention-Guided Context Decoding for Mitigating Context Faithfulness Hallucinations in Large Language Models Yanwen Huang Yong Zhang Ning Cheng Zhitao Li Shaojun Wang Jing Xiao 125 0 0 02 Jan 2025
FitCF: A Framework for Automatic Feature Importance-guided Counterfactual Example Generation Qianli Wang Nils Feldhus Simon Ostermann Luis Felipe Villa-Arenas Sebastian Möller Vera Schmitt AAML 85 1 0 01 Jan 2025
Improving Object Detection by Modifying Synthetic Data with Explainable AI Nitish Mital Simon Malzard Richard Walters Celso M. De Melo Raghuveer Rao Victoria Nockles 113 0 0 02 Dec 2024
Phase Diagram of Vision Large Language Models Inference: A Perspective from Interaction across Image and Instruction Houjing Wei Hakaze Cho Yuting Shi MLLM 85 0 0 01 Nov 2024
Automated Trustworthiness Oracle Generation for Machine Learning Text Classifiers Lam Nguyen Tung Steven Cho Xiaoning Du Neelofar Neelofar Valerio Terragni Stefano Ruberto Aldeida Aleti 423 2 0 30 Oct 2024
Enhancing elusive clues in knowledge learning by contrasting attention of language models Jian Gao Xiao Zhang Ji Wu Miao Li 84 0 0 26 Sep 2024
From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuning Wei Chen Zhen Huang Liang Xie Binbin Lin Houqiang Li ... Deng Cai Yonggang Zhang Wenxiao Wang Xu Shen Jieping Ye 88 9 0 03 Sep 2024
Explainable Artificial Intelligence: A Survey of Needs, Techniques, Applications, and Future Direction Melkamu Mersha Khang Lam Joseph Wood Ali AlShami Jugal Kalita XAI AI4TS 212 31 0 30 Aug 2024
Normalized AOPC: Fixing Misleading Faithfulness Metrics for Feature Attribution Explainability Joakim Edin Andreas Geert Motzfeldt Casper L. Christensen Tuukka Ruotsalo Lars Maaløe Maria Maistro 94 4 0 15 Aug 2024
Machine learning surrogates for efficient hydrologic modeling: Insights from stochastic simulations of managed aquifer recharge Timothy Dai Kate Maher Z. Perzan 62 1 0 30 Jul 2024
Explanation Regularisation through the Lens of Attributions Pedro Ferreira Wilker Aziz Ivan Titov 120 1 0 23 Jul 2024
MambaLRP: Explaining Selective State Space Sequence Models F. Jafari G. Montavon Klaus-Robert Müller Oliver Eberle Mamba 184 10 0 11 Jun 2024
On the Challenges and Opportunities in Generative AI Laura Manduchi Kushagra Pandey Robert Bamler Ryan Cotterell Sina Daubener ... F. Wenzel Frank Wood Stephan Mandt Vincent Fortuin Vincent Fortuin 162 18 0 28 Feb 2024
Credit Risk Meets Large Language Models: Building a Risk Indicator from Loan Descriptions in P2P Lending Mario Sanz-Guerrero Javier Arroyo 69 5 0 29 Jan 2024
A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia Giovanni Monea Maxime Peyrard Martin Josifoski Vishrav Chaudhary Jason Eisner Emre Kiciman Hamid Palangi Barun Patra Robert West KELM 93 12 0 04 Dec 2023
Finding Optimal Diverse Feature Sets with Alternative Feature Selection Jakob Bach 118 1 0 21 Jul 2023
Exploring Self-Attention for Crop-type Classification Explainability Ivica Obadic R. Roscher Dario Augusto Borges Oliveira Xiao Xiang Zhu 71 7 0 24 Oct 2022
Explainability in Deep Reinforcement Learning Alexandre Heuillet Fabien Couthouis Natalia Díaz Rodríguez XAI 127 281 0 15 Aug 2020
Match $^2$ : A Matching over Matching Model for Similar Question Identification Zizhen Wang Yixing Fan Jiafeng Guo Liu Yang Ruqing Zhang Yanyan Lan Xueqi Cheng Hui Jiang Xiaozhao Wang 103 15 0 21 Jun 2020
Deriving Machine Attention from Human Rationales Yujia Bao Shiyu Chang Mo Yu Regina Barzilay 31 104 0 28 Aug 2018
Interpreting Recurrent and Attention-Based Neural Models: a Case Study on Natural Language Inference Reza Ghaeini Xiaoli Z. Fern Prasad Tadepalli MILM 53 97 0 12 Aug 2018
Pathologies of Neural Models Make Interpretations Difficult Shi Feng Eric Wallace Alvin Grissom II Mohit Iyyer Pedro Rodriguez Jordan L. Boyd-Graber AAML FAtt 72 317 0 20 Apr 2018
Explainable Prediction of Medical Codes from Clinical Text J. Mullenbach Sarah Wiegreffe J. Duke Jimeng Sun Jacob Eisenstein FAtt 61 571 0 15 Feb 2018
A causal framework for explaining the predictions of black-box sequence-to-sequence models David Alvarez-Melis Tommi Jaakkola CML 314 204 0 06 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 526 129,831 0 12 Jun 2017
An Interpretable Knowledge Transfer Model for Knowledge Base Completion Qizhe Xie Xuezhe Ma Zihang Dai Eduard H. Hovy 42 102 0 19 Apr 2017
Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations A. Ross M. C. Hughes Finale Doshi-Velez FAtt 113 585 0 10 Mar 2017
Axiomatic Attribution for Deep Networks Mukund Sundararajan Ankur Taly Qiqi Yan OOD FAtt 151 5,920 0 04 Mar 2017
Structured Attention Networks Yoon Kim Carl Denton Luong Hoang Alexander M. Rush 106 462 0 03 Feb 2017
Understanding Neural Networks through Representation Erasure Jiwei Li Will Monroe Dan Jurafsky AAML MILM 83 562 0 24 Dec 2016
Dynamic Coattention Networks For Question Answering Caiming Xiong Victor Zhong R. Socher AIMat 79 684 0 05 Nov 2016
Bidirectional Attention Flow for Machine Comprehension Minjoon Seo Aniruddha Kembhavi Ali Farhadi Hannaneh Hajishirzi 113 2,088 0 05 Nov 2016
RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism Edward Choi M. T. Bahadori Joshua A. Kulas A. Schuetz Walter F. Stewart Jimeng Sun AI4TS 104 1,238 0 19 Aug 2016
Rationalizing Neural Predictions Tao Lei Regina Barzilay Tommi Jaakkola 97 809 0 13 Jun 2016
The Mythos of Model Interpretability Zachary Chase Lipton FaML 148 3,672 0 10 Jun 2016
A Decomposable Attention Model for Natural Language Inference Ankur P. Parikh Oscar Täckström Dipanjan Das Jakob Uszkoreit 316 1,369 0 06 Jun 2016
Rationale-Augmented Convolutional Neural Networks for Text Classification Ye Zhang Iain J. Marshall Byron C. Wallace 57 160 0 14 May 2016