Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAI

16 March 2020

Papers citing "Ground Truth Evaluation of Neural Network Explanations with CLEVR-XAI"

50 / 59 papers shown

Title
Minimizing False-Positive Attributions in Explanations of Non-Linear Models Anders Gjølbye Stefan Haufe Lars Kai Hansen 67 0 0 16 May 2025
A Unified Framework with Novel Metrics for Evaluating the Effectiveness of XAI Techniques in LLMs Melkamu Mersha Mesay Gemeda Yigezu Hassan Shakil Ali Al shami SangHyun Byun Jugal Kalita 92 1 0 06 Mar 2025
Evaluating the Effectiveness of XAI Techniques for Encoder-Based Language Models Melkamu Mersha Mesay Gemeda Yigezu Jugal Kalita ELM 104 4 0 26 Jan 2025
Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metrics Lukas Klein Carsten T. Lüth U. Schlegel Till J. Bungert Mennatallah El-Assady Paul F. Jäger XAI ELM 74 4 0 03 Jan 2025
Beyond Accuracy: On the Effects of Fine-tuning Towards Vision-Language Model's Prediction Rationality Qitong Wang Tang Li Kien X. Nguyen Xi Peng 120 0 0 17 Dec 2024
Identifying Drivers of Predictive Aleatoric Uncertainty Pascal Iversen Simon Witzke Katharina Baum Bernhard Y. Renard UD 85 2 0 12 Dec 2023
Two4Two: Evaluating Interpretable Machine Learning - A Synthetic Dataset For Controlled Experiments M. Schuessler Philipp Weiß Leon Sixt 45 3 0 06 May 2021
KANDINSKYPatterns -- An experimental exploration environment for Pattern Analysis and Machine Intelligence Andreas Holzinger Anna Saranti Heimo Mueller 61 10 0 28 Feb 2021
Debugging Tests for Model Explanations Julius Adebayo M. Muelly Ilaria Liccardi Been Kim FAtt 32 179 0 10 Nov 2020
Modern Hopfield Networks and Attention for Immune Repertoire Classification Michael Widrich Bernhard Schafl Hubert Ramsauer Milena Pavlović Lukas Gruber ... Johannes Brandstetter G. K. Sandve Victor Greiff Sepp Hochreiter Günter Klambauer 215 117 0 16 Jul 2020
Shortcut Learning in Deep Neural Networks Robert Geirhos J. Jacobsen Claudio Michaelis R. Zemel Wieland Brendel Matthias Bethge Felix Wichmann 120 2,023 0 16 Apr 2020
Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness? Alon Jacovi Yoav Goldberg XAI 58 584 0 07 Apr 2020
When Explanations Lie: Why Many Modified BP Attributions Fail Leon Sixt Maximilian Granz Tim Landgraf BDL FAtt XAI 18 132 0 20 Dec 2019
Measuring the Quality of Explanations: The System Causability Scale (SCS). Comparing Human and Machine Explanations Andreas Holzinger André M. Carrington Heimo Muller LRM XAI ELM 40 303 0 19 Dec 2019
Pruning by Explaining: A Novel Criterion for Deep Neural Network Pruning Seul-Ki Yeom P. Seegerer Sebastian Lapuschkin Alexander Binder Simon Wiedemann K. Müller Wojciech Samek CVBM 23 203 0 18 Dec 2019
Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI Alejandro Barredo Arrieta Natalia Díaz Rodríguez Javier Del Ser Adrien Bennetot Siham Tabik ... S. Gil-Lopez Daniel Molina Richard Benjamins Raja Chatila Francisco Herrera XAI 55 6,178 0 22 Oct 2019
Towards Best Practice in Explaining Neural Network Decisions with LRP M. Kohlbrenner Alexander Bauer Shinichi Nakajima Alexander Binder Wojciech Samek Sebastian Lapuschkin 39 147 0 22 Oct 2019
Explaining and Interpreting LSTMs L. Arras Jose A. Arjona-Medina Michael Widrich G. Montavon Michael Gillhofer K. Müller Sepp Hochreiter Wojciech Samek FAtt AI4TS 32 79 0 25 Sep 2019
Unmasking Clever Hans Predictors and Assessing What Machines Really Learn Sebastian Lapuschkin S. Wäldchen Alexander Binder G. Montavon Wojciech Samek K. Müller 39 1,005 0 26 Feb 2019
Understanding Individual Decisions of CNNs via Contrastive Backpropagation Jindong Gu Yinchong Yang Volker Tresp FAtt 24 94 0 05 Dec 2018
Explicit Bias Discovery in Visual Question Answering Models Varun Manjunatha Nirat Saini L. Davis CML FAtt 28 93 0 19 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 655 93,936 0 11 Oct 2018
Local Explanation Methods for Deep Neural Networks Lack Sensitivity to Parameter Values Julius Adebayo Justin Gilmer Ian Goodfellow Been Kim FAtt AAML 36 128 0 08 Oct 2018
Sanity Checks for Saliency Maps Julius Adebayo Justin Gilmer M. Muelly Ian Goodfellow Moritz Hardt Been Kim FAtt AAML XAI 97 1,947 0 08 Oct 2018
Explaining the Unique Nature of Individual Gait Patterns with Deep Learning Fabian Horst Sebastian Lapuschkin Wojciech Samek K. Müller W. Schöllhorn AI4CE 46 208 0 13 Aug 2018
Recognition in Terra Incognita Sara Beery Grant Van Horn Pietro Perona 41 835 0 13 Jul 2018
Measuring abstract reasoning in neural networks David Barrett Felix Hill Adam Santoro Ari S. Morcos Timothy Lillicrap OOD 45 359 0 11 Jul 2018
Women also Snowboard: Overcoming Bias in Captioning Models (Extended Abstract) Lisa Anne Hendricks Kaylee Burns Kate Saenko Trevor Darrell Anna Rohrbach 55 479 0 02 Jul 2018
A Benchmark for Interpretability Methods in Deep Neural Networks Sara Hooker D. Erhan Pieter-Jan Kindermans Been Kim FAtt UQCV 56 673 0 28 Jun 2018
Noise-adding Methods of Saliency Map as Series of Higher Order Partial Derivative Junghoon Seo J. Choe Jamyoung Koo Seunghyeon Jeon Beomsu Kim Taegyun Jeon FAtt ODL 16 29 0 08 Jun 2018
On the importance of single directions for generalization Ari S. Morcos David Barrett Neil C. Rabinowitz M. Botvinick 36 331 0 19 Mar 2018
Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning David Mascharka Philip Tran Ryan Soklaski Arjun Majumdar 87 207 0 14 Mar 2018
Learning to Explain: An Information-Theoretic Perspective on Model Interpretation Jianbo Chen Le Song Martin J. Wainwright Michael I. Jordan MLT FAtt 118 568 0 21 Feb 2018
Visual Explanation by Interpretation: Improving Visual Feedback Capabilities of Deep Neural Networks José Oramas Kaili Wang Tinne Tuytelaars XAI FAtt 28 62 0 18 Dec 2017
Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering Aishwarya Agrawal Dhruv Batra Devi Parikh Aniruddha Kembhavi OOD 120 585 0 01 Dec 2017
Methods for Interpreting and Understanding Deep Neural Networks G. Montavon Wojciech Samek K. Müller FaML 253 2,248 0 24 Jun 2017
Explaining Recurrent Neural Network Predictions in Sentiment Analysis L. Arras G. Montavon K. Müller Wojciech Samek FAtt 32 353 0 22 Jun 2017
SmoothGrad: removing noise by adding noise D. Smilkov Nikhil Thorat Been Kim F. Viégas Martin Wattenberg FAtt ODL 163 2,211 0 12 Jun 2017
A simple neural network module for relational reasoning Adam Santoro David Raposo David Barrett Mateusz Malinowski Razvan Pascanu Peter W. Battaglia Timothy Lillicrap GNN NAI 86 1,610 0 05 Jun 2017
A Unified Approach to Interpreting Model Predictions Scott M. Lundberg Su-In Lee FAtt 191 21,459 0 22 May 2017
ShapeWorld - A new test methodology for multimodal language understanding A. Kuhnle Ann A. Copestake 43 68 0 14 Apr 2017
Interpretable Explanations of Black Boxes by Meaningful Perturbation Ruth C. Fong Andrea Vedaldi FAtt AAML 20 1,514 0 11 Apr 2017
Learning Important Features Through Propagating Activation Differences Avanti Shrikumar Peyton Greenside A. Kundaje FAtt 60 3,848 0 10 Apr 2017
Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations A. Ross M. C. Hughes Finale Doshi-Velez FAtt 89 585 0 10 Mar 2017
Axiomatic Attribution for Deep Networks Mukund Sundararajan Ankur Taly Qiqi Yan OOD FAtt 59 5,920 0 04 Mar 2017
Visualizing Deep Neural Network Decisions: Prediction Difference Analysis L. Zintgraf Taco S. Cohen T. Adel Max Welling FAtt 91 707 0 15 Feb 2017
"What is Relevant in a Text Document?": An Interpretable Machine Learning Approach L. Arras F. Horn G. Montavon K. Müller Wojciech Samek 34 288 0 23 Dec 2016
CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning Justin Johnson B. Hariharan Laurens van der Maaten Li Fei-Fei C. L. Zitnick Ross B. Girshick CoGe 250 2,346 0 20 Dec 2016
Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering Yash Goyal Tejas Khot D. Summers-Stay Dhruv Batra Devi Parikh CoGe 276 3,187 0 02 Dec 2016
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization Ramprasaath R. Selvaraju Michael Cogswell Abhishek Das Ramakrishna Vedantam Devi Parikh Dhruv Batra FAtt 163 19,796 0 07 Oct 2016