Transformer Interpretability Beyond Attention Visualization

17 December 2020

Papers citing "Transformer Interpretability Beyond Attention Visualization"

50 / 134 papers shown

Title
Occlusion Sensitivity Analysis with Augmentation Subspace Perturbation in Deep Feature Space Pedro Valois Koichiro Niinuma Kazuhiro Fukui AAML 26 4 0 25 Nov 2023
Inspecting Explainability of Transformer Models with Additional Statistical Information Hoang C. Nguyen Haeil Lee Junmo Kim ViT 29 3 0 19 Nov 2023
Interpretability-Aware Vision Transformer Yao Qiang Chengyin Li Prashant Khanduri D. Zhu ViT 82 7 0 14 Sep 2023
PDiscoNet: Semantically consistent part discovery for fine-grained recognition Robert van der Klis Stephan Alaniz Massimiliano Mancini C. Dantas Dino Ienco Zeynep Akata Diego Marcos 22 11 0 06 Sep 2023
FunnyBirds: A Synthetic Vision Dataset for a Part-Based Analysis of Explainable AI Methods Robin Hesse Simone Schaub-Meyer Stefan Roth AAML 37 32 0 11 Aug 2023
Is attention all you need in medical image analysis? A review G. Papanastasiou Nikolaos Dikaios Jiahao Huang Chengjia Wang Guang Yang ViT MedIm 25 23 0 24 Jul 2023
Leveraging Historical Medical Records as a Proxy via Multimodal Modeling and Visualization to Enrich Medical Diagnostic Learning Ouyang Yang Yuchen Wu He Wang Chenyang Zhang Furui Cheng Chang Jiang Lixia Jin Yuanwu Cao Qu Li 16 6 0 23 Jul 2023
Transformers in Reinforcement Learning: A Survey Pranav Agarwal A. Rahman P. St-Charles Simon J. D. Prince Samira Ebrahimi Kahou OffRL 26 18 0 12 Jul 2023
MSW-Transformer: Multi-Scale Shifted Windows Transformer Networks for 12-Lead ECG Classification Ren-Wei Cheng Zhemin Zhuang Shuxin Zhuang Linfu Xie Jingfeng Guo MedIm 28 6 0 21 Jun 2023
ExpPoint-MAE: Better interpretability and performance for self-supervised point cloud transformers Ioannis Romanelis Vlassis Fotis Konstantinos Moustakas Adrian Munteanu ViT 3DPC 23 4 0 19 Jun 2023
Turning large language models into cognitive models Marcel Binz Eric Schulz 32 53 0 06 Jun 2023
VISION DIFFMASK: Faithful Interpretation of Vision Transformers with Differentiable Patch Masking A. Nalmpantis Apostolos Panagiotopoulos John Gkountouras Konstantinos Papakostas Wilker Aziz 15 4 0 13 Apr 2023
Computational modeling of semantic change Nina Tahmasebi Haim Dubossarsky 34 6 0 13 Apr 2023
Towards Evaluating Explanations of Vision Transformers for Medical Imaging Piotr Komorowski Hubert Baniecki P. Biecek MedIm 33 27 0 12 Apr 2023
Transformer-based interpretable multi-modal data fusion for skin lesion classification Theodor Cheslerean-Boghiu Melia-Evelina Fleischmann Theresa Willem Tobias Lasser ViT MedIm AI4CE 24 2 0 03 Apr 2023
Evaluating self-attention interpretability through human-grounded experimental protocol Milan Bhan Nina Achache Victor Legrand A. Blangero Nicolas Chesneau 26 9 0 27 Mar 2023
Sector Patch Embedding: An Embedding Module Conforming to The Distortion Pattern of Fisheye Image Dian Yang Jiadong Tang Yu Gao Yi Yang M. Fu 26 1 0 26 Mar 2023
Attention-based Saliency Maps Improve Interpretability of Pneumothorax Classification Alessandro Wollek Robert Graf Saša Čečatka N. Fink Theresa Willem B. Sabel Tobias Lasser 18 26 0 03 Mar 2023
The Meta-Evaluation Problem in Explainable AI: Identifying Reliable Estimators with MetaQuantus Anna Hedström P. Bommer Kristoffer K. Wickstrom Wojciech Samek Sebastian Lapuschkin Marina M.-C. Höhne 37 21 0 14 Feb 2023
PAMI: partition input and aggregate outputs for model interpretation Wei Shi Wentao Zhang Weishi Zheng Ruixuan Wang FAtt 26 3 0 07 Feb 2023
X-ReID: Cross-Instance Transformer for Identity-Level Person Re-Identification Leqi Shen Tao He Yuchen Guo Guiguang Ding 44 6 0 04 Feb 2023
Holistically Explainable Vision Transformers Moritz D Boehle Mario Fritz Bernt Schiele ViT 38 9 0 20 Jan 2023
Opti-CAM: Optimizing saliency maps for interpretability Hanwei Zhang Felipe Torres R. Sicre Yannis Avrithis Stéphane Ayache 36 22 0 17 Jan 2023
Negative Flux Aggregation to Estimate Feature Attributions X. Li Deng Pan Chengyin Li Yao Qiang D. Zhu FAtt 8 6 0 17 Jan 2023
Dynamic Grained Encoder for Vision Transformers Lin Song Songyang Zhang Songtao Liu Zeming Li Xuming He Hongbin Sun Jian Sun Nanning Zheng ViT 26 34 0 10 Jan 2023
What do Vision Transformers Learn? A Visual Exploration Amin Ghiasi Hamid Kazemi Eitan Borgnia Steven Reich Manli Shu Micah Goldblum A. Wilson Tom Goldstein ViT 34 60 0 13 Dec 2022
Interpretable Diabetic Retinopathy Diagnosis based on Biomarker Activation Map P. Zang T. Hormel Jie Wang Yukun Guo Steven T. Bailey C. Flaxel David Huang T. Hwang Yali Jia MedIm 25 7 0 13 Dec 2022
Vision Transformer with Attentive Pooling for Robust Facial Expression Recognition Fanglei Xue Qiangchang Wang Zichang Tan Zhongsong Ma G. Guo ViT 41 67 0 11 Dec 2022
SpaText: Spatio-Textual Representation for Controllable Image Generation Omri Avrahami Thomas Hayes Oran Gafni Sonal Gupta Yaniv Taigman Devi Parikh Dani Lischinski Ohad Fried Xiaoyue Yin DiffM 40 203 0 25 Nov 2022
CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labels Siyuan Li Li Sun Qingli Li VLM 30 149 0 25 Nov 2022
Masked Contrastive Representation Learning Yuan Yao Nandakishor Desai M. Palaniswami SSL 22 8 0 11 Nov 2022
ViT-CX: Causal Explanation of Vision Transformers Weiyan Xie Xiao-hui Li Caleb Chen Cao Nevin L.Zhang ViT 29 17 0 06 Nov 2022
Exploring Self-Attention for Crop-type Classification Explainability Ivica Obadic R. Roscher Dario Augusto Borges Oliveira Xiao Xiang Zhu 27 7 0 24 Oct 2022
Delving into Masked Autoencoders for Multi-Label Thorax Disease Classification Junfei Xiao Yutong Bai Alan Yuille Zongwei Zhou MedIm ViT 37 59 0 23 Oct 2022
Multi-Scale Wavelet Transformer for Face Forgery Detection Jie Liu Jingjing Wang Peng Zhang Chunmao Wang Di Xie Shiliang Pu ViT CVBM 36 8 0 08 Oct 2022
Systematic Generalization and Emergent Structures in Transformers Trained on Structured Tasks Yuxuan Li James L. McClelland 44 17 0 02 Oct 2022
FreeSeg: Free Mask from Interpretable Contrastive Language-Image Pretraining for Semantic Segmentation Yi Li Huifeng Yao Hualiang Wang Xiaomeng Li ISeg VLM 41 2 0 27 Sep 2022
ProtoPFormer: Concentrating on Prototypical Parts in Vision Transformers for Interpretable Image Recognition Mengqi Xue Qihan Huang Haofei Zhang Lechao Cheng Mingli Song Ming-hui Wu Mingli Song ViT 27 52 0 22 Aug 2022
Object-ABN: Learning to Generate Sharp Attention Maps for Action Recognition Tomoya Nitta Tsubasa Hirakawa H. Fujiyoshi Toru Tamaki 58 0 0 27 Jul 2022
Semantic Abstraction: Open-World 3D Scene Understanding from 2D Vision-Language Models Huy Ha Shuran Song LM&Ro VLM 43 102 0 23 Jul 2022
TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers Jihao Liu B. Liu Hang Zhou Hongsheng Li Yu Liu ViT 24 66 0 18 Jul 2022
Explanation-based Counterfactual Retraining(XCR): A Calibration Method for Black-box Models Liu Zhendong Wenyu Jiang Yan Zhang Chongjun Wang CML 11 0 0 22 Jun 2022
SP-ViT: Learning 2D Spatial Priors for Vision Transformers Yuxuan Zhou Wangmeng Xiang Chong Li Biao Wang Xihan Wei Lei Zhang M. Keuper Xia Hua ViT 34 15 0 15 Jun 2022
Dual Decomposition of Convex Optimization Layers for Consistent Attention in Medical Images Tom Ron M. Weiler-Sagie Tamir Hazan FAtt MedIm 24 6 0 06 Jun 2022
Optimizing Relevance Maps of Vision Transformers Improves Robustness Hila Chefer Idan Schwartz Lior Wolf ViT 35 38 0 02 Jun 2022
Attention Flows for General Transformers Niklas Metzger Christopher Hahn Julian Siber Frederik Schmitt Bernd Finkbeiner 34 0 0 30 May 2022
Towards Opening the Black Box of Neural Machine Translation: Source and Target Interpretations of the Transformer Javier Ferrando Gerard I. Gállego Belen Alastruey Carlos Escolano Marta R. Costa-jussá 30 44 0 23 May 2022
A graph-transformer for whole slide image classification Yi Zheng R. Gindra Emily J. Green E. Burks Margrit Betke J. Beane V. Kolachalama MedIm 45 123 0 19 May 2022
MulT: An End-to-End Multitask Learning Transformer Deblina Bhattacharjee Tong Zhang Sabine Süsstrunk Mathieu Salzmann ViT 39 63 0 17 May 2022
Unraveling Attention via Convex Duality: Analysis and Interpretations of Vision Transformers Arda Sahiner Tolga Ergen Batu Mehmet Ozturkler John M. Pauly Morteza Mardani Mert Pilanci 40 33 0 17 May 2022