Quantifying Attention Flow in Transformers

2 May 2020

Papers citing "Quantifying Attention Flow in Transformers"

50 / 403 papers shown

Title
Just Add $π$ ! Pose Induced Video Transformers for Understanding Activities of Daily Living Dominick Reilly Srijan Das ViT 32 17 0 30 Nov 2023
Improving Interpretation Faithfulness for Vision Transformers Lijie Hu Yixin Liu Ninghao Liu Mengdi Huai Lichao Sun Di Wang 41 5 0 29 Nov 2023
Occlusion Sensitivity Analysis with Augmentation Subspace Perturbation in Deep Feature Space Pedro Valois Koichiro Niinuma Kazuhiro Fukui AAML 26 4 0 25 Nov 2023
Inspecting Explainability of Transformer Models with Additional Statistical Information Hoang C. Nguyen Haeil Lee Junmo Kim ViT 29 3 0 19 Nov 2023
Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Survey Ashok Urlana Pruthwik Mishra Tathagato Roy Rahul Mishra 37 8 0 15 Nov 2023
To Transformers and Beyond: Large Language Models for the Genome Micaela Elisa Consens Cameron Dufault Michael Wainberg Duncan Forster Mehran Karimzadeh Hani Goodarzi Fabian J. Theis Alan Moses Bo Wang LM&MA MedIm 26 26 0 13 Nov 2023
Explainability of Vision Transformers: A Comprehensive Review and New Perspectives Rojina Kashefi Leili Barekatain Mohammad Sabokrou Fatemeh Aghaeipoor ViT 42 9 0 12 Nov 2023
Automated Sperm Assessment Framework and Neural Network Specialized for Sperm Video Recognition T. Fujii Hayato Nakagawa T. Takeshima Y. Yumura T. Hamagami 28 3 0 10 Nov 2023
Zero-shot Translation of Attention Patterns in VQA Models to Natural Language Leonard Salewski A. Sophia Koepke Hendrik P. A. Lensch Zeynep Akata 34 2 0 08 Nov 2023
SugarViT -- Multi-objective Regression of UAV Images with Vision Transformers and Deep Label Distribution Learning Demonstrated on Disease Severity Prediction in Sugar Beet Maurice Günder F. R. I. Yamati Abel Andree Barreta Alcántara Anne-Katrin Mahlein R. Sifa Christian Bauckhage 15 2 0 06 Nov 2023
Object-centric Video Representation for Long-term Action Anticipation Ce Zhang Changcheng Fu Shijie Wang Nakul Agarwal Kwonjoon Lee Chiho Choi Chen Sun 25 14 0 31 Oct 2023
Explainable Artificial Intelligence (XAI) 2.0: A Manifesto of Open Challenges and Interdisciplinary Research Directions Luca Longo Mario Brcic Federico Cabitza Jaesik Choi Roberto Confalonieri ... Andrés Páez Wojciech Samek Johannes Schneider Timo Speith Simone Stumpf 32 189 0 30 Oct 2023
Roles of Scaling and Instruction Tuning in Language Perception: Model vs. Human Attention Changjiang Gao Shujian Huang Jixing Li Jiajun Chen LRM ALM 42 6 0 29 Oct 2023
Visual Explanations via Iterated Integrated Attributions Oren Barkan Yehonatan Elisha Yuval Asher Amit Eshel Noam Koenigstein FAtt XAI 28 18 0 28 Oct 2023
This Reads Like That: Deep Learning for Interpretable Natural Language Processing Claudio Fanconi Moritz Vandenhirtz Severin Husmann Julia E. Vogt FAtt 14 2 0 25 Oct 2023
On the Interplay between Fairness and Explainability Stephanie Brandl Emanuele Bugliarello Ilias Chalkidis FaML 27 4 0 25 Oct 2023
Learning to Explain: A Model-Agnostic Framework for Explaining Black Box Models Oren Barkan Yuval Asher Amit Eshel Yehonatan Elisha Noam Koenigstein 43 5 0 25 Oct 2023
Deep Integrated Explanations Oren Barkan Yehonatan Elisha Jonathan Weill Yuval Asher Amit Eshel Noam Koenigstein FAtt 41 7 0 23 Oct 2023
Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models Yifan Hou Jiaoda Li Yu Fei Alessandro Stolfo Wangchunshu Zhou Guangtao Zeng Antoine Bosselut Mrinmaya Sachan LRM 30 40 0 23 Oct 2023
Interpreting and Controlling Vision Foundation Models via Text Explanations Haozhe Chen Junfeng Yang Carl Vondrick Chengzhi Mao 27 2 0 16 Oct 2023
Local Style Awareness of Font Images Daichi Haraguchi Seiichi Uchida 15 0 0 10 Oct 2023
DiPS: Discriminative Pseudo-Label Sampling with Self-Supervised Transformers for Weakly Supervised Object Localization Shakeeb Murtaza Soufiane Belharbi M. Pedersoli Aydin Sarraf Eric Granger WSOL 45 9 0 09 Oct 2023
Interpreting CLIP's Image Representation via Text-Based Decomposition Yossi Gandelsman Alexei A. Efros Jacob Steinhardt VLM 21 81 0 09 Oct 2023
An Attribution Method for Siamese Encoders Lucas Moller Dmitry Nikolaev Sebastian Padó 19 4 0 09 Oct 2023
ViT-ReciproCAM: Gradient and Attention-Free Visual Explanations for Vision Transformer Seokhyun Byun Won-Jo Lee FAtt 23 4 0 04 Oct 2023
Quantifying the Plausibility of Context Reliance in Neural Machine Translation Gabriele Sarti Grzegorz Chrupala Malvina Nissim Arianna Bisazza 34 5 0 02 Oct 2023
Deep learning probability flows and entropy production rates in active matter Nicholas M. Boffi Eric Vanden-Eijnden DiffM 25 17 0 22 Sep 2023
Interpretability-Aware Vision Transformer Yao Qiang Chengyin Li Prashant Khanduri D. Zhu ViT 82 7 0 14 Sep 2023
Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs Angelica Chen Ravid Schwartz-Ziv Kyunghyun Cho Matthew L. Leavitt Naomi Saphra 29 62 0 13 Sep 2023
PDiscoNet: Semantically consistent part discovery for fine-grained recognition Robert van der Klis Stephan Alaniz Massimiliano Mancini C. Dantas Dino Ienco Zeynep Akata Diego Marcos 22 11 0 06 Sep 2023
Interpretable Medical Imagery Diagnosis with Self-Attentive Transformers: A Review of Explainable AI for Health Care Tin Lai MedIm 32 4 0 01 Sep 2023
Emergence of Segmentation with Minimalistic White-Box Transformers Yaodong Yu Tianzhe Chu Shengbang Tong Ziyang Wu Druv Pai Sam Buchanan Y. Ma ViT 25 22 0 30 Aug 2023
ConSlide: Asynchronous Hierarchical Interaction Transformer with Breakup-Reorganize Rehearsal for Continual Whole Slide Image Analysis Yanyan Huang Weiqin Zhao Shujun Wang Yu Fu Yuming Jiang Lequan Yu CLL 30 18 0 25 Aug 2023
AtmoRep: A stochastic model of atmosphere dynamics using large scale representation learning C. Lessig Ilaria Luise Bing Gong M. Langguth S. Stadtler Martin G. Schultz 15 29 0 25 Aug 2023
Generic Attention-model Explainability by Weighted Relevance Accumulation Yiming Huang Ao Jia Xiaodan Zhang Jiawei Zhang 18 1 0 20 Aug 2023
Improving Depth Gradient Continuity in Transformers: A Comparative Study on Monocular Depth Estimation with CNN Jiawei Yao Tong Wu Xiaofeng Zhang ViT MDE 42 74 0 16 Aug 2023
FunnyBirds: A Synthetic Vision Dataset for a Part-Based Analysis of Explainable AI Methods Robin Hesse Simone Schaub-Meyer Stefan Roth AAML 37 32 0 11 Aug 2023
OxfordTVG-HIC: Can Machine Make Humorous Captions from Images? Runjia Li Shuyang Sun Mohamed Elhoseiny Philip Torr 36 11 0 21 Jul 2023
R-Cut: Enhancing Explainability in Vision Transformers with Relationship Weighted Out and Cut Yingjie Niu Ming Ding Maoning Ge Robin Karlsson Yuxiao Zhang K. Takeda ViT 26 3 0 18 Jul 2023
Does Visual Pretraining Help End-to-End Reasoning? Chen Sun Calvin Luo Xingyi Zhou Anurag Arnab Cordelia Schmid OCL LRM ViT 38 3 0 17 Jul 2023
An Explainable Deep Framework: Towards Task-Specific Fusion for Multi-to-One MRI Synthesis Luyi Han Tianyu Zhang Yunzhi Huang Haoran Dou Xin Wang Yuan Gao Chun-Ta Lu Tan Tao R. Mann MedIm 22 8 0 03 Jul 2023
Exploring the Role of Audio in Video Captioning Yuhan Shen Linjie Yang Longyin Wen Haichao Yu Ehsan Elhamifar Heng Wang 18 2 0 21 Jun 2023
RaViTT: Random Vision Transformer Tokens Felipe A. Quezada Carlos F. Navarro Cristian Muñoz Manuel Zamorano Jorge Jara-Wilde Violeta Chang C. Navarro Mauricio Cerda ViT 25 1 0 19 Jun 2023
B-cos Alignment for Inherently Interpretable CNNs and Vision Transformers Moritz D Boehle Navdeeppal Singh Mario Fritz Bernt Schiele 59 27 0 19 Jun 2023
Personalized Image Enhancement Featuring Masked Style Modeling Satoshi Kosugi T. Yamasaki DiffM 21 1 0 15 Jun 2023
Seeing the Pose in the Pixels: Learning Pose-Aware Representations in Vision Transformers Dominick Reilly Aman Chadha Srijan Das ViT 33 4 0 15 Jun 2023
Genomic Interpreter: A Hierarchical Genomic Deep Neural Network with 1D Shifted Window Transformer Zehui Li Akashaditya Das W. Beardall Yiren Zhao Guy-Bart Stan 10 4 0 08 Jun 2023
DecompX: Explaining Transformers Decisions by Propagating Token Decomposition Ali Modarressi Mohsen Fayyaz Ehsan Aghazadeh Yadollah Yaghoobzadeh Mohammad Taher Pilehvar 25 26 0 05 Jun 2023
Cyclic Learning: Bridging Image-level Labels and Nuclei Instance Segmentation Yang Zhou Yongjian Wu Zehao Wang Bingzheng Wei Maode Lai Jianzhong Shou Yubo Fan Yan Xu 33 10 0 05 Jun 2023
Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistency Owen Queen Thomas Hartvigsen Teddy Koker Huan He Theodoros Tsiligkaridis Marinka Zitnik AI4TS 37 17 0 03 Jun 2023