Towards Transparent and Explainable Attention Models

29 April 2020

Akash Kumar Mohankumar

Preksha Nema

Sharan Narasimhan

Mitesh M. Khapra

Balaji Vasan Srinivasan

Balaraman Ravindran

ArXiv PDF HTML

Papers citing "Towards Transparent and Explainable Attention Models"

28 / 28 papers shown

Title
Self-Explaining Hypergraph Neural Networks for Diagnosis Prediction Leisheng Yu Yanxiao Cai Minxing Zhang Xia Hu FAtt 363 0 0 15 Feb 2025
Regularization, Semi-supervision, and Supervision for a Plausible Attention-Based Explanation Duc Hau Nguyen Cyrielle Mallart Guillaume Gravier Pascale Sébillot 93 0 0 22 Jan 2025
Attention is not not Explanation Sarah Wiegreffe Yuval Pinter XAI AAML FAtt 48 901 0 13 Aug 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 186 1,586 0 11 Jun 2019
Is Attention Interpretable? Sofia Serrano Noah A. Smith 75 679 0 09 Jun 2019
Analyzing the Structure of Attention in a Transformer Language Model Jesse Vig Yonatan Belinkov 51 361 0 07 Jun 2019
Exploring Interpretable LSTM Neural Networks over Multi-Variable Data Tian Guo Tao R. Lin Nino Antulov-Fantulin AI4TS 47 155 0 28 May 2019
Are Sixteen Heads Really Better than One? Paul Michel Omer Levy Graham Neubig MoE 80 1,051 0 25 May 2019
BERT Rediscovers the Classical NLP Pipeline Ian Tenney Dipanjan Das Ellie Pavlick MILM SSeg 103 1,458 0 15 May 2019
Selective Attention for Context-aware Neural Machine Translation Sameen Maruf André F. T. Martins Gholamreza Haffari 49 175 0 21 Mar 2019
SSN: Learning Sparse Switchable Normalization via SparsestMax Wenqi Shao Jiamin Ren Jingyu Li Ruimao Zhang Yudian Li Xiaogang Wang Ping Luo 45 56 0 09 Mar 2019
Attention is not Explanation Sarthak Jain Byron C. Wallace FAtt 87 1,307 0 26 Feb 2019
Re-evaluating ADEM: A Deeper Look at Scoring Dialogue Responses Ananya B. Sai Mithun Das Gupta Mitesh M. Khapra Mukundhan Srinivasan 47 48 0 23 Feb 2019
Deriving Machine Attention from Human Rationales Yujia Bao Shiyu Chang Mo Yu Regina Barzilay 24 104 0 28 Aug 2018
Sparse and Constrained Attention for Neural Machine Translation Chaitanya Malaviya Pedro Ferreira André F. T. Martins 36 62 0 21 May 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 658 7,080 0 20 Apr 2018
Advances in Pre-Training Distributed Word Representations Tomas Mikolov Edouard Grave Piotr Bojanowski Christian Puhrsch Armand Joulin AI4TS VLM 87 1,238 0 26 Dec 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 453 129,831 0 12 Jun 2017
A Regularized Framework for Sparse and Structured Neural Attention Vlad Niculae Mathieu Blondel 62 99 0 22 May 2017
Diversity driven Attention Model for Query-based Abstractive Summarization Preksha Nema Mitesh Khapra Anirban Laha Balaraman Ravindran 55 170 0 26 Apr 2017
Axiomatic Attribution for Deep Networks Mukund Sundararajan Ankur Taly Qiqi Yan OOD FAtt 122 5,920 0 04 Mar 2017
Rationalizing Neural Predictions Tao Lei Regina Barzilay Tommi Jaakkola 87 809 0 13 Jun 2016
From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification André F. T. Martins Ramón Fernández Astudillo 125 711 0 05 Feb 2016
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 229 4,268 0 21 Aug 2015
Teaching Machines to Read and Comprehend Karl Moritz Hermann Tomás Kociský Edward Grefenstette L. Espeholt W. Kay Mustafa Suleyman Phil Blunsom 274 3,527 0 10 Jun 2015
Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks Jason Weston Antoine Bordes S. Chopra Alexander M. Rush Bart van Merriënboer Armand Joulin Tomas Mikolov LRM ELM 105 1,178 0 19 Feb 2015
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 390 27,205 0 01 Sep 2014
A Universal Part-of-Speech Tagset Slav Petrov Dipanjan Das Ryan T. McDonald 66 1,035 0 11 Apr 2011