How Far Does BERT Look At:Distance-based Clustering and Analysis of
BERT$'$s Attention

How Far Does BERT Look At:Distance-based Clustering and Analysis of BERT $'$ s Attention

2 November 2020

Jingwen Leng

Papers citing "How Far Does BERT Look At:Distance-based Clustering and Analysis of BERT$'$s Attention"

8 / 8 papers shown

Title
Lite Transformer with Long-Short Range Attention Zhanghao Wu Zhijian Liu Ji Lin Chengyue Wu Song Han 49 321 0 24 Apr 2020
Are Sixteen Heads Really Better than One? Paul Michel Omer Levy Graham Neubig MoE 66 1,049 0 25 May 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned Elena Voita David Talbot F. Moiseev Rico Sennrich Ivan Titov 76 1,120 0 23 May 2019
Attention is not Explanation Sarthak Jain Byron C. Wallace FAtt 87 1,307 0 26 Feb 2019
What you can cram into a single vector: Probing sentence embeddings for linguistic properties Alexis Conneau Germán Kruszewski Guillaume Lample Loïc Barrault Marco Baroni 274 888 0 03 May 2018
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 391 4,444 0 18 Apr 2017
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 144 8,067 0 16 Jun 2016
Clustering Stability: An Overview U. V. Luxburg 97 285 0 07 Jul 2010