Adaptively Sparse Transformers

Adaptively Sparse Transformers

30 August 2019

Gonçalo M. Correia

André F. T. Martins

Papers citing "Adaptively Sparse Transformers"

7 / 57 papers shown

Title
Linking Social Media Posts to News with Siamese Transformers Jacob Danovitch 24 2 0 10 Jan 2020
Explicit Sparse Transformer: Concentrated Attention Through Explicit Selection Guangxiang Zhao Junyang Lin Zhiyuan Zhang Xuancheng Ren Qi Su Xu Sun 22 108 0 25 Dec 2019
Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models Giannis Daras Augustus Odena Han Zhang A. Dimakis 35 55 0 27 Nov 2019
Improving Transformer Models by Reordering their Sublayers Ofir Press Noah A. Smith Omer Levy 22 87 0 10 Nov 2019
Blockwise Self-Attention for Long Document Understanding J. Qiu Hao Ma Omer Levy Scott Yih Sinong Wang Jie Tang 11 252 0 07 Nov 2019
Reducing Transformer Depth on Demand with Structured Dropout Angela Fan Edouard Grave Armand Joulin 48 585 0 25 Sep 2019
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 220 7,930 0 17 Aug 2015