Translational Equivariance in Kernelizable Attention

15 February 2021

Papers citing "Translational Equivariance in Kernelizable Attention"

7 / 7 papers shown

Title
Rethinking Attention with Performers K. Choromanski Valerii Likhosherstov David Dohan Xingyou Song Andreea Gane ... Afroz Mohiuddin Lukasz Kaiser David Belanger Lucy J. Colwell Adrian Weller 144 1,548 0 30 Sep 2020
Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas Franccois Fleuret 123 1,734 0 29 Jun 2020
Linformer: Self-Attention with Linear Complexity Sinong Wang Belinda Z. Li Madian Khabsa Han Fang Hao Ma 175 1,678 0 08 Jun 2020
A Data and Compute Efficient Design for Limited-Resources Deep Learning Mirgahney Mohamed Gabriele Cesa Taco S. Cohen Max Welling MedIm 47 18 0 21 Apr 2020
Convolutional Conditional Neural Processes Jonathan Gordon W. Bruinsma Andrew Y. K. Foong James Requeima Yann Dubois Richard Turner BDL 53 164 0 29 Oct 2019
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai Zhilin Yang Yiming Yang J. Carbonell Quoc V. Le Ruslan Salakhutdinov VLM 142 3,714 0 09 Jan 2019
Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms Han Xiao Kashif Rasul Roland Vollgraf 178 8,807 0 25 Aug 2017