The Quarks of Attention

The Quarks of Attention

15 February 2022

Roman Vershynin

Papers citing "The Quarks of Attention"

5 / 5 papers shown

Title
Implicit Bias and Fast Convergence Rates for Self-attention Bhavya Vasudeva Puneesh Deora Christos Thrampoulidis 39 15 0 08 Feb 2024
Inductive biases in deep learning models for weather prediction Jannik Thümmel Matthias Karlbauer S. Otte C. Zarfl Georg Martius ... Thomas Scholten Ulrich Friedrich V. Wulfmeyer B. Goswami Martin Volker Butz AI4CE 46 6 0 06 Apr 2023
Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformers Alexander Shmakov A. Yankelevich Jianming Bian Pierre Baldi BDL ViT 21 1 0 10 Mar 2023
Permutationless Many-Jet Event Reconstruction with Symmetry Preserving Attention Networks M. Fenton Alexander Shmakov Ta-Wei Ho S. Hsu D. Whiteson Pierre Baldi 41 37 0 19 Oct 2020
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,929 0 17 Aug 2015