Exploring the Space of Key-Value-Query Models with Intention

17 May 2023

Papers citing "Exploring the Space of Key-Value-Query Models with Intention"

7 / 7 papers shown

Title
Ordinary Least Squares as an Attention Mechanism Philippe Goulet Coulombe 26 0 0 13 Apr 2025
Translation Equivariant Transformer Neural Processes Matthew Ashman Cristiana-Diana Diaconu Junhyuck Kim Lakee Sivaraya Stratis Markou James Requeima W. Bruinsma Richard E. Turner 46 4 0 18 Jun 2024
Uncovering mesa-optimization algorithms in Transformers J. Oswald Eyvind Niklasson Maximilian Schlegel Seijin Kobayashi Nicolas Zucchet ... Mark Sandler Blaise Agüera y Arcas Max Vladymyrov Razvan Pascanu João Sacramento 26 53 0 11 Sep 2023
What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization Yufeng Zhang Fengzhuo Zhang Zhuoran Yang Zhaoran Wang BDL 36 62 0 30 May 2023
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks Chelsea Finn Pieter Abbeel Sergey Levine OOD 338 11,684 0 09 Mar 2017
Input Convex Neural Networks Brandon Amos Lei Xu J. Zico Kolter 187 599 0 22 Sep 2016
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 218 7,926 0 17 Aug 2015