ResearchTrend.AI
Dynamic metastability in the self-attention model

Dynamic metastability in the self-attention model

Borjan Geshkovski
Hugo Koubbi
Yury Polyanskiy
Philippe Rigollet
ArXiv (abs)PDFHTML

Papers citing "Dynamic metastability in the self-attention model"

3 / 3 papers shown
Title
Quantitative Clustering in Mean-Field Transformer Models
Quantitative Clustering in Mean-Field Transformer Models
Shi Chen
Zhengjiang Lin
Yury Polyanskiy
Philippe Rigollet
95
2
0
20 Apr 2025
The Geometry of Tokens in Internal Representations of Large Language Models
The Geometry of Tokens in Internal Representations of Large Language Models
Karthik Viswanathan
Yuri Gardinazzi
Giada Panerai
Alberto Cazzaniga
Matteo Biagetti
AIFin
143
7
0
17 Jan 2025
Emergence of meta-stable clustering in mean-field transformer models
Emergence of meta-stable clustering in mean-field transformer models
Giuseppe Bruno
Federico Pasqualotto
Andrea Agazzi
109
9
0
30 Oct 2024

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.