ResearchTrend.AI
Constrained belief updates explain geometric structures in transformer representations

Constrained belief updates explain geometric structures in transformer representations

Mateusz Piotrowski
P. Riechers
Daniel Filan
A. Shai
ArXivPDFHTML

Papers citing "Constrained belief updates explain geometric structures in transformer representations"

3 / 3 papers shown
Title
Transformers represent belief state geometry in their residual stream
Transformers represent belief state geometry in their residual stream
A. Shai
Sarah E. Marzen
Lucas Teixeira
Alexander Gietelink Oldenziel
P. Riechers
AI4CE
51
15
0
24 May 2024
Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models
Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models
Samuel Marks
Can Rager
Eric J. Michaud
Yonatan Belinkov
David Bau
Aaron Mueller
131
151
0
28 Mar 2024
Attention Is All You Need
Attention Is All You Need
Ashish Vaswani
Noam M. Shazeer
Niki Parmar
Jakob Uszkoreit
Llion Jones
Aidan Gomez
Lukasz Kaiser
Illia Polosukhin
3DV
701
131,652
0
12 Jun 2017

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.