Phase Transitions in the Output Distribution of Large Language Models

27 May 2024

Papers citing "Phase Transitions in the Output Distribution of Large Language Models"

5 / 5 papers shown

Title
Fast Detection of Phase Transitions with Multi-Task Learning-by-Confusion Julian Arnold Frank Schafer Niels Lörch 20 5 0 15 Nov 2023
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small Kevin Wang Alexandre Variengien Arthur Conmy Buck Shlegeris Jacob Steinhardt 212 497 0 01 Nov 2022
Omnigrok: Grokking Beyond Algorithmic Data Ziming Liu Eric J. Michaud Max Tegmark 56 77 0 03 Oct 2022
Learning entanglement breakdown as a phase transition by confusion M. A. Gavreev A. S. Mastiukova E. Kiktenko A. Fedorov 24 9 0 01 Feb 2022
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 264 4,489 0 23 Jan 2020