Probing for Incremental Parse States in Autoregressive Language Models

Probing for Incremental Parse States in Autoregressive Language Models

17 November 2022

Tiwalayo Eisape

Vineet Gangireddy

Papers citing "Probing for Incremental Parse States in Autoregressive Language Models"

12 / 12 papers shown

Title
A polar coordinate system represents syntax in large language models Pablo Diego-Simón Stéphane DÁscoli Emmanuel Chemla Yair Lakretz J. King LLMSV 65 0 0 07 Dec 2024
When Only Time Will Tell: Interpreting How Transformers Process Local Ambiguities Through the Lens of Restart-Incrementality Brielen Madureira Patrick Kahardipraja David Schlangen 33 2 0 20 Feb 2024
SyntaxShap: Syntax-aware Explainability Method for Text Generation Kenza Amara R. Sevastjanova Mennatallah El-Assady 39 2 0 14 Feb 2024
Multipath parsing in the brain Berta Franzluebbers Donald Dunagan Milovs Stanojević Jan Buys John T. Hale 6 0 0 31 Jan 2024
Multilingual Nonce Dependency Treebanks: Understanding how Language Models represent and process syntactic structure David Arps Laura Kallmeyer Younes Samih Hassan Sajjad 19 1 0 13 Nov 2023
Are Structural Concepts Universal in Transformer Language Models? Towards Interpretable Cross-Lingual Generalization Ningyu Xu Qi Zhang Jingting Ye Menghan Zhang Xuanjing Huang 38 4 0 19 Oct 2023
On the Challenges of Fully Incremental Neural Dependency Parsing Rafał Dreżewski Carlos Gómez-Rodríguez David Vilares CLL 90 1 0 28 Sep 2023
Emergent Linear Representations in World Models of Self-Supervised Sequence Models Neel Nanda Andrew Lee Martin Wattenberg FAtt MILM 40 141 0 02 Sep 2023
Backpack Language Models John Hewitt John Thickstun Christopher D. Manning Percy Liang KELM 11 16 0 26 May 2023
Approximating CKY with Transformers Ghazal Khalighinejad Ollie Liu Sam Wiseman 52 2 0 03 May 2023
Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans Yair Lakretz T. Desbordes Dieuwke Hupkes S. Dehaene 230 11 0 14 Oct 2021
Probing Classifiers: Promises, Shortcomings, and Advances Yonatan Belinkov 226 404 0 24 Feb 2021