A Non-Linear Structural Probe

A Non-Linear Structural Probe

21 May 2021

Jennifer C. White

Papers citing "A Non-Linear Structural Probe"

14 / 14 papers shown

Title
Linguistic Interpretability of Transformer-based Language Models: a systematic review Miguel López-Otal Jorge Gracia Jordi Bernad Carlos Bobed Lucía Pitarch-Ballesteros Emma Anglés-Herrero VLM 86 1 0 09 Apr 2025
Pareto Probing: Trading Off Accuracy for Complexity Tiago Pimentel Naomi Saphra Adina Williams Ryan Cotterell 46 60 0 05 Oct 2020
A Tale of a Probe and a Parser Rowan Hall Maudslay Josef Valvoda Tiago Pimentel Adina Williams Ryan Cotterell 43 55 0 04 May 2020
A Matter of Framing: The Impact of Linguistic Formalism on Probing Results Ilia Kuznetsov Iryna Gurevych 37 26 0 30 Apr 2020
Information-Theoretic Probing with Minimum Description Length Elena Voita Ivan Titov 71 274 0 27 Mar 2020
Designing and Interpreting Probes with Control Tasks John Hewitt Percy Liang 58 536 0 08 Sep 2019
Visualizing and Measuring the Geometry of BERT Andy Coenen Emily Reif Ann Yuan Been Kim Adam Pearce F. Viégas Martin Wattenberg MILM 76 417 0 06 Jun 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned Elena Voita David Talbot F. Moiseev Rico Sennrich Ivan Titov 106 1,134 0 23 May 2019
Understanding Learning Dynamics Of Language Models with SVCCA Naomi Saphra Adam Lopez 60 94 0 01 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.6K 94,511 0 11 Oct 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 196 11,542 0 15 Feb 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 651 130,942 0 12 Jun 2017
Understanding intermediate layers using linear classifier probes Guillaume Alain Yoshua Bengio FAtt 139 941 0 05 Oct 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 2.1K 193,426 0 10 Dec 2015