v1v2 (latest)

Characterizing Intrinsic Compositionality in Transformers with Tree Projections

2 November 2022

Shikhar Murty

Pratyusha Sharma

Jacob Andreas

Christopher D. Manning

ArXiv (abs)PDF HTML

Papers citing "Characterizing Intrinsic Compositionality in Transformers with Tree Projections"

22 / 22 papers shown

Title
Sneaking Syntax into Transformer Language Models with Tree Regularization Ananjan Nandi Christopher D. Manning Shikhar Murty 121 0 0 28 Nov 2024
Geometric Signatures of Compositionality Across a Language Model's Lifetime Jin Hwa Lee Thomas Jiralerspong Lei Yu Yoshua Bengio Emily Cheng CoGe 173 4 0 02 Oct 2024
Physics of Language Models: Part 1, Learning Hierarchical Language Structures Zeyuan Allen-Zhu Yuanzhi Li 108 21 0 23 May 2023
Revisiting the Compositional Generalization Abilities of Neural Sequence Models Arkil Patel S. Bhattamishra Phil Blunsom Navin Goyal BDL CoGe 68 32 0 14 Mar 2022
COGS: A Compositional Generalization Challenge Based on Semantic Interpretation Najoung Kim Tal Linzen CoGe 48 281 0 12 Oct 2020
Assessing Phrasal Representation and Composition in Transformers Lang-Chi Yu Allyson Ettinger CoGe 82 67 0 08 Oct 2020
Beyond Accuracy: Behavioral Testing of NLP models with CheckList Marco Tulio Ribeiro Tongshuang Wu Carlos Guestrin Sameer Singh ELM 210 1,107 0 08 May 2020
Measuring Compositionality in Representation Learning Jacob Andreas CoGe 76 149 0 19 Feb 2019
RNNs Implicitly Implement Tensor Product Representations R. Thomas McCoy Tal Linzen Ewan Dunbar P. Smolensky 72 54 0 20 Dec 2018
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks Songlin Yang Shawn Tan Alessandro Sordoni Aaron Courville 126 324 0 22 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018
Targeted Syntactic Evaluation of Language Models Rebecca Marvin Tal Linzen 81 416 0 27 Aug 2018
Improving Text-to-SQL Evaluation Methodology Catherine Finegan-Dollak Jonathan K. Kummerfeld Li Zhang Karthik Ramanathan Sesh Sadasivam Rui Zhang Dragomir R. Radev 83 279 0 23 Jun 2018
Finding Syntax in Human Encephalography with Beam Search John T. Hale Chris Dyer A. Kuncoro Jonathan Brennan 78 135 0 11 Jun 2018
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 786 132,363 0 12 Jun 2017
A Minimal Span-Based Neural Constituency Parser Mitchell Stern Jacob Andreas Dan Klein 74 198 0 10 May 2017
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies Tal Linzen Emmanuel Dupoux Yoav Goldberg 106 906 0 04 Nov 2016
Recurrent Neural Network Grammars Chris Dyer A. Kuncoro Miguel Ballesteros Noah A. Smith GNN 95 527 0 25 Feb 2016
Neural Module Networks Jacob Andreas Marcus Rohrbach Trevor Darrell Dan Klein CoGe 139 1,076 0 09 Nov 2015
Domain-Adversarial Training of Neural Networks Yaroslav Ganin E. Ustinova Hana Ajakan Pascal Germain Hugo Larochelle François Laviolette M. Marchand Victor Lempitsky GAN OOD 390 9,515 0 28 May 2015
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks Kai Sheng Tai R. Socher Christopher D. Manning AIMat 144 3,122 0 28 Feb 2015
Domain Generalization via Invariant Feature Representation Krikamol Muandet David Balduzzi Bernhard Schölkopf OOD 142 1,185 0 10 Jan 2013