Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction

30 January 2020

Papers citing "Are Pre-trained Language Models Aware of Phrases? Simple but Strong Baselines for Grammar Induction"

32 / 32 papers shown

Title
A Critical Analysis of Biased Parsers in Unsupervised Parsing Chris Dyer Gábor Melis Phil Blunsom 30 23 0 20 Sep 2019
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddings Kawin Ethayarajh 59 858 0 02 Sep 2019
Visualizing and Understanding the Effectiveness of BERT Y. Hao Li Dong Furu Wei Ke Xu 104 183 0 15 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 419 24,160 0 26 Jul 2019
Inducing Syntactic Trees from BERT Representations Rudolf Rosa David Marecek MILM 15 22 0 27 Jun 2019
Compound Probabilistic Context-Free Grammars for Grammar Induction Yoon Kim Chris Dyer Alexander M. Rush 37 152 0 24 Jun 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 183 8,386 0 19 Jun 2019
What Does BERT Look At? An Analysis of BERT's Attention Kevin Clark Urvashi Khandelwal Omer Levy Christopher D. Manning MILM 189 1,586 0 11 Jun 2019
Visually Grounded Neural Syntax Acquisition Freda Shi Jiayuan Mao Kevin Gimpel Karen Livescu NAI 41 84 0 07 Jun 2019
An Imitation Learning Approach to Unsupervised Parsing Bowen Li Lili Mou Frank Keller 40 24 0 05 Jun 2019
From Balustrades to Pierre Vinken: Looking for Syntax in Transformer Self-Attentions David Marecek Rudolf Rosa 42 52 0 05 Jun 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned Elena Voita David Talbot F. Moiseev Rico Sennrich Ivan Titov 76 1,120 0 23 May 2019
Unsupervised Recurrent Neural Network Grammars Yoon Kim Alexander M. Rush Lei Yu A. Kuncoro Chris Dyer Gábor Melis LRM RALM SSL 44 115 0 07 Apr 2019
Unsupervised Latent Tree Induction with Deep Inside-Outside Recursive Autoencoders Andrew Drozdov Pat Verga Mohit Yadav Mohit Iyyer Andrew McCallum 30 123 0 03 Apr 2019
Linguistic Knowledge and Transferability of Contextual Representations Nelson F. Liu Matt Gardner Yonatan Belinkov Matthew E. Peters Noah A. Smith 97 728 0 21 Mar 2019
Cooperative Learning of Disjoint Syntax and Semantics Serhii Havrylov Germán Kruszewski Armand Joulin 35 48 0 25 Feb 2019
Assessing BERT's Syntactic Abilities Yoav Goldberg 58 494 0 16 Jan 2019
Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks Songlin Yang Shawn Tan Alessandro Sordoni Aaron Courville 95 324 0 22 Oct 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.1K 93,936 0 11 Oct 2018
Straight to the Tree: Constituency Parsing with Neural Syntactic Distance Songlin Yang Zhouhan Lin Athul Paul Jacob Alessandro Sordoni Aaron Courville Yoshua Bengio 39 91 0 11 Jun 2018
Constituency Parsing with a Self-Attentive Encoder Nikita Kitaev Dan Klein 56 537 0 02 May 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 692 7,080 0 20 Apr 2018
ListOps: A Diagnostic Dataset for Latent Tree Learning Nikita Nangia Samuel R. Bowman 36 136 0 17 Apr 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 125 11,520 0 15 Feb 2018
Neural Language Modeling by Jointly Learning Syntax and Lexicon Songlin Yang Zhouhan Lin Chin-Wei Huang Aaron Courville 55 178 0 02 Nov 2017
Learning to Compose Task-Specific Tree Structures Jihun Choi Kang Min Yoo Sang-goo Lee 57 189 0 10 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 494 129,831 0 12 Jun 2017
Jointly Learning Sentence Embeddings and Syntax with Unsupervised Tree-LSTMs Jean Maillard S. Clark Dani Yogatama 49 87 0 25 May 2017
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 426 4,444 0 18 Apr 2017
Learning to Compose Words into Sentences with Reinforcement Learning Dani Yogatama Phil Blunsom Chris Dyer Edward Grefenstette Wang Ling NAI 50 158 0 28 Nov 2016
Recurrent Neural Network Grammars Chris Dyer A. Kuncoro Miguel Ballesteros Noah A. Smith GNN 79 524 0 25 Feb 2016
Adam: A Method for Stochastic Optimization Diederik P. Kingma Jimmy Ba ODL 970 149,474 0 22 Dec 2014