StructFormer: Joint Unsupervised Induction of Dependency and
Constituency Structure from Masked Language Modeling

StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling

1 December 2020

Aaron Courville

Papers citing "StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling"

12 / 12 papers shown

Title
Findings of the BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora Alex Warstadt Aaron Mueller Leshem Choshen E. Wilcox Chengxu Zhuang ... Rafael Mosquera Bhargavi Paranjape Adina Williams Tal Linzen Ryan Cotterell 43 108 0 10 Apr 2025
Improving Unsupervised Constituency Parsing via Maximizing Semantic Information Junjie Chen Xiangheng He Yusuke Miyao Danushka Bollegala 43 0 0 03 Oct 2024
Punctuation Restoration Improves Structure Understanding Without Supervision Junghyun Min Minho Lee Woochul Lee Yeonsoo Lee 62 1 0 13 Feb 2024
Augmenting Transformers with Recursively Composed Multi-grained Representations Xiang Hu Qingyang Zhu Kewei Tu Wei Wu 29 3 0 28 Sep 2023
Unsupervised Chunking with Hierarchical RNN Zijun Wu Anup Anand Deshmukh Yongkang Wu Jimmy Lin Lili Mou 34 3 0 10 Sep 2023
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model Hao Fei Shengqiong Wu Jingye Li Bobo Li Fei Li Libo Qin Meishan Zhang Hao Fei Tat-Seng Chua 26 76 0 13 Apr 2023
A Multi-Grained Self-Interpretable Symbolic-Neural Model For Single/Multi-Labeled Text Classification Xiang Hu Xinyu Kong Kewei Tu MILM BDL 31 5 0 06 Mar 2023
Dynamic Programming in Rank Space: Scaling Structured Inference with Low-Rank HMMs and PCFGs Aaron Courville Wei Liu Kewei Tu 21 8 0 01 May 2022
Dependency-based Mixture Language Models Zhixian Yang Xiaojun Wan 49 2 0 19 Mar 2022
Fast-R2D2: A Pretrained Recursive Neural Network based on Pruned CKY for Grammar Induction and Text Representation Xiang Hu Haitao Mi Liang Li Gerard de Melo 29 13 0 01 Mar 2022
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments Yu Zhang Qingrong Xia Shilin Zhou Yong-jia Jiang Guohong Fu Min Zhang 43 27 0 13 Oct 2021
Cooperative Self-training of Machine Reading Comprehension Hongyin Luo Shang-Wen Li Ming Gao Seunghak Yu James R. Glass SyDa RALM 15 11 0 12 Mar 2021