Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees

7 March 2021

Yujing Wang

Jing Bai

Papers citing "Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees"

48 / 48 papers shown

Title
Using External knowledge to Enhanced PLM for Semantic Matching Min Li Chun Yuan 31 0 0 10 May 2025
Boosting Neural Language Inference via Cascaded Interactive Reasoning Min Li Chun Yuan ReLM LRM 43 0 0 10 May 2025
Comateformer: Combined Attention Transformer for Semantic Sentence Matching Bo Li Di Liang Zixin Zhang 67 2 0 10 Dec 2024
Leveraging Grammar Induction for Language Understanding and Generation Jushi Kai Shengyuan Hou Yusheng Huang Zhouhan Lin 18 0 0 07 Oct 2024
On Eliciting Syntax from Language Models via Hashing Yiran Wang Masao Utiyama 41 0 0 05 Oct 2024
Negation Triplet Extraction with Syntactic Dependency and Semantic Consistency Yuchen Shi Deqing Yang Jingping Liu Yanghua Xiao Zongyu Wang Huimin Xu 28 0 0 15 Apr 2024
Knowing Your Nonlinearities: Shapley Interactions Reveal the Underlying Structure of Data Divyansh Singhvi Andrej Erkelens Raghav Jain Diganta Misra Naomi Saphra 19 0 0 19 Mar 2024
Linguistic Knowledge Can Enhance Encoder-Decoder Models (If You Let It) Alessio Miaschi F. Dell’Orletta Giulia Venturi 47 0 0 27 Feb 2024
Tree-Planted Transformers: Unidirectional Transformer Language Models with Implicit Syntactic Supervision Ryosuke Yoshida Taiga Someya Yohei Oseki 34 0 0 20 Feb 2024
ConcEPT: Concept-Enhanced Pre-Training for Language Models Xintao Wang Zhouhong Gu Jiaqing Liang Dakuan Lu Yanghua Xiao Wei Wang 29 1 0 11 Jan 2024
Combining EEG and NLP Features for Predicting Students' Lecture Comprehension using Ensemble Classification Phantharach Natnithikarat Theerawit Wilaiprasitporn Supavit Kongwudhikunakorn 8 1 0 18 Nov 2023
DACBERT: Leveraging Dependency Agreement for Cost-Efficient Bert Pretraining Martin Kuo Jianyi Zhang Yiran Chen 19 2 0 08 Nov 2023
Fusing Temporal Graphs into Transformers for Time-Sensitive Question Answering Xin Su Phillip Howard Nagib Hakim Steven Bethard 32 3 0 30 Oct 2023
Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models Raymond Li Gabriel Murray Giuseppe Carenini MoE 41 2 0 24 Oct 2023
CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks Hoang Nguyen Ye Liu Chenwei Zhang Tao Zhang Philip S. Yu LRM 24 13 0 23 Oct 2023
Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language Pre-training Yuxuan Wang Jianghui Wang Dongyan Zhao Zilong Zheng 26 4 0 30 May 2023
Semantic Composition in Visually Grounded Language Models Rohan Pandey CoGe 16 1 0 15 May 2023
CSED: A Chinese Semantic Error Diagnosis Corpus Bo Sun Baoxin Wang Yixuan Wang Wanxiang Che Dayong Wu Shijin Wang Ting Liu 35 4 0 09 May 2023
Summarizing Multiple Documents with Conversational Structure for Meta-Review Generation Miao Li Eduard H. Hovy Jey Han Lau 36 14 0 02 May 2023
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model Hao Fei Shengqiong Wu Jingye Li Bobo Li Fei Li Libo Qin Meishan Zhang M. Zhang Tat-Seng Chua 26 76 0 13 Apr 2023
Do Transformers Parse while Predicting the Masked Word? Haoyu Zhao A. Panigrahi Rong Ge Sanjeev Arora 76 31 0 14 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 26 27 0 14 Mar 2023
Dual Path Modeling for Semantic Matching by Perceiving Subtle Conflicts Chao Xue Di Liang Sirui Wang Wei Yu Wu Jing Zhang 10 9 0 24 Feb 2023
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 24 3 0 27 Dec 2022
Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment Rohan Pandey Rulin Shao Paul Pu Liang Ruslan Salakhutdinov Louis-Philippe Morency 21 12 0 20 Dec 2022
Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledge Y. Li Jiaoyan Chen Yinghui Li Tianyu Yu Xi Chen Haitao Zheng 14 14 0 20 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 24 121 0 11 Nov 2022
Not Just Plain Text! Fuel Document-Level Relation Extraction with Explicit Syntax Refinement and Subsentence Modeling Zhichao Duan Xiuxing Li Zhenyu Li Zhuo Wang Jianyong Wang 16 6 0 10 Nov 2022
Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models Xiaoman Pan Wenlin Yao Hongming Zhang Dian Yu Dong Yu Jianshu Chen KELM 193 22 0 28 Oct 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 19 13 0 21 Oct 2022
Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion Jian Song Di Liang Rumei Li Yun Li Sirui Wang Minlong Peng Wei Yu Wu Yongxin Yu 27 12 0 16 Oct 2022
DABERT: Dual Attention Enhanced BERT for Semantic Matching Sirui Wang Di Liang Jian Song Yun Li Wei Yu Wu 44 18 0 07 Oct 2022
Syntax-driven Data Augmentation for Named Entity Recognition Arie Pratama Sutiono Gus Hahn-Powell 22 4 0 15 Aug 2022
Improving Pre-trained Language Models with Syntactic Dependency Prediction Task for Chinese Semantic Error Recognition Bo Sun Baoxin Wang Wanxiang Che Dayong Wu Zhigang Chen Ting Liu 24 0 0 15 Apr 2022
Lite Unified Modeling for Discriminative Reading Comprehension Yilin Zhao Hai Zhao Libin Shen Yinggong Zhao 23 2 0 26 Mar 2022
Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale Laurent Sartran Samuel Barrett A. Kuncoro Milovs Stanojević Phil Blunsom Chris Dyer 47 49 0 01 Mar 2022
A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models Da Yin Li Dong Hao Cheng Xiaodong Liu Kai-Wei Chang Furu Wei Jianfeng Gao KELM 27 34 0 17 Feb 2022
Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling Jakob Prange Nathan Schneider Lingpeng Kong 22 9 0 15 Dec 2021
Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation Raymond Li Wen Xiao Linzi Xing Lanjun Wang Gabriel Murray Giuseppe Carenini ViT 25 7 0 10 Dec 2021
Discontinuous Grammar as a Foreign Language Daniel Fernández-González Carlos Gómez-Rodríguez 50 9 0 20 Oct 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 21 45 0 16 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 30 5 0 01 Oct 2021
Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations Ekaterina Taktasheva Vladislav Mikhailov Ekaterina Artemova 16 13 0 28 Sep 2021
Dependency Parsing with Bottom-up Hierarchical Pointer Networks Daniel Fernández-González Carlos Gómez-Rodríguez 26 13 0 20 May 2021
Improving BERT Pretraining with Syntactic Supervision Georgios Tziafas Konstantinos Kogkalidis G. Wijnholds M. Moortgat 30 3 0 21 Apr 2021
Should Semantic Vector Composition be Explicit? Can it be Linear? Dominic Widdows Kristen Howell T. Cohen CoGe 11 3 0 13 Apr 2021
Multitask Pointer Network for Multi-Representational Parsing Daniel Fernández-González Carlos Gómez-Rodríguez 32 24 0 21 Sep 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,956 0 20 Apr 2018