Dict-BERT: Enhancing Language Model Pre-training with Dictionary

Dict-BERT: Enhancing Language Model Pre-training with Dictionary

13 October 2021

Meng-Long Jiang

Papers citing "Dict-BERT: Enhancing Language Model Pre-training with Dictionary"

17 / 17 papers shown

Title
Threshold Filtering Packing for Supervised Fine-Tuning: Training Related Samples within Packs Jiancheng Dong Lei Jiang Wei Jin Lu Cheng 36 1 0 18 Aug 2024
CHEW: A Dataset of CHanging Events in Wikipedia Hsuvas Borkakoty Luis Espinosa-Anke 37 1 0 27 Jun 2024
Unified Representation for Non-compositional and Compositional Expressions Ziheng Zeng Suma Bhat 17 3 0 29 Oct 2023
Teaching the Pre-trained Model to Generate Simple Texts for Text Simplification Renliang Sun Wei-ping Xu Xiaojun Wan CLL 16 16 0 21 May 2023
ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain Mike Zhang Rob van der Goot Barbara Plank 16 14 0 20 May 2023
Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translation Alex Jones Isaac Caswell Ishan Saxena Orhan Firat 21 8 0 27 Mar 2023
Detecting Euphemisms with Literal Descriptions and Visual Imagery .Ilker Kesen Aykut Erdem Erkut Erdem Iacer Calixto 29 4 0 08 Nov 2022
Prompt Combines Paraphrase: Teaching Pre-trained Models to Understand Rare Biomedical Words Hao Wang Chi-Liang Liu Nuwa Xi Sendong Zhao Meizhi Ju Shiwei Zhang Ziheng Zhang Yefeng Zheng Bing Qin Ting Liu VLM AAML LM&MA 41 6 0 14 Sep 2022
Learning Better Masking for Better Language Model Pre-training Dongjie Yang Zhuosheng Zhang Hai Zhao 24 15 0 23 Aug 2022
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning Qianglong Chen Feng-Lin Li Guohai Xu Ming Yan Ji Zhang Yin Zhang 29 22 0 01 Aug 2022
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts W. Yu Chenguang Zhu Lianhui Qin Zhihan Zhang Tong Zhao Meng-Long Jiang LRM 20 31 0 14 Mar 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP Yulong Chen Yang Liu Li Dong Shuohang Wang Chenguang Zhu Michael Zeng Yue Zhang VLM 27 45 0 10 Feb 2022
Lacking the embedding of a word? Look it up into a traditional dictionary Elena Sofia Ruzzetti Leonardo Ranaldi Michele Mastromattei Francesca Fallucchi Fabio Massimo Zanzotto 36 15 0 24 Sep 2021
Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation Leyang Cui Yu-Huan Wu Shujie Liu Yue Zhang 75 22 0 12 Sep 2021
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,450 0 18 Mar 2020
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 231 778 0 17 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 297 6,956 0 20 Apr 2018