MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining

17 November 2020

Papers citing "MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining"

7 / 7 papers shown

Title
F-PABEE: Flexible-patience-based Early Exiting for Single-label and Multi-label text Classification Tasks Xiangxiang Gao Wei-wei Zhu Jiasheng Gao Congrui Yin VLM 28 12 0 21 May 2023
Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models Xinnian Liang Zefan Zhou Hui Huang Shuangzhi Wu Tong Xiao Muyun Yang Zhoujun Li Chao Bian VLM 38 2 0 20 Mar 2023
Sub-Character Tokenization for Chinese Pretrained Language Models Chenglei Si Zhengyan Zhang Yingfa Chen Fanchao Qi Xiaozhi Wang Zhiyuan Liu Yasheng Wang Qun Liu Maosong Sun 24 9 0 01 Jun 2021
CMV-BERT: Contrastive multi-vocab pretraining of BERT Wei-wei Zhu Daniel Cheung SSL VLM 19 0 0 29 Dec 2020
AutoRC: Improving BERT Based Relation Classification Models via Architecture Search Wei-wei Zhu Xipeng Qiu Yuan Ni Guotong Xie 24 18 0 22 Sep 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 288 2,023 0 28 Jul 2020
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 231 777 0 17 Sep 2019