ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations

2 November 2019

Shizhe Diao

Jiaxin Bai

Yan Song

Tong Zhang

Yonggang Wang

AI4CE

ArXiv PDF HTML

Papers citing "ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations"

21 / 21 papers shown

Title
N-Gram Unsupervised Compoundation and Feature Injection for Better Symbolic Music Understanding Jinhao Tian Zuchao Li Jiajia Li Ping Wang 30 3 0 13 Dec 2023
ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferences Yuanhe Tian Ruyi Gan Yan Song Jiaxing Zhang Yongdong Zhang AI4MH AI4CE LM&MA 31 31 0 10 Nov 2023
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories Shizhe Diao Tianyang Xu Ruijia Xu Jiawei Wang Tong Zhang MoE AI4CE 13 36 0 08 Jun 2023
Active Prompting with Chain-of-Thought for Large Language Models Shizhe Diao Pengcheng Wang Yong Lin Tong Zhang ReLM KELM LLMAG LRM 41 122 0 23 Feb 2023
Model Agnostic Sample Reweighting for Out-of-Distribution Learning Xiao Zhou Yong Lin Renjie Pi Weizhong Zhang Renzhe Xu Peng Cui Tong Zhang OODD 44 61 0 24 Jan 2023
Improved Target-specific Stance Detection on Social Media Platforms by Delving into Conversation Threads Yupeng Li Haorui He Shaonan Wang F. Lau Yunya Song 34 15 0 06 Nov 2022
Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling Peijie Jiang Dingkun Long Yanzhao Zhang Pengjun Xie Meishan Zhang Hao Fei SSL 30 12 0 27 Oct 2022
VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models Wangchunshu Zhou Yan Zeng Shizhe Diao Xinsong Zhang CoGe VLM 34 13 0 30 May 2022
Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-stage Span Labeling Duc-Vu Nguyen Linh-Bao Vo Ngoc Linh Tran Kiet Van Nguyen Ngan Luu-Thuy Nguyen 16 6 0 17 Dec 2021
Span Labeling Approach for Vietnamese and Chinese Word Segmentation Duc-Vu Nguyen Linh-Bao Vo D. Thin Ngan Luu-Thuy Nguyen 34 3 0 01 Oct 2021
K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering Fu Sun Feng-Lin Li Ruize Wang Qianglong Chen Xingyi Cheng Ji Zhang VLM KELM 41 4 0 22 Sep 2021
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation Yunfan Shao Zhichao Geng Yitao Liu Junqi Dai Hang Yan Fei Yang Li Zhe Hujun Bao Xipeng Qiu MedIm 70 149 0 13 Sep 2021
CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark Ningyu Zhang Mosha Chen Zhen Bi Xiaozhuan Liang Lei Li ... Jun Yan Hongying Zan Kunli Zhang Buzhou Tang Qingcai Chen LM&MA ELM 34 179 0 15 Jun 2021
Generating Radiology Reports via Memory-driven Transformer Zhihong Chen Yan Song Tsung-Hui Chang Xiang Wan MedIm 30 461 0 30 Oct 2020
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding Dongling Xiao Yukun Li Han Zhang Yu Sun Hao Tian Hua Wu Haifeng Wang 27 38 0 23 Oct 2020
N-LTP: An Open-source Neural Language Technology Platform for Chinese Wanxiang Che Yunlong Feng Libo Qin Ting Liu VLM 40 109 0 24 Sep 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 246 1,454 0 18 Mar 2020
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 231 778 0 17 Sep 2019
Knowledge Enhanced Contextual Word Representations Matthew E. Peters Mark Neumann IV RobertL.Logan Roy Schwartz Vidur Joshi Sameer Singh Noah A. Smith 234 656 0 09 Sep 2019
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 261 1,436 0 22 Aug 2019
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Zhehuai Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 718 6,750 0 26 Sep 2016