v1v2v3 (latest)

NEZHA: Neural Contextualized Representation for Chinese Language Understanding

31 August 2019

Xin Jiang

Qun Liu

Papers citing "NEZHA: Neural Contextualized Representation for Chinese Language Understanding"

44 / 44 papers shown

Title
Acoustic Model Optimization over Multiple Data Sources: Merging and Valuation Victor Junqiu Wei Weicheng Wang Di Jiang Conghui Tan Rongzhong Lian MoMe 96 0 0 21 Oct 2024
FarSSiBERT: A Novel Transformer-based Model for Semantic Similarity Measurement of Persian Social Networks Informal Texts Seyed Mojtaba Sadjadi Zeinab Rajabi Leila Rabiei M. Moin 65 2 0 27 Jul 2024
SOS-1K: A Fine-grained Suicide Risk Classification Dataset for Chinese Social Media Analysis Hongzhi Qi Hanfei Liu Jianqiang Li Qing Zhao Wei-dong Zhai Dan Luo Tianyu He Shuo Liu Bing Xiang Yang Guanghui Fu 96 1 0 19 Apr 2024
Chinese Sequence Labeling with Semi-Supervised Boundary-Aware Language Model Pre-training Longhui Zhang Dingkun Long Meishan Zhang Yanzhao Zhang Pengjun Xie Min Zhang 81 3 0 08 Apr 2024
MRC-based Nested Medical NER with Co-prediction and Adaptive Pre-training Xiaojing Du Hanjie Zhao Danyan Xing Yuxiang Jia Hongying Zan 58 6 0 23 Mar 2024
Vygotsky Distance: Measure for Benchmark Task Similarity Maxim K. Surkov Ivan P. Yamshchikov 89 0 0 22 Feb 2024
Unleashing the power of Neural Collapse for Transferability Estimation Yuhe Ding Bo Jiang Lijun Sheng Aihua Zheng Jian Liang CVBM 87 1 0 09 Oct 2023
WYWEB: A NLP Evaluation Benchmark For Classical Chinese Bo Zhou Qianglong Chen Tianyu Wang Xiaoshi Zhong Yin Zhang ELM 119 10 0 23 May 2023
A Simple and Plug-and-play Method for Unsupervised Sentence Representation Enhancement Lingfeng Shen Haiyun Jiang Lemao Liu Shuming Shi 35 1 0 13 May 2023
GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmark Dongyang Li Ruixue Ding Qiang-Wei Zhang Zheng Li Boli Chen ... Yao Xu Xin Li Ning Guo Fei Huang Xiaofeng He ELM VLM 65 6 0 11 May 2023
Address Matching Based On Hierarchical Information Chengxia Zhang Jintao Tang Ting Wang Shasha Li 48 0 0 10 May 2023
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation Anchun Gui Han Xiao 60 5 0 08 May 2023
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey Tianlin Li Guangyao Chen Guangwu Qian Pengcheng Gao Xiaoyong Wei Yaowei Wang Yonghong Tian Wen Gao AI4CE VLM 160 216 0 20 Feb 2023
Recall, Expand and Multi-Candidate Cross-Encode: Fast and Accurate Ultra-Fine Entity Typing Chengyue Jiang Wenyang Hui Yong Jiang Xiaobin Wang Pengjun Xie Kewei Tu 86 4 0 18 Dec 2022
Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling Peijie Jiang Dingkun Long Yanzhao Zhang Pengjun Xie Meishan Zhang Hao Fei SSL 53 13 0 27 Oct 2022
Better Pre-Training by Reducing Representation Confusion Haojie Zhang Mingfei Liang Ruobing Xie Zhen Sun Bo Zhang Leyu Lin 49 2 0 09 Oct 2022
Domain-Specific NER via Retrieving Correlated Samples Xin Zhang Yong Jiang Xiaobin Wang Xuming Hu Yueheng Sun Pengjun Xie Meishan Zhang 134 15 0 27 Aug 2022
FL-Tuning: Layer Tuning for Feed-Forward Network in Transformer Jingping Liu Yuqiu Song Kui Xue Hongli Sun Chao Wang Lihan Chen Haiyun Jiang Jiaqing Liang Tong Ruan 74 2 0 30 Jun 2022
Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding Abbas Ghaddar Yimeng Wu Sunyam Bagga Ahmad Rashid Khalil Bibi ... Zhefeng Wang Baoxing Huai Xin Jiang Qun Liu Philippe Langlais 65 7 0 21 May 2022
Improving Tokenisation by Alternative Treatment of Spaces Edward Gow-Smith Harish Tayyar Madabushi Carolina Scarton Aline Villavicencio 89 21 0 08 Apr 2022
Sparse-softmax: A Simpler and Faster Alternative Softmax Transformation Shaoshi Sun Zhenyuan Zhang B. Huang Pengbin Lei Jianlin Su Shengfeng Pan Jiarun Cao UQCV 52 8 0 23 Dec 2021
Hierarchical Cross-Modality Semantic Correlation Learning Model for Multimodal Summarization Litian Zhang Xiaoming Zhang Junshu Pan Feiran Huang 66 48 0 16 Dec 2021
JABER and SABER: Junior and Senior Arabic BERt Abbas Ghaddar Yimeng Wu Ahmad Rashid Khalil Bibi Mehdi Rezagholizadeh ... Zhefeng Wang Baoxing Huai Xin Jiang Qun Liu Philippe Langlais 55 5 0 08 Dec 2021
Mengzi: Towards Lightweight yet Ingenious Pre-trained Models for Chinese Zhuosheng Zhang Hanqing Zhang Keming Chen Yuhang Guo Jingyun Hua Yulong Wang Ming Zhou VLM 110 72 0 13 Oct 2021
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation Yunfan Shao Zhichao Geng Yitao Liu Junqi Dai Hang Yan Fei Yang Li Zhe Hujun Bao Xipeng Qiu MedIm 148 151 0 13 Sep 2021
NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction Yi Sun Yu Zheng Chao Hao Hangping Qiu VLM 107 37 0 08 Sep 2021
An Effective System for Multi-format Information Extraction Yaduo Liu Longhui Zhang Shujuan Yin Xiaofeng Zhao Feiliang Ren 42 1 0 16 Aug 2021
FewCLUE: A Chinese Few-shot Learning Evaluation Benchmark Liang Xu Xiaojing Lu Chenyang Yuan Xuanwei Zhang Huilin Xu ... Guoao Wei X. Pan Xin Tian Libo Qin Hai Hu ELM 99 57 0 15 Jul 2021
Multi-Task Learning based Online Dialogic Instruction Detection with Pre-trained Language Models Y. Hao Hang Li Wenbiao Ding Zhongqin Wu Jiliang Tang R. Luckin Zitao Liu 39 2 0 15 Jul 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 177 863 0 14 Jun 2021
Sub-Character Tokenization for Chinese Pretrained Language Models Chenglei Si Zhengyan Zhang Yingfa Chen Fanchao Qi Xiaozhi Wang Zhiyuan Liu Yasheng Wang Qun Liu Maosong Sun 53 12 0 01 Jun 2021
ZEN 2.0: Continue Training and Adaption for N-gram Enhanced Text Encoders Yan Song Tong Zhang Yonggang Wang Kai-Fu Lee 97 45 0 04 May 2021
PanGu- $α$ : Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation Wei Zeng Xiaozhe Ren Teng Su Hui Wang Yi-Lun Liao ... Gaojun Fan Yaowei Wang Xuefeng Jin Qun Liu Yonghong Tian ALM MoE AI4CE 80 215 0 26 Apr 2021
RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su Yu Lu Shengfeng Pan Ahmed Murtadha Bo Wen Yunfeng Liu 376 2,552 0 20 Apr 2021
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models Yuxuan Lai Yijia Liu Yansong Feng Songfang Huang Dongyan Zhao VLM AI4CE 70 38 0 15 Apr 2021
Training Multilingual Pre-trained Language Model with Byte-level Subwords Junqiu Wei Qun Liu Yinpeng Guo Xin Jiang 63 20 0 23 Jan 2021
Censorship of Online Encyclopedias: Implications for NLP Models Eddie Yang Margaret E. Roberts 43 16 0 22 Jan 2021
CPM: A Large-scale Generative Chinese Pre-trained Language Model Zhengyan Zhang Xu Han Hao Zhou Pei Ke Yuxian Gu ... Wentao Han Jie Tang Juan-Zi Li Xiaoyan Zhu Maosong Sun 74 119 0 01 Dec 2020
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding Dongling Xiao Yukun Li Han Zhang Yu Sun Hao Tian Hua Wu Haifeng Wang 29 39 0 23 Oct 2020
Neural Multi-Task Learning for Teacher Question Detection in Online Classrooms Gale Yan Huang Jiahao Chen Haochen Liu Weiping Fu Wenbiao Ding Jiliang Tang Songfan Yang Guoliang Li Zitao Liu 24 10 0 16 May 2020
Revisiting Pre-Trained Models for Chinese Natural Language Processing Yiming Cui Wanxiang Che Ting Liu Bing Qin Shijin Wang Guoping Hu 104 706 0 29 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 419 1,500 0 18 Mar 2020
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations Shizhe Diao Jiaxin Bai Yan Song Tong Zhang Yonggang Wang AI4CE 70 136 0 02 Nov 2019
Pre-Training with Whole Word Masking for Chinese BERT Yiming Cui Wanxiang Che Ting Liu Bing Qin Ziqing Yang 55 186 0 19 Jun 2019