ERNIE: Enhanced Representation through Knowledge Integration

19 April 2019

Papers citing "ERNIE: Enhanced Representation through Knowledge Integration"

50 / 360 papers shown

Title
Paramixer: Parameterizing Mixing Links in Sparse Factors Works Better than Dot-Product Self-Attention Tong Yu Ruslan Khalitov Lei Cheng Zhirong Yang MoE 27 10 0 22 Apr 2022
Towards Multi-Turn Empathetic Dialogs with Positive Emotion Elicitation Shihang Wang Xinchao Xu Wenquan Wu Zheng-Yu Niu Hua Wu Haifeng Wang 22 1 0 22 Apr 2022
Identifying and Characterizing Active Citizens who Refute Misinformation in Social Media Yida Mu Pu Niu Nikolaos Aletras 34 12 0 21 Apr 2022
Attention Mechanism based Cognition-level Scene Understanding Xuejiao Tang Tai Le Quy LRM 30 0 0 17 Apr 2022
Improving Pre-trained Language Models with Syntactic Dependency Prediction Task for Chinese Semantic Error Recognition Bo Sun Baoxin Wang Wanxiang Che Dayong Wu Zhigang Chen Ting Liu 24 0 0 15 Apr 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 44 175 0 12 Apr 2022
Improving Tokenisation by Alternative Treatment of Spaces Edward Gow-Smith Harish Tayyar Madabushi Carolina Scarton Aline Villavicencio 37 20 0 08 Apr 2022
A Survey on Dropout Methods and Experimental Verification in Recommendation Yong Li Weizhi Ma C. L. Philip Chen Hao Fei Yiqun Liu Shaoping Ma Yue Yang 33 9 0 05 Apr 2022
Graph Enhanced BERT for Query Understanding Juanhui Li Yao Ma Weizhen Zeng Suqi Cheng Jiliang Tang Shuaiqiang Wang Dawei Yin 26 7 0 03 Apr 2022
Requirements Elicitation in Cognitive Service for Recommendation Bolin Zhang Zhiying Tu Yunzhe Xu Dian-Hui Chu Xiaofei Xu 19 0 0 29 Mar 2022
DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search Engine Yifu Qiu Hongyu Li Yingqi Qu Ying-Cong Chen Qiaoqiao She Jing Liu Hua Wu Haifeng Wang RALM 38 15 0 19 Mar 2022
elBERto: Self-supervised Commonsense Learning for Question Answering Xunlin Zhan Yuan Li Xiao Dong Xiaodan Liang Zhiting Hu Lawrence Carin SSL RALM LRM 24 7 0 17 Mar 2022
Multimodal Learning on Graphs for Disease Relation Extraction Yucong Lin Keming Lu Sheng Yu Tianxi Cai Marinka Zitnik 34 31 0 16 Mar 2022
HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsing Yanzhao Zheng Haibin Wang B. Dong Xingjun Wang Changshan Li 30 32 0 14 Mar 2022
PERT: Pre-training BERT with Permuted Language Model Yiming Cui Ziqing Yang Ting Liu 33 37 0 14 Mar 2022
MarkBERT: Marking Word Boundaries Improves Chinese BERT Linyang Li Yong Dai Duyu Tang Xipeng Qiu Zenglin Xu Shuming Shi VLM 29 11 0 12 Mar 2022
Pretrained Domain-Specific Language Model for General Information Retrieval Tasks in the AEC Domain Zhe Zheng Xingwu Lu Ke Chen Yu-Cheng Zhou Jiaju Lin 25 52 0 09 Mar 2022
A Unified Framework of Medical Information Annotation and Extraction for Chinese Clinical Text Enwei Zhu Qilin Sheng Huan Yang Jinpeng Li 27 8 0 08 Mar 2022
SkillNet-NLU: A Sparsely Activated Model for General-Purpose Natural Language Understanding Fan Zhang Duyu Tang Yong Dai Cong Zhou Shuangzhi Wu Shuming Shi CLL MoE 33 12 0 07 Mar 2022
Vision-Language Intelligence: Tasks, Representation Learning, and Large Models Feng Li Hao Zhang Yi-Fan Zhang Shixuan Liu Jian Guo L. Ni Pengchuan Zhang Lei Zhang AI4TS VLM 24 36 0 03 Mar 2022
Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shots Wenting Zhao Ye Liu Yao Wan Philip S. Yu 23 11 0 01 Mar 2022
"Is Whole Word Masking Always Better for Chinese BERT?": Probing on Chinese Grammatical Error Correction Yong Dai Linyang Li Cong Zhou Zhangyin Feng Enbo Zhao Xipeng Qiu Pijian Li Duyu Tang 25 13 0 01 Mar 2022
MSCTD: A Multimodal Sentiment Chat Translation Dataset Yunlong Liang Fandong Meng Jinan Xu Jinan Xu Jie Zhou 19 21 0 28 Feb 2022
Ask2Mask: Guided Data Selection for Masked Speech Modeling M. Baskar Andrew Rosenberg Bhuvana Ramabhadran Yu Zhang Pedro J. Moreno 20 7 0 24 Feb 2022
StyleBERT: Chinese pretraining by font style information Chao Lv Hang Zhang Xinkai Du Yunhao Zhang Ying Huang Wenhao Li Jia-qi Han Shanshan Gu 25 3 0 21 Feb 2022
TURNER: The Uncertainty-based Retrieval Framework for Chinese NER Zhichao Geng Hang Yan Zhangyue Yin Chen An Xipeng Qiu UQLM 25 6 0 18 Feb 2022
Integrating AI Planning with Natural Language Processing: A Combination of Explicit and Tacit Knowledge Kebing Jin H. Zhuo 36 5 0 15 Feb 2022
What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code Yao Wan Wei-Ye Zhao Hongyu Zhang Yulei Sui Guandong Xu Hairong Jin 35 105 0 14 Feb 2022
Research on Dual Channel News Headline Classification Based on ERNIE Pre-training Model Jianing Li Hui Cao 29 4 0 14 Feb 2022
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework Peng Wang An Yang Rui Men Junyang Lin Shuai Bai Zhikang Li Jianxin Ma Chang Zhou Jingren Zhou Hongxia Yang MLLM ObjD 74 850 0 07 Feb 2022
MVPTR: Multi-Level Semantic Alignment for Vision-Language Pre-Training via Multi-Stage Learning Zejun Li Zhihao Fan Huaixiao Tou Jingjing Chen Zhongyu Wei Xuanjing Huang 25 16 0 29 Jan 2022
One Student Knows All Experts Know: From Sparse to Dense Fuzhao Xue Xiaoxin He Xiaozhe Ren Yuxuan Lou Yang You MoMe MoE 35 20 0 26 Jan 2022
Relational Memory Augmented Language Models Qi Liu Dani Yogatama Phil Blunsom KELM RALM 69 32 0 24 Jan 2022
OntoProtein: Protein Pretraining With Gene Ontology Embedding Ningyu Zhang Zhen Bi Xiaozhuan Liang Shuyang Cheng Haosen Hong Shumin Deng J. Lian Qiang Zhang Huajun Chen 99 90 0 23 Jan 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 34 101 0 15 Jan 2022
Fortunately, Discourse Markers Can Enhance Language Models for Sentiment Analysis L. Ein-Dor Ilya Shnayderman Artem Spector Lena Dankin R. Aharonov Noam Slonim 36 8 0 06 Jan 2022
ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Shuohuan Wang Yu Sun Yang Xiang Zhihua Wu Siyu Ding ... Tian Wu Wei Zeng Ge Li Wen Gao Haifeng Wang ELM 39 79 0 23 Dec 2021
DuQM: A Chinese Dataset of Linguistically Perturbed Natural Questions for Evaluating the Robustness of Question Matching Models Hongyu Zhu Yan Chen Jing Yang Jing Liu Yu Hong Ying-Cong Chen Hua Wu Haifeng Wang AAML 27 6 0 16 Dec 2021
Few-shot Multi-hop Question Answering over Knowledge Base Meihao Fan Lei Zhang Siyao Xiao Yuru Liang 27 4 0 14 Dec 2021
Native Chinese Reader: A Dataset Towards Native-Level Chinese Machine Reading Comprehension Shusheng Xu Yichen Liu Xiaoyuan Yi Siyuan Zhou Huizi Li Yi Wu ELM 31 3 0 13 Dec 2021
JABER and SABER: Junior and Senior Arabic BERt Abbas Ghaddar Yimeng Wu Ahmad Rashid Khalil Bibi Mehdi Rezagholizadeh ... Zhefeng Wang Baoxing Huai Xin Jiang Qun Liu Philippe Langlais 24 5 0 08 Dec 2021
DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding Taolin Zhang Chengyu Wang Nan Hu Minghui Qiu Chengguang Tang Xiaofeng He Jun Huang KELM VLM 19 30 0 02 Dec 2021
Domain-oriented Language Pre-training with Adaptive Hybrid Masking and Optimal Transport Alignment Denghui Zhang Zixuan Yuan Yanchi Liu Hao Liu Fuzhen Zhuang Hui Xiong Haifeng Chen VLM 16 3 0 01 Dec 2021
Neural Collaborative Graph Machines for Table Structure Recognition Hao Liu Xin Li Bin Liu Deqiang Jiang Yinsong Liu Bo Ren LMTD 24 31 0 26 Nov 2021
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples Linlin Liu Xin Li Ruidan He Lidong Bing Chenyu You Luo Si KELM 40 18 0 22 Nov 2021
FPM: A Collection of Large-scale Foundation Pre-trained Language Models Dezhou Shen AI4CE 22 0 0 09 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 81 83 0 08 Nov 2021
EventBERT: A Pre-Trained Model for Event Correlation Reasoning Yucheng Zhou Xiubo Geng Tao Shen Guodong Long Daxin Jiang 42 46 0 13 Oct 2021
Multi-modal Self-supervised Pre-training for Regulatory Genome Across Cell Types Shentong Mo Xiao Fu Chenyang Hong Yizhen Chen Yuxuan Zheng Xiangru Tang Zhiqiang Shen Eric Xing Yanyan Lan AI4CE 25 19 0 11 Oct 2021
A Survey On Neural Word Embeddings Erhan Sezerer Selma Tekir AI4TS 26 12 0 05 Oct 2021