ERNIE: Enhanced Language Representation with Informative Entities

17 May 2019

Zhengyan Zhang

Xu Han

Zhiyuan Liu

Xin Jiang

Maosong Sun

Qun Liu

ArXiv PDF HTML

Papers citing "ERNIE: Enhanced Language Representation with Informative Entities"

50 / 247 papers shown

Title
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 73 3,853 0 28 Jul 2021
An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers Lu Wang Munif Ishad Mujib Jake Williams G. Demiris Jina Huh-Yoo AI4MH 32 32 0 28 Jul 2021
Exceeding the Limits of Visual-Linguistic Multi-Task Learning Cameron R. Wolfe Keld T. Lundgaard VLM 45 2 0 27 Jul 2021
Query2Label: A Simple Transformer Way to Multi-Label Classification Shilong Liu Lei Zhang Xiao Yang Hang Su Jun Zhu 26 187 0 22 Jul 2021
CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision Zhongyang Li Xiao Ding Kuo Liao Bing Qin Ting Liu CML 29 17 0 21 Jul 2021
JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs Pei Ke Haozhe Ji Yuanyuan Ran Xin Cui Liwei Wang Linfeng Song Xiaoyan Zhu Minlie Huang 59 95 0 19 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 58 816 0 14 Jun 2021
SGPT: Semantic Graphs based Pre-training for Aspect-based Sentiment Analysis Yong Qian Zhongqing Wang Rong Xiao Chen Chen Haihong Tang 33 4 0 26 May 2021
Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction Tianyu Gao Xu Han Keyue Qiu Yuzhuo Bai Zhiyu Xie Yankai Lin Zhiyuan Liu Peng Li Maosong Sun Jie Zhou ELM 27 31 0 20 May 2021
Retrieval-Augmented Transformer-XL for Close-Domain Dialog Generation Giovanni Bonetta R. Cancelliere Ding Liu Paul Vozila RALM 24 16 0 19 May 2021
Conversational Entity Linking: Problem Definition and Datasets Hideaki Joko Faegheh Hasibi K. Balog A. D. Vries 23 19 0 11 May 2021
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training Fangkai Jiao Yangyang Guo Yilin Niu Feng Ji Feng-Lin Li Liqiang Nie LRM 34 12 0 10 May 2021
PanGu- $α$ : Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation Wei Zeng Xiaozhe Ren Teng Su Hui Wang Yi-Lun Liao ... Gaojun Fan Yaowei Wang Xuefeng Jin Qun Liu Yonghong Tian ALM MoE AI4CE 35 212 0 26 Apr 2021
Identify, Align, and Integrate: Matching Knowledge Graphs to Commonsense Reasoning Tasks Lisa Bauer Mohit Bansal 19 19 0 20 Apr 2021
Re-TACRED: Addressing Shortcomings of the TACRED Dataset George Stoica Emmanouil Antonios Platanios Barnabas Poczos 39 113 0 16 Apr 2021
Editing Factual Knowledge in Language Models Nicola De Cao Wilker Aziz Ivan Titov KELM 68 478 0 16 Apr 2021
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce Song Xu Haoran Li Peng Yuan Yujia Wang Youzheng Wu Xiaodong He Ying Liu Bowen Zhou KELM 38 24 0 14 Apr 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 38 51 0 12 Apr 2021
Defx at SemEval-2020 Task 6: Joint Extraction of Concepts and Relations for Definition Extraction Marc Hübner Christoph Alt Robert Schwarzenberg Leonhard Hennig 16 1 0 31 Mar 2021
KGSynNet: A Novel Entity Synonyms Discovery Framework with Knowledge Graph Yiying Yang Xi Yin Haiqing Yang Xingjian Fei Hao Peng Kaijie Zhou Kunfeng Lai Jianping Shen 19 14 0 16 Mar 2021
Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networks Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 33 77 0 11 Mar 2021
BERTese: Learning to Speak to BERT Adi Haviv Jonathan Berant Amir Globerson 30 123 0 09 Mar 2021
Topology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphs Jiajun Chen Huarui He Feng Wu Jie Wang 21 130 0 05 Mar 2021
OAG-BERT: Towards A Unified Backbone Language Model For Academic Knowledge Services Xiao Liu Da Yin Jingnan Zheng Xingjian Zhang Peng Zhang Hongxia Yang Yuxiao Dong Jie Tang VLM 45 30 0 03 Mar 2021
First Target and Opinion then Polarity: Enhancing Target-opinion Correlation for Aspect Sentiment Triplet Extraction Lianzhe Huang Peiyi Wang Sujian Li Tianyu Liu Xiaodong Zhang Zhicong Cheng Dawei Yin Houfeng Wang 170 28 0 17 Feb 2021
Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategies Gabriele Pergola E. Kochkina Lin Gui Maria Liakata Yulan He 88 31 0 16 Feb 2021
Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge ZhuoSheng Zhang Junlong Li Hai Zhao 40 23 0 10 Feb 2021
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 66 21 0 31 Dec 2020
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning Yujia Qin Yankai Lin Ryuichi Takanobu Zhiyuan Liu Peng Li Heng Ji Minlie Huang Maosong Sun Jie Zhou 60 125 0 30 Dec 2020
KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning Bin He Xin Jiang Jinghui Xiao Qun Liu 37 18 0 07 Dec 2020
Modifying Memories in Transformer Models Chen Zhu A. S. Rawat Manzil Zaheer Srinadh Bhojanapalli Daliang Li Felix X. Yu Sanjiv Kumar KELM 32 192 0 01 Dec 2020
Duality-Induced Regularizer for Tensor Factorization Based Knowledge Graph Completion Zhanqiu Zhang Jianyu Cai Jie Wang 11 56 0 11 Nov 2020
CharBERT: Character-aware Pre-trained Language Model Wentao Ma Yiming Cui Chenglei Si Ting Liu Shijin Wang Guoping Hu 31 104 0 03 Nov 2020
A Frustratingly Easy Approach for Entity and Relation Extraction Zexuan Zhong Danqi Chen 162 108 0 24 Oct 2020
Language Models are Open Knowledge Graphs Chenguang Wang Xiao Liu D. Song SSL KELM 26 135 0 22 Oct 2020
Document-Level Relation Extraction with Adaptive Thresholding and Localized Context Pooling Wenxuan Zhou Kevin Huang Tengyu Ma Jing Huang 24 273 0 21 Oct 2020
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation Yan Zeng J. Nie 21 5 0 21 Oct 2020
BERT2DNN: BERT Distillation with Massive Unlabeled Data for Online E-Commerce Search Yunjiang Jiang Yue Shang Ziyang Liu Hongwei Shen Yun Xiao Wei Xiong Sulong Xu Weipeng P. Yan Di Jin 29 17 0 20 Oct 2020
CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters Hicham El Boukkouri Olivier Ferret Thomas Lavergne Hiroshi Noji Pierre Zweigenbaum Junichi Tsujii 77 156 0 20 Oct 2020
Bootleg: Chasing the Tail with Self-Supervised Named Entity Disambiguation Laurel J. Orr Megan Leszczynski Simran Arora Sen Wu Neel Guha Xiao Ling Christopher Ré 143 48 0 20 Oct 2020
Coarse-to-Fine Pre-training for Named Entity Recognition Mengge Xue Yu Bowen Zhenyu Zhang Tingwen Liu Yue Zhang Bin Wang 25 52 0 16 Oct 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition Yun He Ziwei Zhu Yin Zhang Qin Chen James Caverlee AI4MH 36 108 0 08 Oct 2020
Learning from Context or Names? An Empirical Study on Neural Relation Extraction Hao Peng Tianyu Gao Xu Han Yankai Lin Peng Li Zhiyuan Liu Maosong Sun Jie Zhou 26 201 0 05 Oct 2020
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Ikuya Yamada Akari Asai Hiroyuki Shindo Hideaki Takeda Yuji Matsumoto 28 662 0 02 Oct 2020
MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models Peng Xu M. Patwary M. Shoeybi Raul Puri Pascale Fung Anima Anandkumar Bryan Catanzaro 26 126 0 02 Oct 2020
CoLAKE: Contextualized Language and Knowledge Embedding Tianxiang Sun Yunfan Shao Xipeng Qiu Qipeng Guo Yaru Hu Xuanjing Huang Zheng-Wei Zhang KELM 33 181 0 01 Oct 2020
KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoning Ye Liu Yao Wan Lifang He Hao Peng Philip S. Yu 32 188 0 26 Sep 2020
Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Models Joseph F DeRose Jiayao Wang M. Berger 17 83 0 03 Sep 2020
ConvBERT: Improving BERT with Span-based Dynamic Convolution Zihang Jiang Weihao Yu Daquan Zhou Yunpeng Chen Jiashi Feng Shuicheng Yan 43 157 0 06 Aug 2020
Artificial Intelligence in the Battle against Coronavirus (COVID-19): A Survey and Future Research Directions Thanh Thi Nguyen Quoc Viet Hung Nguyen Dung Nguyen Samuel Yang Peter W. Eklund Thien Huynh-The Thanh Tam Nguyen Quoc-Viet Pham Imran Razzak Edbert B. Hsu 36 190 0 30 Jul 2020