ERNIE: Enhanced Language Representation with Informative Entities

17 May 2019

Zhengyan Zhang

Xu Han

Zhiyuan Liu

Xin Jiang

Maosong Sun

Qun Liu

ArXiv PDF HTML

Papers citing "ERNIE: Enhanced Language Representation with Informative Entities"

50 / 246 papers shown

Title
Knowledgeable Salient Span Mask for Enhancing Language Models as Knowledge Base Cunxiang Wang Fuli Luo Yanyang Li Runxin Xu Fei Huang Yue Zhang KELM 39 2 0 17 Apr 2022
Contrastive Learning with Hard Negative Entities for Entity Set Expansion Hai-Tao Zheng Yong Li Yuxin He Tianyu Yu Ying Shen Haitao Zheng 18 32 0 16 Apr 2022
Knowledge Infused Decoding Ruibo Liu Guoqing Zheng Shashank Gupta Radhika Gaonkar Chongyang Gao Soroush Vosoughi Milad Shokouhi Ahmed Hassan Awadallah KELM 28 14 0 06 Apr 2022
Evaluation of Fake News Detection with Knowledge-Enhanced Language Models Chenxi Whitehouse Tillman Weyde Pranava Madhyastha N. Komninos 24 25 0 01 Apr 2022
Entity-driven Fact-aware Abstractive Summarization of Biomedical Literature Amanuel Alambo Tanvi Banerjee K. Thirunarayan M. Raymer MedIm 21 7 0 30 Mar 2022
LinkBERT: Pretraining Language Models with Document Links Michihiro Yasunaga J. Leskovec Percy Liang KELM 29 353 0 29 Mar 2022
ANNA: Enhanced Language Representation for Question Answering Changwook Jun Hansol Jang Myoseop Sim Hyun Kim Jooyoung Choi Kyungkoo Min Kyunghoon Bae 31 6 0 28 Mar 2022
Duality-Induced Regularizer for Semantic Matching Knowledge Graph Embeddings Jie Wang Zhanqiu Zhang Zhihao Shi Jianyu Cai Shuiwang Ji Feng Wu 24 8 0 24 Mar 2022
Automatic Detection of Entity-Manipulated Text using Factual Knowledge Ganesh Jawahar Muhammad Abdul-Mageed L. Lakshmanan DeLMO 22 10 0 19 Mar 2022
elBERto: Self-supervised Commonsense Learning for Question Answering Xunlin Zhan Yuan Li Xiao Dong Xiaodan Liang Zhiting Hu Lawrence Carin SSL RALM LRM 24 7 0 17 Mar 2022
SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarization Mathieu Ravaut Chenyu You Nancy F. Chen MoE 16 92 0 13 Mar 2022
ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classification Yucheng Zhou Tao Shen Xiubo Geng Guodong Long Daxin Jiang 31 57 0 04 Mar 2022
SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models Liang Wang Wei Zhao Zhuoyu Wei Jingming Liu 28 177 0 04 Mar 2022
EPPAC: Entity Pre-typing Relation Classification with Prompt AnswerCentralizing Jiejun Tan Wenbin Hu Weiwei Liu 24 1 0 01 Mar 2022
ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classification Xinjie Lin G. Xiong Gaopeng Gou Zhen Li Junzheng Shi Jiahao Yu 20 235 0 13 Feb 2022
Ultra-fine Entity Typing with Indirect Supervision from Natural Language Inference Bangzheng Li Wenpeng Yin Muhao Chen 33 29 0 12 Feb 2022
What Has Been Enhanced in my Knowledge-Enhanced Language Model? Yifan Hou Guoji Fu Mrinmaya Sachan KELM 35 1 0 02 Feb 2022
Disaster Tweets Classification using BERT-Based Language Model Anh-Duc Le 15 5 0 31 Jan 2022
A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models Hanqing Zhang Haolin Song Shaoyu Li Ming Zhou Dawei Song 54 215 0 14 Jan 2022
Multi-task Pre-training Language Model for Semantic Network Completion Da Li Sen Yang Kele Xu Ming Yi Yukai He Huaimin Wang 48 30 0 13 Jan 2022
Does Entity Abstraction Help Generative Transformers Reason? Nicolas Angelard-Gontier Siva Reddy C. Pal 34 5 0 05 Jan 2022
Best of Both Worlds: A Hybrid Approach for Multi-Hop Explanation with Declarative Facts Shane Storks Qiaozi Gao Aishwarya N. Reganti Govind Thattai 30 1 0 17 Dec 2021
CODER: An efficient framework for improving retrieval through COntextual Document Embedding Reranking George Zerveas Navid Rekabsaz Daniel Cohen Carsten Eickhoff 31 8 0 16 Dec 2021
Learning Rich Representation of Keyphrases from Text Mayank Kulkarni Debanjan Mahata Ravneet Arora Rajarshi Bhowmik VLM 27 65 0 16 Dec 2021
LongT5: Efficient Text-To-Text Transformer for Long Sequences Mandy Guo Joshua Ainslie David C. Uthus Santiago Ontanon Jianmo Ni Yun-hsuan Sung Yinfei Yang VLM 31 306 0 15 Dec 2021
Roof-Transformer: Divided and Joined Understanding with Knowledge Enhancement Wei-Lin Liao Chengwei Su Wei-Yun Ma 32 0 0 13 Dec 2021
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples Linlin Liu Xin Li Ruidan He Lidong Bing Chenyu You Luo Si KELM 42 18 0 22 Nov 2021
Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models Wei Ping Chejian Xu Shuohang Wang Zhe Gan Yu Cheng Jianfeng Gao Ahmed Hassan Awadallah Yangqiu Song VLM ELM AAML 33 216 0 04 Nov 2021
Conformal prediction for text infilling and part-of-speech prediction N. Dey Jing Ding Jack G. Ferrell Carolina Kapper Maxwell Lovig Emiliano Planchon Jonathan P. Williams UQLM 24 19 0 04 Nov 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 72 18 0 16 Oct 2021
Metadata Shaping: Natural Language Annotations for the Tail Simran Arora Sen Wu Enci Liu Christopher Ré 38 0 0 16 Oct 2021
A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification Sosuke Nishikawa Ikuya Yamada Yoshimasa Tsuruoka Isao Echizen VLM 46 5 0 15 Oct 2021
Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Health Andrew Lee Jonathan K. Kummerfeld Lawrence C. An Rada Mihalcea 38 24 0 28 Sep 2021
Discovering Drug-Target Interaction Knowledge from Biomedical Literature Yutai Hou Yingce Xia Lijun Wu Shufang Xie Yang Fan Jinhua Zhu Wanxiang Che Tao Qin Tie-Yan Liu 25 14 0 27 Sep 2021
K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering Fu Sun Feng-Lin Li Ruize Wang Qianglong Chen Xingyi Cheng Ji Zhang VLM KELM 41 4 0 22 Sep 2021
Relation-Guided Pre-Training for Open-Domain Question Answering Ziniu Hu Yizhou Sun Kai-Wei Chang RALM OnRL 34 6 0 21 Sep 2021
Knowledge-Enhanced Evidence Retrieval for Counterargument Generation Yohan Jo Haneul Yoo Jinyeong Bak Alice Oh Chris Reed Eduard H. Hovy RALM 40 12 0 19 Sep 2021
Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings Hendrik Schuff Hsiu-yu Yang Heike Adel Ngoc Thang Vu ELM ReLM LRM 49 13 0 16 Sep 2021
Packed Levitated Marker for Entity and Relation Extraction Deming Ye Yankai Lin Peng Li Maosong Sun 141 106 0 13 Sep 2021
Fine-grained Entity Typing via Label Reasoning Qing Liu Hongyu Lin Xinyan Xiao Xianpei Han Le Sun Hua Wu LRM 28 28 0 13 Sep 2021
Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding Shane Storks Qiaozi Gao Yichi Zhang J. Chai ReLM LRM 49 22 0 10 Sep 2021
KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs Yinquan Lu H. Lu Guirong Fu Qun Liu KELM 18 34 0 09 Sep 2021
Joint model for intent and entity recognition Petr Lorenc VLM 29 3 0 07 Sep 2021
Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval Zhiqi Huang Hamed Bonab Sheikh Muhammad Sarwar Razieh Rahimi James Allan 40 10 0 07 Sep 2021
Enhancing Natural Language Representation with Large-Scale Out-of-Domain Commonsense Wanyun Cui Xingran Chen 22 6 0 06 Sep 2021
Prompt-Learning for Fine-Grained Entity Typing Ning Ding Yulin Chen Xu Han Guangwei Xu Pengjun Xie Haitao Zheng Zhiyuan Liu Juan-Zi Li Hong-Gee Kim 26 156 0 24 Aug 2021
Knowledge Perceived Multi-modal Pretraining in E-commerce Yushan Zhu Huaixiao Tou Wen Zhang Ganqiang Ye Hui Chen Ningyu Zhang Huajun Chen 28 32 0 20 Aug 2021
SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining Taolin Zhang Zerui Cai Chengyu Wang Minghui Qiu Bite Yang Xiaofeng He AI4MH 28 52 0 20 Aug 2021
ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration Yuhao Cui Zhou Yu Chunqi Wang Zhongzhou Zhao Ji Zhang Meng Wang Jun-chen Yu VLM 27 53 0 16 Aug 2021
More but Correct: Generating Diversified and Entity-revised Medical Response Bin Li Encheng Chen Hongrui Liu Yixuan Weng Bin Sun Shutao Li Yongping Bai Meiling Hu MedIm 19 11 0 03 Aug 2021