ERNIE: Enhanced Language Representation with Informative Entities

17 May 2019

Zhengyan Zhang

Xu Han

Zhiyuan Liu

Xin Jiang

Maosong Sun

Qun Liu

ArXiv PDF HTML

Papers citing "ERNIE: Enhanced Language Representation with Informative Entities"

46 / 246 papers shown

Title
SenWave: Monitoring the Global Sentiments under the COVID-19 Pandemic Qiang Yang Hind Alamro Somayah Albaradei Adil Salhi Xiaoting Lv ... Wei Wang T. Gojobori C. Duarte Xin Gao Xiangliang Zhang 6 35 0 18 Jun 2020
PERL: Pivot-based Domain Adaptation for Pre-trained Deep Contextualized Embedding Models Eyal Ben-David Carmel Rabinovitz Roi Reichart SSL 58 61 0 16 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 52 1,587 0 15 Jun 2020
Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers Anne Lauscher Olga Majewska Leonardo F. R. Ribeiro Iryna Gurevych Nikolai Rozanov Goran Glavaš KELM 39 79 0 24 May 2020
Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease prediction L. Rasmy Yang Xiang Z. Xie Cui Tao Degui Zhi AI4MH LM&MA 24 657 0 22 May 2020
BiQGEMM: Matrix Multiplication with Lookup Table For Binary-Coding-based Quantized DNNs Yongkweon Jeon Baeseong Park S. Kwon Byeongwook Kim Jeongin Yun Dongsoo Lee MQ 33 30 0 20 May 2020
Speech to Text Adaptation: Towards an Efficient Cross-Modal Distillation Won Ik Cho Donghyun Kwak J. Yoon N. Kim 34 26 0 17 May 2020
Entity-Enriched Neural Models for Clinical Question Answering Bhanu Pratap Singh Rawat W. Weng So Yeon Min Preethi Raghavan Peter Szolovits 26 18 0 13 May 2020
Commonsense Evidence Generation and Injection in Reading Comprehension Ye Liu Tao Yang Zeyu You Wei Fan Philip S. Yu 33 14 0 11 May 2020
RICA: Evaluating Robust Inference Capabilities Based on Commonsense Axioms Pei Zhou Rahul Khanna Seyeon Lee Bill Yuchen Lin Daniel E. Ho Jay Pujara Xiang Ren ReLM 21 36 0 02 May 2020
BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA Nora Kassner Hinrich Schütze RALM 21 68 0 02 May 2020
Progressive Transformers for End-to-End Sign Language Production Ben Saunders Necati Cihan Camgöz Richard Bowden SLR 22 128 0 30 Apr 2020
TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Task Christoph Alt Aleksandra Gabryszak Leonhard Hennig 19 153 0 30 Apr 2020
Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning Tao Shen Yi Mao Pengcheng He Guodong Long Adam Trischler Weizhu Chen 18 63 0 29 Apr 2020
DIET: Lightweight Language Understanding for Dialogue Systems Tanja Bunk Daksh Varshneya Vladimir Vlasov Alan Nichol 27 160 0 21 Apr 2020
Entities as Experts: Sparse Memory Access with Entity Supervision Thibault Févry Livio Baldini Soares Nicholas FitzGerald Eunsol Choi Tom Kwiatkowski RALM 30 151 0 15 Apr 2020
Downstream Model Design of Pre-trained Language Model for Relation Extraction Task Cheng-rong Li Ye Tian 19 36 0 08 Apr 2020
Towards Evaluating the Robustness of Chinese BERT Classifiers Wei Ping Boyuan Pan Xin Li Bo-wen Li AAML 34 8 0 07 Apr 2020
More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction Xu Han Tianyu Gao Yankai Lin Hao Peng Yaoliang Yang Chaojun Xiao Zhiyuan Liu Peng Li Maosong Sun Jie Zhou 27 132 0 07 Apr 2020
Deep Entity Matching with Pre-Trained Language Models Yuliang Li Jinfeng Li Yoshihiko Suhara A. Doan W. Tan VLM 28 373 0 01 Apr 2020
Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation Necati Cihan Camgöz Oscar Koller Simon Hadfield Richard Bowden SLR 28 490 0 30 Mar 2020
TNT-KID: Transformer-based Neural Tagger for Keyword Identification Matej Martinc Blaž Škrlj Senja Pollak 24 37 0 20 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 246 1,454 0 18 Mar 2020
A Survey on Contextual Embeddings Qi Liu Matt J. Kusner Phil Blunsom 225 146 0 16 Mar 2020
Investigating Entity Knowledge in BERT with Simple Neural End-To-End Entity Linking Samuel Broscheit OCL 30 120 0 11 Mar 2020
A Survey on Knowledge Graph-Based Recommender Systems Qingyu Guo Fuzhen Zhuang Chuan Qin Hengshu Zhu Xing Xie Hui Xiong Qing He 38 727 0 28 Feb 2020
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters Ruize Wang Duyu Tang Nan Duan Zhongyu Wei Xuanjing Huang Jianshu Ji Guihong Cao Daxin Jiang Ming Zhou KELM 48 545 0 05 Feb 2020
Generating Representative Headlines for News Stories Xiaotao Gu Yuning Mao Jiawei Han Jialu Liu Hongkun Yu You Wu Cong Yu Daniel Finnie Jiaqi Zhai Nicholas Zukoski 30 70 0 26 Jan 2020
Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model Wenhan Xiong Jingfei Du William Yang Wang Veselin Stoyanov SSL KELM 52 201 0 20 Dec 2019
Learning Hierarchy-Aware Knowledge Graph Embeddings for Link Prediction Zhanqiu Zhang Jianyu Cai Yongdong Zhang Jie Wang 43 379 0 21 Nov 2019
E-BERT: Efficient-Yet-Effective Entity Embeddings for BERT Nina Poerner Ulli Waltinger Hinrich Schütze 15 156 0 09 Nov 2019
Relation Adversarial Network for Low Resource Knowledge Graph Completion Ningyu Zhang Shumin Deng Zhanlin Sun Jiaoayan Chen Wei Zhang Huajun Chen 17 71 0 08 Nov 2019
Evaluation of Sentence Representations in Polish Slawomir Dadas Michal Perelkiewicz Rafal Poswiata 33 13 0 25 Oct 2019
MRQA 2019 Shared Task: Evaluating Generalization in Reading Comprehension Adam Fisch Alon Talmor Robin Jia Minjoon Seo Eunsol Choi Danqi Chen 33 302 0 22 Oct 2019
OpenNRE: An Open and Extensible Toolkit for Neural Relation Extraction Xu Han Tianyu Gao Yuan Yao Deming Ye Zhiyuan Liu Maosong Sun KELM VLM 27 150 0 28 Sep 2019
Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddings Gregor Wiedemann Steffen Remus Avi Chawla Chris Biemann 27 174 0 23 Sep 2019
Enriching BERT with Knowledge Graph Embeddings for Document Classification Malte Ostendorff Peter Bourgonje Maria Berger J. Moreno-Schneider Georg Rehm Bela Gipp 22 80 0 18 Sep 2019
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 231 777 0 17 Sep 2019
Knowledge Enhanced Contextual Word Representations Matthew E. Peters Mark Neumann IV RobertL.Logan Roy Schwartz Vidur Joshi Sameer Singh Noah A. Smith 234 656 0 09 Sep 2019
Semantics-aware BERT for Language Understanding ZhuoSheng Zhang Yuwei Wu Zhao Hai Z. Li Shuailiang Zhang Xi Zhou Xiang Zhou 21 365 0 05 Sep 2019
Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models Zhiquan Ye Qian Chen Wen Wang Zhenhua Ling 27 68 0 19 Aug 2019
Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approaches Shane Storks Qiaozi Gao J. Chai 21 128 0 02 Apr 2019
Informed Machine Learning -- A Taxonomy and Survey of Integrating Knowledge into Learning Systems Laura von Rueden S. Mayer Katharina Beckh B. Georgiev Sven Giesselbach ... Rajkumar Ramamurthy Michal Walczak Jochen Garcke Christian Bauckhage Jannis Schuecker 39 626 0 29 Mar 2019
A Survey on Deep Learning for Named Entity Recognition J. Li Aixin Sun Jianglei Han Chenliang Li 3DV 27 1,139 0 22 Dec 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 304 6,996 0 20 Apr 2018
Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguation Ikuya Yamada Hiroyuki Shindo Hideaki Takeda Yoshiyasu Takefuji 136 318 0 06 Jan 2016