ERNIE: Enhanced Representation through Knowledge Integration

19 April 2019

Papers citing "ERNIE: Enhanced Representation through Knowledge Integration"

50 / 360 papers shown

Title
A Survey on Self-supervised Pre-training for Sequential Transfer Learning in Neural Networks H. H. Mao BDL SSL 6 50 0 01 Jul 2020
ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene Graph Fei Yu Jiji Tang Weichong Yin Yu Sun Hao Tian Hua Wu Haifeng Wang 31 376 0 30 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 50 1,586 0 15 Jun 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 64 2,622 0 05 Jun 2020
A Data-driven Approach for Noise Reduction in Distantly Supervised Biomedical Relation Extraction Saadullah Amin K. Dunfield Anna Vechkaeva G. Neumann NoLa MedIm 19 14 0 26 May 2020
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data Pengcheng Yin Graham Neubig Wen-tau Yih Sebastian Riedel RALM LMTD 28 584 0 17 May 2020
SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysis Hao Tian Can Gao Xinyan Xiao Hao Liu Bolei He Hua Wu Haifeng Wang Feng Wu 29 229 0 12 May 2020
An Empirical Study of Pre-trained Transformers for Arabic Information Extraction Wuwei Lan Yang Chen Wei-ping Xu Alan Ritter 22 4 0 30 Apr 2020
Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning Tao Shen Yi Mao Pengcheng He Guodong Long Adam Trischler Weizhu Chen 15 63 0 29 Apr 2020
Revisiting Pre-Trained Models for Chinese Natural Language Processing Yiming Cui Wanxiang Che Ting Liu Bing Qin Shijin Wang Guoping Hu 34 682 0 29 Apr 2020
Semantics-Aware Inferential Network for Natural Language Understanding Shuailiang Zhang Hai Zhao Junru Zhou LRM 21 4 0 28 Apr 2020
MATINF: A Jointly Labeled Large-Scale Dataset for Classification, Question Answering and Summarization Canwen Xu Jiaxin Pei Hongtao Wu Yiyu Liu Chenliang Li MLLM VLM 25 14 0 26 Apr 2020
Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word Order Yi-Lun Liao Xin Jiang Qun Liu 25 40 0 24 Apr 2020
DuReader_robust: A Chinese Dataset Towards Evaluating Robustness and Generalization of Machine Reading Comprehension in Real-World Applications Hongxuan Tang Hongyu Li Jing Liu Yu Hong Hua Wu Haifeng Wang 13 18 0 23 Apr 2020
Exploring the Combination of Contextual Word Embeddings and Knowledge Graph Embeddings Lea Dieudonat Kelvin Han Phyllicia Leavitt Esteban Marquer 20 3 0 17 Apr 2020
CLUE: A Chinese Language Understanding Evaluation Benchmark Liang Xu Hai Hu Xuanwei Zhang Lu Li Chenjie Cao ... Cong Yue Xinrui Zhang Zhen-Yi Yang Kyle Richardson Zhenzhong Lan ELM 45 377 0 13 Apr 2020
KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversation Hao Zhou Chujie Zheng Kaili Huang Minlie Huang Xiaoyan Zhu 27 122 0 08 Apr 2020
Deep Learning Based Text Classification: A Comprehensive Review Shervin Minaee Nal Kalchbrenner Min Zhang Narjes Nikzad M. Asgari-Chenaghlu Jianfeng Gao AILaw VLM AI4TS 24 1,091 0 06 Apr 2020
FastBERT: a Self-distilling BERT with Adaptive Inference Time Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Haotang Deng Qi Ju 57 354 0 05 Apr 2020
Deep Entity Matching with Pre-Trained Language Models Yuliang Li Jinfeng Li Yoshihiko Suhara A. Doan W. Tan VLM 22 373 0 01 Apr 2020
TNT-KID: Transformer-based Neural Tagger for Keyword Identification Matej Martinc Blaž Škrlj Senja Pollak 24 37 0 20 Mar 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
A Survey on Contextual Embeddings Qi Liu Matt J. Kusner Phil Blunsom 225 146 0 16 Mar 2020
Overview of the CCKS 2019 Knowledge Graph Evaluation Track: Entity, Relation, Event and QA Xianpei Han Zhichun Wang Jiangtao Zhang Qinghua Wen Wenqi Li ... Guilin Qi Lei Zou Sen Hu Minhao Zhang Yinnian Lin 24 16 0 09 Mar 2020
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing Ziqing Yang Yiming Cui Zhipeng Chen Wanxiang Che Ting Liu Shijin Wang Guoping Hu VLM 14 47 0 28 Feb 2020
A Primer in BERTology: What we know about how BERT works Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 35 1,458 0 27 Feb 2020
CBAG: Conditional Biomedical Abstract Generation Justin Sybrandt Ilya Safro MedIm AI4CE 22 8 0 13 Feb 2020
Application of Pre-training Models in Named Entity Recognition Yu Wang Yining Sun Zuchang Ma Lisheng Gao Yang Xu Ting Sun 18 20 0 09 Feb 2020
A Survey on Knowledge Graphs: Representation, Acquisition and Applications Shaoxiong Ji Shirui Pan Min Zhang Pekka Marttinen Philip S. Yu 195 1,941 0 02 Feb 2020
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation Dongling Xiao Han Zhang Yukun Li Yu Sun Hao Tian Hua Wu Haifeng Wang 31 126 0 26 Jan 2020
Generating Representative Headlines for News Stories Xiaotao Gu Yuning Mao Jiawei Han Jialu Liu Hongkun Yu You Wu Cong Yu Daniel Finnie Jiaqi Zhai Nicholas Zukoski 30 70 0 26 Jan 2020
A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation Jian Guan Fei Huang Zhihao Zhao Xiaoyan Zhu Minlie Huang LRM SyDa 27 242 0 15 Jan 2020
Knowledge Infused Learning (K-IL): Towards Deep Incorporation of Knowledge in Deep Learning Ugur Kursuncu Manas Gaur A. Sheth NAI 20 57 0 01 Dec 2019
Integrating Graph Contextualized Knowledge into Pre-trained Language Models Bin He Di Zhou Jinghui Xiao Xin jiang Qun Liu Nicholas Jing Yuan Tong Xu AI4CE 16 77 0 30 Nov 2019
A Pre-training Based Personalized Dialogue Generation Model with Persona-sparse Data Yinhe Zheng Rongsheng Zhang Xiaoxi Mao Minlie Huang 22 157 0 12 Nov 2019
Enhancing Pre-trained Chinese Character Representation with Word-aligned Attention Yanzeng Li Yu Bowen Mengge Xue Tingwen Liu 19 26 0 07 Nov 2019
SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledge Pei Ke Haozhe Ji Siyang Liu Xiaoyan Zhu Minlie Huang 17 7 0 06 Nov 2019
ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations Shizhe Diao Jiaxin Bai Yan Song Tong Zhang Yonggang Wang AI4CE 17 134 0 02 Nov 2019
BIG MOOD: Relating Transformers to Explicit Commonsense Knowledge Jeff Da 16 0 0 17 Oct 2019
Enriching BERT with Knowledge Graph Embeddings for Document Classification Malte Ostendorff Peter Bourgonje Maria Berger J. Moreno-Schneider Georg Rehm Bela Gipp 17 80 0 18 Sep 2019
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 231 778 0 17 Sep 2019
Specializing Unsupervised Pretraining Models for Word-Level Semantic Similarity Anne Lauscher Ivan Vulić Edoardo Ponti Anna Korhonen Goran Glavavs SSL 25 57 0 05 Sep 2019
Semantics-aware BERT for Language Understanding Zhuosheng Zhang Yuwei Wu Zhao Hai Z. Li Shuailiang Zhang Xi Zhou Xiang Zhou 21 363 0 05 Sep 2019
NEZHA: Neural Contextualized Representation for Chinese Language Understanding Junqiu Wei Xiaozhe Ren Xiaoguang Li Wenyong Huang Yi-Lun Liao Yasheng Wang Jianghao Lin Xin Jiang Xiao Chen Qun Liu 6 116 0 31 Aug 2019
EntEval: A Holistic Evaluation Benchmark for Entity Representations Mingda Chen Zewei Chu Yang Chen K. Stratos Kevin Gimpel 19 12 0 31 Aug 2019
Giving BERT a Calculator: Finding Operations and Arguments with Reading Comprehension D. Andor Luheng He Kenton Lee Emily Pitler AIMat 13 97 0 31 Aug 2019
Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models Zhiquan Ye Qian Chen Wen Wang Zhenhua Ling 27 68 0 19 Aug 2019
Learning Conceptual-Contextual Embeddings for Medical Text Xiao Zhang Dejing Dou Ji Wu BDL 14 17 0 16 Aug 2019
DuTongChuan: Context-aware Translation Model for Simultaneous Interpreting Hao Xiong Ruiqing Zhang Chuanqiang Zhang Zhongjun He Hua Wu Haifeng Wang 41 25 0 30 Jul 2019
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding Yu Sun Shuohuan Wang Yukun Li Shikun Feng Hao Tian Hua Wu Haifeng Wang CLL 27 799 0 29 Jul 2019