ERNIE: Enhanced Representation through Knowledge Integration

19 April 2019

Papers citing "ERNIE: Enhanced Representation through Knowledge Integration"

50 / 360 papers shown

Title
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 24 123 0 11 Nov 2022
LERT: A Linguistically-motivated Pre-trained Language Model Yiming Cui Wanxiang Che Shijin Wang Ting Liu 28 24 0 10 Nov 2022
CLOP: Video-and-Language Pre-Training with Knowledge Regularizations Guohao Li Hu Yang Feng He Zhifan Feng Yajuan Lyu Hua Wu Haifeng Wang VLM 21 1 0 07 Nov 2022
Tri-Attention: Explicit Context-Aware Attention Mechanism for Natural Language Processing Rui Yu Yifeng Li Wenpeng Lu LongBing Cao 30 1 0 05 Nov 2022
Evaluation of Automated Speech Recognition Systems for Conversational Speech: A Linguistic Perspective H. Pasandi Haniyeh B. Pasandi 31 1 0 05 Nov 2022
VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language Understanding Dou Hu Xiaolong Hou Xiyang Du Mengyuan Zhou Lian-Xin Jiang Yang Mo Xiaofeng Shi 33 12 0 01 Nov 2022
WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain Raj Sanjay Shah Kunal Chawla Dheeraj Eidnani Agam Shah Wendi Du S. Chava Natraj Raman Charese Smiley Jiaao Chen Diyi Yang AIFin 37 103 0 31 Oct 2022
Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection Yi Wang Jiajun Deng Tianzi Wang Bo Zheng Shoukang Hu Xunying Liu Helen M. Meng 38 14 0 29 Oct 2022
Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling Peijie Jiang Dingkun Long Yanzhao Zhang Pengjun Xie Meishan Zhang Hao Fei SSL 30 12 0 27 Oct 2022
EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching Chenxi Whitehouse Fenia Christopoulou Ignacio Iacobacci 37 9 0 22 Oct 2022
Spectrum-BERT: Pre-training of Deep Bidirectional Transformers for Spectral Classification of Chinese Liquors Yansong Wang Yundong Sun Yan-Jiao Fu Dongjie Zhu Zhaoshuo Tian 32 6 0 22 Oct 2022
Enhancing Tabular Reasoning with Pattern Exploiting Training Abhilash Shankarampeta Vivek Gupta Shuo Zhang LMTD RALM ReLM 68 6 0 21 Oct 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 27 13 0 21 Oct 2022
SLING: Sino Linguistic Evaluation of Large Language Models Yixiao Song Kalpesh Krishna R. Bhatt Mohit Iyyer 24 8 0 21 Oct 2022
Tele-Knowledge Pre-training for Fault Analysis Zhuo Chen Wen Zhang Yufen Huang Mingyang Chen Yuxia Geng ... Song Jiang Zhaoyang Lian Y. Li Lei Cheng Hua-zeng Chen 49 17 0 20 Oct 2022
Pre-training Language Models with Deterministic Factual Knowledge Shaobo Li Xiaoguang Li Lifeng Shang Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 47 11 0 20 Oct 2022
Hidden State Variability of Pretrained Language Models Can Guide Computation Reduction for Transfer Learning Shuo Xie Jiahao Qiu Ankita Pasad Li Du Qing Qu Hongyuan Mei 35 16 0 18 Oct 2022
Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding Jie Wang Wenkang Huang Qiuhui Shi Hongbin Wang Minghui Qiu Xiang Li Ming Gao KELM VLM 30 17 0 16 Oct 2022
CDConv: A Benchmark for Contradiction Detection in Chinese Conversations Chujie Zheng Jinfeng Zhou Yinhe Zheng Libiao Peng Zhen Guo Wenquan Wu Zhengyu Niu Hua Wu Minlie Huang 24 13 0 16 Oct 2022
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding Qiming Peng Yinxu Pan Wenjin Wang Bin Luo Zhenyu Zhang ... Shi Feng Yu Sun Hao Tian Hua Wu Haifeng Wang 13 83 0 12 Oct 2022
ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training Bin Shan Weichong Yin Yu Sun Hao Tian Hua Wu Haifeng Wang VLM 27 19 0 30 Sep 2022
WeLM: A Well-Read Pre-trained Language Model for Chinese Hui Su Xiao Zhou Houjin Yu Xiaoyu Shen Yuwen Chen Zilin Zhu Yang Yu Jie Zhou 37 23 0 21 Sep 2022
A Comprehensive Survey on Trustworthy Recommender Systems Wenqi Fan Xiangyu Zhao Xiao Chen Jingran Su Jingtong Gao ... Qidong Liu Yiqi Wang Hanfeng Xu Lei Chen Qing Li FaML 43 46 0 21 Sep 2022
Physical Logic Enhanced Network for Small-Sample Bi-Layer Metallic Tubes Bending Springback Prediction Chang-Hai Sun Zili Wang Shuyou Zhang Le Wang Jianrong Tan AI4CE 14 2 0 20 Sep 2022
Align, Reason and Learn: Enhancing Medical Vision-and-Language Pre-training with Knowledge Zhihong Chen Guanbin Li Xiang Wan 127 65 0 15 Sep 2022
SPACE-2: Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding Wanwei He Yinpei Dai Binyuan Hui Min Yang Zhen Cao Jianbo Dong Fei Huang Luo Si Yongbin Li VLM 43 31 0 14 Sep 2022
PainPoints: A Framework for Language-based Detection of Chronic Pain and Expert-Collaborative Text-Summarization S. Fadnavis Amit Dhurandhar R. Norel Jenna M. Reinen C. Agurto E. Secchettin V. Schweiger Giovanni Perini Guillermo Cecchi 34 1 0 14 Sep 2022
CrossDial: An Entertaining Dialogue Dataset of Chinese Crosstalk Baizhou Huang Shikang Du Xiao-Yi Wan 22 0 0 03 Sep 2022
DPTDR: Deep Prompt Tuning for Dense Passage Retrieval Zhen-Quan Tang Benyou Wang Ting Yao VLM 39 14 0 24 Aug 2022
CLOWER: A Pre-trained Language Model with Contrastive Learning over Word and Character Representations Borun Chen Hongyin Tang Jiahao Bu Kai Zhang Jingang Wang Qifan Wang Haitao Zheng Wei Wu Liqian Yu VLM 27 1 0 23 Aug 2022
Learning Better Masking for Better Language Model Pre-training Dongjie Yang Zhuosheng Zhang Hai Zhao 37 15 0 23 Aug 2022
Brand Celebrity Matching Model Based on Natural Language Processing Han Yang Kejian Yang Erhan Zhang 36 1 0 18 Aug 2022
An Interpretability Evaluation Benchmark for Pre-trained Language Models Ya-Ming Shen Lijie Wang Ying-Cong Chen Xinyan Xiao Jing Liu Hua Wu 37 4 0 28 Jul 2022
MLRIP: Pre-training a military language representation model with informative factual knowledge and professional knowledge base Hui Li Xu Yang Xin Zhao Lin Yu Jiping Zheng Wei Sun KELM 36 0 0 28 Jul 2022
Masked Spatial-Spectral Autoencoders Are Excellent Hyperspectral Defenders Jiahao Qi Z. Gong Xingyue Liu Kangcheng Bin Chen Chen Yongqiang Li Wei Xue Yu Zhang P. Zhong AAML 42 6 0 16 Jul 2022
Exploiting Word Semantics to Enrich Character Representations of Chinese Pre-trained Models Wenbiao Li Rui Sun Yunfang Wu 20 4 0 13 Jul 2022
Understanding Performance of Long-Document Ranking Models through Comprehensive Evaluation and Leaderboarding Leonid Boytsov David Akinpelu Tianyi Lin Fangwei Gao Yutian Zhao Jeffrey Huang Nipun Katyal Eric Nyberg 47 9 0 04 Jul 2022
An Understanding-Oriented Robust Machine Reading Comprehension Model Feiliang Ren Yongkang Liu Bochao Li Shilei Liu Bingchao Wang Jiaqi Wang Chunchao Liu Qi Ma 19 3 0 01 Jul 2022
Entity-Graph Enhanced Cross-Modal Pretraining for Instance-level Product Retrieval Xiao Dong Xunlin Zhan Yunchao Wei Xiaoyong Wei Yaowei Wang Minlong Lu Xiaochun Cao Xiaodan Liang 27 11 0 17 Jun 2022
Towards Robust Ranker for Text Retrieval Yucheng Zhou Tao Shen Xiubo Geng Chongyang Tao Can Xu Guodong Long Binxing Jiao Daxin Jiang OOD 28 42 0 16 Jun 2022
KE-QI: A Knowledge Enhanced Article Quality Identification Dataset Chunhui Ai Derui Wang Xuemi Yan Yang Xu Wenrui Xie Ziqiang Cao 24 0 0 15 Jun 2022
A Unified Continuous Learning Framework for Multi-modal Knowledge Discovery and Pre-training Zhihao Fan Zhongyu Wei Jingjing Chen Siyuan Wang Zejun Li Jiarong Xu Xuanjing Huang CLL 14 6 0 11 Jun 2022
1Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task Zhiyong Wang Ge Zhang Nineli Lashkarashvili 24 3 0 08 Jun 2022
Less Learn Shortcut: Analyzing and Mitigating Learning of Spurious Feature-Label Correlation Yanrui Du Jing Yang Yan Chen Jing Liu Sendong Zhao Qiaoqiao She Huaqin Wu Haifeng Wang Bing Qin 44 9 0 25 May 2022
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder Shitao Xiao Zheng Liu Yingxia Shao Bo Zhao RALM 120 110 0 24 May 2022
Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding Abbas Ghaddar Yimeng Wu Sunyam Bagga Ahmad Rashid Khalil Bibi ... Zhefeng Wang Baoxing Huai Xin Jiang Qun Liu Philippe Langlais 27 6 0 21 May 2022
PaddleSpeech: An Easy-to-Use All-in-One Speech Toolkit Hui Zhang Tian Yuan Junkun Chen Xintong Li Renjie Zheng ... Zeyu Chen Xiaoguang Hu Dianhai Yu Yanjun Ma Liang Huang AuLLM 31 24 0 20 May 2022
ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval Yuxiang Lu Yiding Liu Jiaxiang Liu Yunsheng Shi Zhengjie Huang ... Hao Tian Hua Wu Shuaiqiang Wang Dawei Yin Haifeng Wang 117 59 0 18 May 2022
POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detection Yujian Liu Xinliang Frederick Zhang David Wegsman Nick Beauchamp Lu Wang 37 71 0 02 May 2022
Incorporating Explicit Knowledge in Pre-trained Language Models for Passage Re-ranking Qian Dong Yiding Liu Suqi Cheng Shuaiqiang Wang Zhicong Cheng Shuzi Niu Dawei Yin 32 24 0 25 Apr 2022