K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters

5 February 2020

Xuanjing Huang

Papers citing "K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters"

50 / 316 papers shown

Title
Unified Semantic Typing with Meaningful Label Inference James Y. Huang Bangzheng Li Lyne Tchapmi Muhao Chen 29 30 0 04 May 2022
Entity-aware Transformers for Entity Search E. Gerritse Faegheh Hasibi A. D. Vries 39 22 0 02 May 2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing Chengyu Wang Minghui Qiu Chen Shi Taolin Zhang Tingting Liu Lei Li Jie Wang Ming Wang Jun Huang W. Lin 27 21 0 30 Apr 2022
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models Joel Jang Seonghyeon Ye Changho Lee Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Minjoon Seo CLL KELM 27 93 0 29 Apr 2022
Plug-and-Play Adaptation for Continuously-updated QA Kyungjae Lee Wookje Han Seung-won Hwang Hwaran Lee Joonsuk Park Sang-Woo Lee KELM 30 16 0 27 Apr 2022
K-LITE: Learning Transferable Visual Models with External Knowledge Sheng Shen Chunyuan Li Xiaowei Hu Jianwei Yang Yujia Xie ... Ce Liu Kurt Keutzer Trevor Darrell Anna Rohrbach Jianfeng Gao CLIP VLM 36 83 0 20 Apr 2022
Infusing Linguistic Knowledge of SMILES into Chemical Language Models Ingoo Lee Hojung Nam 29 6 0 20 Apr 2022
Knowledgeable Salient Span Mask for Enhancing Language Models as Knowledge Base Cunxiang Wang Fuli Luo Yanyang Li Runxin Xu Fei Huang Yue Zhang KELM 36 2 0 17 Apr 2022
XLMRQA: Open-Domain Question Answering on Vietnamese Wikipedia-based Textual Knowledge Source Kiet Van Nguyen Phong Nguyen-Thuan Do N. D. Nguyen Tin Van Huynh A. Nguyen Ngan Luu-Thuy Nguyen 29 6 0 14 Apr 2022
DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning Zifeng Wang Zizhao Zhang Sayna Ebrahimi Ruoxi Sun Han Zhang ... Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VLM VPVLM 36 463 0 10 Apr 2022
Modeling Multi-Granularity Hierarchical Features for Relation Extraction Xinnian Liang Shuangzhi Wu Mu Li Zhoujun Li 15 10 0 09 Apr 2022
Evaluation of Fake News Detection with Knowledge-Enhanced Language Models Chenxi Whitehouse Tillman Weyde Pranava Madhyastha N. Komninos 24 25 0 01 Apr 2022
elBERto: Self-supervised Commonsense Learning for Question Answering Xunlin Zhan Yuan Li Xiao Dong Xiaodan Liang Zhiting Hu Lawrence Carin SSL RALM LRM 24 7 0 17 Mar 2022
Geographic Adaptation of Pretrained Language Models Valentin Hofmann Goran Glavavs Nikola Ljubevsić J. Pierrehumbert Hinrich Schütze VLM 21 16 0 16 Mar 2022
Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer Woojeong Jin Dong-Ho Lee Chenguang Zhu Jay Pujara Xiang Ren CLIP VLM 19 9 0 14 Mar 2022
PKGM: A Pre-trained Knowledge Graph Model for E-commerce Application Wen Zhang Chi-Man Wong Ganqinag Ye Bo Wen Hongting Zhou Wei Zhang Hua-zeng Chen 19 0 0 02 Mar 2022
A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models Deming Ye Yankai Lin Peng Li Maosong Sun Zhiyuan Liu KELM 14 11 0 27 Feb 2022
Ultra-fine Entity Typing with Indirect Supervision from Natural Language Inference Bangzheng Li Wenpeng Yin Muhao Chen 33 29 0 12 Feb 2022
What Has Been Enhanced in my Knowledge-Enhanced Language Model? Yifan Hou Guoji Fu Mrinmaya Sachan KELM 35 1 0 02 Feb 2022
ScaLA: Accelerating Adaptation of Pre-Trained Transformer-Based Language Models via Efficient Large-Batch Adversarial Noise Minjia Zhang U. Niranjan Yuxiong He 28 1 0 29 Jan 2022
OntoProtein: Protein Pretraining With Gene Ontology Embedding Ningyu Zhang Zhen Bi Xiaozhuan Liang Shuyang Cheng Haosen Hong Shumin Deng J. Lian Qiang Zhang Huajun Chen 99 90 0 23 Jan 2022
Context-Tuning: Learning Contextualized Prompts for Natural Language Generation Tianyi Tang Junyi Li Wayne Xin Zhao Ji-Rong Wen 33 15 0 21 Jan 2022
Unpaired Referring Expression Grounding via Bidirectional Cross-Modal Matching Hengcan Shi Munawar Hayat Jianfei Cai ObjD 20 10 0 18 Jan 2022
Efficient Hierarchical Domain Adaptation for Pretrained Language Models Alexandra Chronopoulou Matthew E. Peters Jesse Dodge 33 42 0 16 Dec 2021
Learning to Prompt for Continual Learning Zifeng Wang Zizhao Zhang Chen-Yu Lee Han Zhang Ruoxi Sun Xiaoqi Ren Guolong Su Vincent Perot Jennifer Dy Tomas Pfister CLL VPVLM KELM VLM 22 739 0 16 Dec 2021
Learning Rich Representation of Keyphrases from Text Mayank Kulkarni Debanjan Mahata Ravneet Arora Rajarshi Bhowmik VLM 27 65 0 16 Dec 2021
DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding Taolin Zhang Chengyu Wang Nan Hu Minghui Qiu Chengguang Tang Xiaofeng He Jun Huang KELM VLM 21 30 0 02 Dec 2021
Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs Peter Hase Mona T. Diab Asli Celikyilmaz Xian Li Zornitsa Kozareva Veselin Stoyanov Joey Tianyi Zhou Srini Iyer KELM LRM 30 79 0 26 Nov 2021
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples Linlin Liu Xin Li Ruidan He Lidong Bing Chenyu You Luo Si KELM 40 18 0 22 Nov 2021
Linking-Enhanced Pre-Training for Table Semantic Parsing Bowen Qin Lihan Wang Binyuan Hui Ruiying Geng Zhen Cao Min Yang Jian Sun Yongbin Li 35 1 0 18 Nov 2021
Unsupervised Domain Adaptation with Adapter Rongsheng Zhang Yinhe Zheng Xiaoxi Mao Minlie Huang 13 18 0 01 Nov 2021
Towards Tractable Mathematical Reasoning: Challenges, Strategies, and Opportunities for Solving Math Word Problems Keyur Faldu A. Sheth Prashant Kikani Manas Gaur Aditi Avasthi LRM 37 17 0 29 Oct 2021
SYNERGY: Building Task Bots at Scale Using Symbolic Knowledge and Machine Teaching Baolin Peng Chunyuan Li Zhu Zhang Jinchao Li Chenguang Zhu Jianfeng Gao 76 3 0 21 Oct 2021
Fast Model Editing at Scale E. Mitchell Charles Lin Antoine Bosselut Chelsea Finn Christopher D. Manning KELM 230 343 0 21 Oct 2021
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew O. Arnold Xiang Ren KELM CLL 31 112 0 16 Oct 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 29 45 0 16 Oct 2021
Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou Fangyu Liu Ivan Vulić Nigel Collier Muhao Chen KELM 72 18 0 16 Oct 2021
Metadata Shaping: Natural Language Annotations for the Tail Simran Arora Sen Wu Enci Liu Christopher Ré 38 0 0 16 Oct 2021
Dict-BERT: Enhancing Language Model Pre-training with Dictionary Wenhao Yu Chenguang Zhu Yuwei Fang Donghan Yu Shuohang Wang Yichong Xu Michael Zeng Meng Jiang 54 64 0 13 Oct 2021
Language Models As or For Knowledge Bases Simon Razniewski Andrew Yates Nora Kassner Gerhard Weikum KELM 30 1 0 10 Oct 2021
Towards Continual Knowledge Learning of Language Models Joel Jang Seonghyeon Ye Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Stanley Jungkyu Choi Minjoon Seo CLL KELM 233 151 0 07 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 40 5 0 01 Oct 2021
XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge X. Jiang Yaobo Liang Weizhu Chen Nan Duan 32 22 0 26 Sep 2021
K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering Fu Sun Feng-Lin Li Ruize Wang Qianglong Chen Xingyi Cheng Ji Zhang VLM KELM 41 4 0 22 Sep 2021
xGQA: Cross-Lingual Visual Question Answering Jonas Pfeiffer Gregor Geigle Aishwarya Kamath Jan-Martin O. Steitz Stefan Roth Ivan Vulić Iryna Gurevych 39 56 0 13 Sep 2021
Packed Levitated Marker for Entity and Relation Extraction Deming Ye Yankai Lin Peng Li Maosong Sun 141 106 0 13 Sep 2021
Total Recall: a Customized Continual Learning Method for Neural Semantic Parsers Zhuang Li Lizhen Qu Gholamreza Haffari CLL 40 15 0 11 Sep 2021
Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT Zaiqiao Meng Fangyu Liu T. H. Clark Ehsan Shareghi Nigel Collier MoE 50 37 0 10 Sep 2021
KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs Yinquan Lu H. Lu Guirong Fu Qun Liu KELM 18 34 0 09 Sep 2021
Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extraction Oscar Sainz Oier López de Lacalle Gorka Labaka Ander Barrena Eneko Agirre 16 117 0 08 Sep 2021