K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters

5 February 2020

Xuanjing Huang

Papers citing "K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters"

50 / 316 papers shown

Title
Sustainable Modular Debiasing of Language Models Anne Lauscher Tobias Lüken Goran Glavas 55 120 0 08 Sep 2021
Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation Hongyin Zhu Hao Peng Zhiheng Lyu Lei Hou Juan-Zi Li Jinghui Xiao 37 21 0 02 Sep 2021
Does Knowledge Help General NLU? An Empirical Study Ruochen Xu Yuwei Fang Chenguang Zhu Michael Zeng ELM 34 9 0 01 Sep 2021
Prompt-Learning for Fine-Grained Entity Typing Ning Ding Yulin Chen Xu Han Guangwei Xu Pengjun Xie Haitao Zheng Zhiyuan Liu Juan-Zi Li Hong-Gee Kim 26 156 0 24 Aug 2021
Knowledge Perceived Multi-modal Pretraining in E-commerce Yushan Zhu Huaixiao Tou Wen Zhang Ganqiang Ye Hui Chen Ningyu Zhang Huajun Chen 28 32 0 20 Aug 2021
AdapterHub Playground: Simple and Flexible Few-Shot Learning with Adapters Tilman Beck Bela Bohlender Christina Viehmann Vincent Hane Yanik Adamson Jaber Khuri Jonas Brossmann Jonas Pfeiffer Iryna Gurevych 21 15 0 18 Aug 2021
ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration Yuhao Cui Zhou Yu Chunqi Wang Zhongzhou Zhao Ji Zhang Meng Wang Jun-chen Yu VLM 27 53 0 16 Aug 2021
Knowledge-intensive Language Understanding for Explainable AI A. Sheth Manas Gaur Kaushik Roy Keyur Faldu 19 48 0 02 Aug 2021
Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition Varsha Suresh Desmond C. Ong 27 19 0 31 Jul 2021
CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision Zhongyang Li Xiao Ding Kuo Liao Bing Qin Ting Liu CML 29 17 0 21 Jul 2021
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Yu Sun Shuohuan Wang Shikun Feng Siyu Ding Chao Pang ... Ouyang Xuan Dianhai Yu Hao Tian Hua Wu Haifeng Wang 61 454 0 05 Jul 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 58 816 0 14 Jun 2021
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation Ruidan He Linlin Liu Hai Ye Qingyu Tan Bosheng Ding Liying Cheng Jia-Wei Low Lidong Bing Luo Si 34 197 0 06 Jun 2021
BERTnesia: Investigating the capture and forgetting of knowledge in BERT Jonas Wallat Jaspreet Singh Avishek Anand CLL KELM 36 58 0 05 Jun 2021
SGPT: Semantic Graphs based Pre-training for Aspect-based Sentiment Analysis Yong Qian Zhongqing Wang Rong Xiao Chen Chen Haihong Tang 33 4 0 26 May 2021
Relation Classification with Entity Type Restriction Shengfei Lyu Huanhuan Chen 27 68 0 18 May 2021
Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter Wei Liu Xiyan Fu Yueqian Zhang Wenming Xiao 17 155 0 15 May 2021
Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters Yan Xu Etsuko Ishii Samuel Cahyawijaya Zihan Liu Genta Indra Winata Andrea Madotto Dan Su Pascale Fung RALM 25 44 0 13 May 2021
Billion-scale Pre-trained E-commerce Product Knowledge Graph Model Wen Zhang Chi-Man Wong Ganqiang Ye Bo Wen Wei Zhang Huajun Chen 16 21 0 02 May 2021
Low Anisotropy Sense Retrofitting (LASeR) : Towards Isotropic and Sense Enriched Representations Geetanjali Bihani Julia Taylor Rayz 33 13 0 22 Apr 2021
Static Embeddings as Efficient Knowledge Bases? Philipp Dufter Nora Kassner Hinrich Schütze 25 19 0 14 Apr 2021
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce Song Xu Haoran Li Peng Yuan Yujia Wang Youzheng Wu Xiaodong He Ying Liu Bowen Zhou KELM 38 24 0 14 Apr 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 38 51 0 12 Apr 2021
KI-BERT: Infusing Knowledge Context for Better Language and Domain Understanding Keyur Faldu A. Sheth Prashant Kikani Hemang Akabari 27 28 0 09 Apr 2021
Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation Alexandra Chronopoulou Dario Stojanovski Alexander Fraser SSL 37 26 0 18 Mar 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 42 18 0 18 Mar 2021
THEaiTRE 1.0: Interactive generation of theatre play scripts Rudolf Rosa Tomáš Musil Ondrej Dusek Dominik Jurko Patrícia Schmidtová ... Marie Nováková Josef Dolevzal Klára Vosecká Tomávs Studeník Petr vZabka VGen 33 10 0 17 Feb 2021
Focusing Knowledge-based Graph Argument Mining via Topic Modeling Patricia B. Abels Zahra Ahmadi Sophie Burkhardt Benjamin Schiller Iryna Gurevych Stefan Kramer 35 6 0 03 Feb 2021
Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models Nora Kassner Philipp Dufter Hinrich Schütze 26 133 0 01 Feb 2021
Combining pre-trained language models and structured knowledge Pedro Colon-Hernandez Catherine Havasi Jason B. Alonso Matthew Huggins C. Breazeal KELM 38 48 0 28 Jan 2021
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 66 21 0 31 Dec 2020
Verb Knowledge Injection for Multilingual Event Processing Olga Majewska Ivan Vulić Goran Glavavs Edoardo Ponti Anna Korhonen 32 11 0 31 Dec 2020
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning Yujia Qin Yankai Lin Ryuichi Takanobu Zhiyuan Liu Peng Li Heng Ji Minlie Huang Maosong Sun Jie Zhou 60 125 0 30 Dec 2020
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training Peng Shi Patrick Ng Zhiguo Wang Henghui Zhu Alexander Hanbo Li Jun Wang Cicero Nogueira dos Santos Bing Xiang 23 117 0 18 Dec 2020
Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solution Ron Zhu 26 79 0 15 Dec 2020
KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning Bin He Xin Jiang Jinghui Xiao Qun Liu 37 18 0 07 Dec 2020
Pre-training Text-to-Text Transformers for Concept-centric Common Sense Wangchunshu Zhou Dong-Ho Lee Ravi Kiran Selvam Seyeon Lee Bill Yuchen Lin Xiang Ren LRM VLM 14 71 0 24 Oct 2020
GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method Nicole Peinelt Marek Rei Maria Liakata 30 2 0 23 Oct 2020
AdapterDrop: On the Efficiency of Adapters in Transformers Andreas Rucklé Gregor Geigle Max Glockner Tilman Beck Jonas Pfeiffer Nils Reimers Iryna Gurevych 57 255 0 22 Oct 2020
Incorporating BERT into Parallel Sequence Decoding with Adapters Junliang Guo Zhirui Zhang Linli Xu Hao-Ran Wei Boxing Chen Enhong Chen 51 69 0 13 Oct 2020
Probing Pretrained Language Models for Lexical Semantics Ivan Vulić Edoardo Ponti Robert Litschko Goran Glavas Anna Korhonen KELM 33 233 0 12 Oct 2020
Exposing Shallow Heuristics of Relation Extraction Models with Challenge Data Shachar Rosenman Alon Jacovi Yoav Goldberg 16 28 0 07 Oct 2020
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Ikuya Yamada Akari Asai Hiroyuki Shindo Hideaki Takeda Yuji Matsumoto 26 662 0 02 Oct 2020
CoLAKE: Contextualized Language and Knowledge Embedding Tianxiang Sun Yunfan Shao Xipeng Qiu Qipeng Guo Yaru Hu Xuanjing Huang Zheng-Wei Zhang KELM 33 181 0 01 Oct 2020
CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models Yusheng Su Xu Han Zhengyan Zhang Peng Li Zhiyuan Liu Yankai Lin Jie Zhou Maosong Sun ODL 23 24 0 29 Sep 2020
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems Andrea Madotto Samuel Cahyawijaya Genta Indra Winata Yan Xu Zihan Liu Zhaojiang Lin Pascale Fung 36 59 0 28 Sep 2020
Knowledge-Aware Procedural Text Understanding with Multi-Stage Training Zhihan Zhang Xiubo Geng Tao Qin Yunfang Wu Daxin Jiang 35 22 0 28 Sep 2020
Knowledge Transfer via Pre-training for Recommendation: A Review and Prospect Zheni Zeng Chaojun Xiao Yuan Yao Ruobing Xie Zhiyuan Liu Fen Lin Leyu Lin Maosong Sun VLM 32 40 0 19 Sep 2020
E-BERT: A Phrase and Product Knowledge Enhanced Language Model for E-commerce Denghui Zhang Zixuan Yuan Yanchi Liu Fuzhen Zhuang Haifeng Chen Hui Xiong 19 33 0 07 Sep 2020
GAN Memory with No Forgetting Yulai Cong Miaoyun Zhao Jianqiao Li Sijia Wang Lawrence Carin CLL 13 116 0 13 Jun 2020