K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters

5 February 2020

Xuanjing Huang

Papers citing "K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters"

50 / 316 papers shown

Title
Contextual information integration for stance detection via cross-attention Tilman Beck Andreas Waldis Iryna Gurevych 21 12 0 03 Nov 2022
Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models Xiaoman Pan Wenlin Yao Hongming Zhang Dian Yu Dong Yu Jianshu Chen KELM 201 22 0 28 Oct 2022
LegoNet: A Fast and Exact Unlearning Architecture Sihao Yu Fei Sun J. Guo Ruqing Zhang Xueqi Cheng MU 42 8 0 28 Oct 2022
Towards Language-driven Scientific AI José Manuél Gómez-Pérez 34 0 0 27 Oct 2022
Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning Yifan Chen Devamanyu Hazarika Mahdi Namazifar Yang Liu Di Jin Dilek Z. Hakkani-Tür 29 3 0 26 Oct 2022
PALT: Parameter-Lite Transfer of Language Models for Knowledge Graph Completion Jianhao Shen Chenguang Wang Ye Yuan Jiawei Han Heng Ji Koushik Sen Ming Zhang Dawn Song KELM ALM VPVLM 25 7 0 25 Oct 2022
Adapters for Enhanced Modeling of Multilingual Knowledge and Text Yifan Hou Wenxiang Jiao Mei-Jun Liu Carl Allen Zhaopeng Tu Mrinmaya Sachan 34 11 0 24 Oct 2022
"Covid vaccine is against Covid but Oxford vaccine is made at Oxford!" Semantic Interpretation of Proper Noun Compounds Keshav Kolluru Gabriel Stanovsky Mausam NAI 9 1 0 24 Oct 2022
An Empirical Revisiting of Linguistic Knowledge Fusion in Language Understanding Tasks Changlong Yu Tianyi Xiao Lingpeng Kong Yangqiu Song Wilfred Ng 30 3 0 24 Oct 2022
Generative Knowledge Graph Construction: A Review Hongbin Ye Ningyu Zhang Hui Chen Huajun Chen 53 70 0 23 Oct 2022
EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching Chenxi Whitehouse Fenia Christopoulou Ignacio Iacobacci 47 9 0 22 Oct 2022
R $^2$ F: A General Retrieval, Reading and Fusion Framework for Document-level Natural Language Inference Hao Wang Yixin Cao Yangguang Li Zhen Huang Kun Wang Jing Shao FedML 30 0 0 22 Oct 2022
SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation Zekun Li Jina Kim Yao-Yi Chiang Muhao Chen 90 28 0 21 Oct 2022
Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding Jie Wang Wenkang Huang Qiuhui Shi Hongbin Wang Minghui Qiu Xiang Li Ming Gao KELM VLM 30 17 0 16 Oct 2022
DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation Mojtaba Valipour Mehdi Rezagholizadeh I. Kobyzev A. Ghodsi 32 164 0 14 Oct 2022
Can Pretrained Language Models (Yet) Reason Deductively? Moy Yuan Songbo Hu Ivan Vulić Anna Korhonen Zaiqiao Meng ReLM ELM LRM 42 8 0 12 Oct 2022
ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding Qiming Peng Yinxu Pan Wenjin Wang Bin Luo Zhenyu Zhang ... Shi Feng Yu Sun Hao Tian Hua Wu Haifeng Wang 13 83 0 12 Oct 2022
Revisiting adapters with adversarial training Sylvestre-Alvise Rebuffi Francesco Croce Sven Gowal AAML 36 16 0 10 Oct 2022
KSAT: Knowledge-infused Self Attention Transformer -- Integrating Multiple Domain-Specific Contexts Kaushik Roy Yuxin Zi Vignesh Narayanan Manas Gaur Amit P. Sheth AI4MH 46 12 0 09 Oct 2022
KALM: Knowledge-Aware Integration of Local, Document, and Global Contexts for Long Document Understanding Shangbin Feng Zhaoxuan Tan Wenqian Zhang Zhenyu Lei Yulia Tsvetkov KELM VLM 56 10 0 08 Oct 2022
Calibrating Factual Knowledge in Pretrained Language Models Qingxiu Dong Damai Dai Yifan Song Jingjing Xu Zhifang Sui Lei Li KELM 249 83 0 07 Oct 2022
Granularity-aware Adaptation for Image Retrieval over Multiple Tasks Jon Almazán ByungSoo Ko Geonmo Gu Diane Larlus Yannis Kalantidis ObjD VLM 46 7 0 05 Oct 2022
The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection Sondre Wold KELM 37 4 0 03 Oct 2022
An Equal-Size Hard EM Algorithm for Diverse Dialogue Generation Yuqiao Wen Yongchang Hao Yanshuai Cao Lili Mou 64 10 0 29 Sep 2022
KoCHET: a Korean Cultural Heritage corpus for Entity-related Tasks Gyeongmin Kim Jinsung Kim Junyoung Son Heu-Jeoung Lim 25 7 0 01 Sep 2022
SPOT: Knowledge-Enhanced Language Representations for Information Extraction Jiacheng Li Yannis Katsis Tyler Baldwin Ho-Cheol Kim Andrew Bartko Julian McAuley Chun-Nan Hsu 30 15 0 20 Aug 2022
Ered: Enhanced Text Representations with Entities and Descriptions Qinghua Zhao Shuai Ma Yu Lei 32 1 0 18 Aug 2022
LM-CORE: Language Models with Contextually Relevant External Knowledge Jivat Neet Kaur S. Bhatia Milan Aggarwal Rachit Bansal Balaji Krishnamurthy KELM 22 13 0 12 Aug 2022
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning Qianglong Chen Feng-Lin Li Guohai Xu Ming Yan Ji Zhang Yin Zhang 29 22 0 01 Aug 2022
Neural Knowledge Bank for Pretrained Transformers Damai Dai Wen-Jie Jiang Qingxiu Dong Yajuan Lyu Qiaoqiao She Zhifang Sui KELM 32 21 0 31 Jul 2022
MLRIP: Pre-training a military language representation model with informative factual knowledge and professional knowledge base Hui Li Xu Yang Xin Zhao Lin Yu Jiping Zheng Wei Sun KELM 36 0 0 28 Jul 2022
Discourse-Aware Graph Networks for Textual Logical Reasoning Yinya Huang Lemao Liu Kun Xu Meng Fang Liang Lin Xi Liang NAI 23 5 0 04 Jul 2022
Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data Tian Li Xiang Chen Zhen Dong Weijiang Yu Yijun Yan Kurt Keutzer Shanghang Zhang 17 8 0 20 Jun 2022
A Unified Understanding of Deep NLP Models for Text Classification Zhuguo Li Xiting Wang Weikai Yang Jing Wu Zhengyan Zhang Zhiyuan Liu Maosong Sun Hui Zhang Shixia Liu VLM 28 30 0 19 Jun 2022
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks Tuan Dinh Yuchen Zeng Ruisu Zhang Ziqian Lin Michael Gira Shashank Rajput Jy-yong Sohn Dimitris Papailiopoulos Kangwook Lee LMTD 45 128 0 14 Jun 2022
Singular Value Fine-tuning: Few-shot Segmentation requires Few-parameters Fine-tuning Yanpeng Sun Qiang Chen Xiangyu He Jian Wang Haocheng Feng Junyu Han Errui Ding Jian Cheng Zechao Li Jingdong Wang 31 56 0 13 Jun 2022
A Unified Continuous Learning Framework for Multi-modal Knowledge Discovery and Pre-training Zhihao Fan Zhongyu Wei Jingjing Chen Siyuan Wang Zejun Li Jiarong Xu Xuanjing Huang CLL 17 6 0 11 Jun 2022
REKnow: Enhanced Knowledge for Joint Entity and Relation Extraction Sheng Zhang Patrick Ng Zhiguo Wang Bing Xiang 27 4 0 10 Jun 2022
Modularized Transfer Learning with Multiple Knowledge Graphs for Zero-shot Commonsense Reasoning Yu Jin Kim Beong-woo Kwak Youngwook Kim Reinald Kim Amplayo Seung-won Hwang Jinyoung Yeo LRM 27 12 0 08 Jun 2022
1Cademy at Semeval-2022 Task 1: Investigating the Effectiveness of Multilingual, Multitask, and Language-Agnostic Tricks for the Reverse Dictionary Task Zhiyong Wang Ge Zhang Nineli Lashkarashvili 24 3 0 08 Jun 2022
Prompt Injection: Parameterization of Fixed Inputs Eunbi Choi Yongrae Jo Joel Jang Minjoon Seo 21 29 0 31 May 2022
StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypes Awantee V. Deshpande Dana Ruiter Marius Mosbach Dietrich Klakow 20 11 0 27 May 2022
Conditional set generation using Seq2seq models Aman Madaan Dheeraj Rajagopal Niket Tandon Yiming Yang Antoine Bosselut 35 10 0 25 May 2022
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer Ahmet Üstün Arianna Bisazza G. Bouma Gertjan van Noord Sebastian Ruder 54 32 0 24 May 2022
Stop Filtering: Multi-View Attribute-Enhanced Dialogue Learning Yiwei Li Bin Sun Shaoxiong Feng Kan Li 29 3 0 23 May 2022
Summarization as Indirect Supervision for Relation Extraction Keming Lu I-Hung Hsu Wenxuan Zhou Mingyu Derek Ma Muhao Chen 65 52 0 19 May 2022
Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters Yang Xiang Zhihua Wu Weibao Gong Siyu Ding Xianjie Mo ... Yue Yu Ge Li Yu Sun Yanjun Ma Dianhai Yu 24 5 0 19 May 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers Jonas Pfeiffer Naman Goyal Xi Lin Xian Li James Cross Sebastian Riedel Mikel Artetxe LRM 40 139 0 12 May 2022
GRAPHCACHE: Message Passing as Caching for Sentence-Level Relation Extraction Yiwei Wang Muhao Chen Wenxuan Zhou Yujun Cai Keli Zhang Bryan Hooi GNN 15 9 0 08 May 2022
Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysis Yiwei Wang Muhao Chen Wenxuan Zhou Yujun Cai Keli Zhang Dayiheng Liu Baosong Yang Juncheng Liu Bryan Hooi CML 20 51 0 08 May 2022