K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters

5 February 2020

Xuanjing Huang

Papers citing "K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters"

50 / 316 papers shown

Title
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey Chen Ling Xujiang Zhao Jiaying Lu Chengyuan Deng Can Zheng ... Chris White Quanquan Gu Jian Pei Carl Yang Liang Zhao ALM 33 126 0 30 May 2023
Plug-and-Play Knowledge Injection for Pre-trained Language Models Zhengyan Zhang Zhiyuan Zeng Yankai Lin Huadong Wang Deming Ye ... Xu Han Zhiyuan Liu Peng Li Maosong Sun Jie Zhou KELM 46 11 0 28 May 2023
Plug-and-Play Document Modules for Pre-trained Models Chaojun Xiao Zhengyan Zhang Xu Han Chi-Min Chan Yankai Lin Zhiyuan Liu Xiangyang Li Zhonghua Li Bo Zhao Maosong Sun KELM 34 5 0 28 May 2023
Calibration of Transformer-based Models for Identifying Stress and Depression in Social Media Loukas Ilias S. Mouzakitis D. Askounis 33 41 0 26 May 2023
Pre-training Language Models for Comparative Reasoning Mengxia Yu Zhihan Zhang Wenhao Yu Meng Jiang LRM 27 9 0 23 May 2023
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations Jonas Pfeiffer Francesco Piccinno Massimo Nicosia Xinyi Wang Machel Reid Sebastian Ruder VLM LRM 38 27 0 23 May 2023
How Fragile is Relation Extraction under Entity Replacements? Yiwei Wang Bryan Hooi Fei Wang Yujun Cai Keli Zhang Wenxuan Zhou Jing Tang Manjuan Duan Muhao Chen 69 5 0 22 May 2023
Editing Large Language Models: Problems, Methods, and Opportunities Yunzhi Yao Peng Wang Bo Tian Shuyang Cheng Zhoubo Li Shumin Deng Huajun Chen Ningyu Zhang KELM 34 281 0 22 May 2023
EnCore: Fine-Grained Entity Typing by Pre-Training Entity Encoders on Coreference Chains Frank Mtumbuka Steven Schockaert 47 0 0 22 May 2023
ESCOXLM-R: Multilingual Taxonomy-driven Pre-training for the Job Market Domain Mike Zhang Rob van der Goot Barbara Plank 24 14 0 20 May 2023
G-Adapter: Towards Structure-Aware Parameter-Efficient Transfer Learning for Graph Transformer Networks Anchun Gui Jinqiang Ye Han Xiao 27 19 0 17 May 2023
Parameter-Efficient Fine-Tuning with Layer Pruning on Free-Text Sequence-to-Sequence Modeling Y. Zhu Xuebing Yang Yuanyuan Wu Wensheng Zhang MedIm 25 2 0 15 May 2023
Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering Qianglong Chen Guohai Xu Mingshi Yan Ji Zhang Fei Huang Luo Si Yin Zhang 21 9 0 14 May 2023
Continual Learning for End-to-End ASR by Averaging Domain Experts Peter William VanHarn Plantinga Jaekwon Yoo C. Dhir CLL MoMe 33 1 0 12 May 2023
Towards Versatile and Efficient Visual Knowledge Integration into Pre-trained Language Models with Cross-Modal Adapters Xinyun Zhang Haochen Tan Han Wu Bei Yu KELM 17 1 0 12 May 2023
Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer Zhiqiang Hu Roy Ka-Wei Lee Nancy F. Chen 30 2 0 10 May 2023
Completeness, Recall, and Negation in Open-World Knowledge Bases: A Survey Simon Razniewski Hiba Arnaout Shrestha Ghosh Fabian M. Suchanek 59 8 0 09 May 2023
CSED: A Chinese Semantic Error Diagnosis Corpus Bo Sun Baoxin Wang Yixuan Wang Wanxiang Che Dayong Wu Shijin Wang Ting Liu 37 4 0 09 May 2023
HiFi: High-Information Attention Heads Hold for Parameter-Efficient Model Adaptation Anchun Gui Han Xiao 21 4 0 08 May 2023
KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness Yichuan Li Jialong Han Kyumin Lee Chengyuan Ma S. Sarkar Derek Liu VLM KELM 25 0 0 02 May 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models Deming Ye Yankai Lin Zhengyan Zhang Maosong Sun KELM 29 0 0 02 May 2023
Neurosymbolic AI -- Why, What, and How Ami N. Sheth Kaushik Roy Manas Gaur NAI 38 24 0 01 May 2023
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond Ensheng Shi Yanlin Wang Hongyu Zhang Lun Du Shi Han Dongmei Zhang Hongbin Sun 36 43 0 11 Apr 2023
Sentence-Level Relation Extraction via Contrastive Learning with Descriptive Relation Prompts Jiewen Zheng Ze Chen 33 2 0 11 Apr 2023
Bridging the Language Gap: Knowledge Injected Multilingual Question Answering Zhichao Duan Xiuxing Li Zhengyan Zhang Zhenyu Li Ning Liu Jianyong Wang 27 8 0 06 Apr 2023
Retrieving Multimodal Information for Augmented Generation: A Survey Ruochen Zhao Hailin Chen Weishi Wang Fangkai Jiao Do Xuan Long ... Bosheng Ding Xiaobao Guo Minzhi Li Xingxuan Li Chenyu You 31 82 0 20 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 33 27 0 14 Mar 2023
Generating multiple-choice questions for medical question answering with distractors and cue-masking Damien Sileo Kanimozhi Uma Marie-Francine Moens 43 5 0 13 Mar 2023
Multimodal Parameter-Efficient Few-Shot Class Incremental Learning Marco D’Alessandro Alberto Alonso Enrique Calabrés M. Galar CLL 48 13 0 08 Mar 2023
SMoA: Sparse Mixture of Adapters to Mitigate Multiple Dataset Biases Yanchen Liu Jing Yang Yan Chen Jing Liu Huaqin Wu MoE 47 2 0 28 Feb 2023
HugNLP: A Unified and Comprehensive Library for Natural Language Processing Jie Wang Nuo Chen Qiushi Sun Wenkang Huang Chengyu Wang Ming Gao 32 3 0 28 Feb 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić Edoardo Ponti MoMe OOD 32 73 0 22 Feb 2023
KILM: Knowledge Injection into Encoder-Decoder Language Models Yan Xu Mahdi Namazifar Devamanyu Hazarika Aishwarya Padmakumar Yang Liu Dilek Z. Hakkani-Tür KELM 22 26 0 17 Feb 2023
LabelPrompt: Effective Prompt-based Learning for Relation Classification Wenbo Zhang Xiaoning Song Zhenhua Feng Tianyang Xu Xiaojun Wu VLM 35 4 0 16 Feb 2023
Exploring Category Structure with Contextual Language Models and Lexical Semantic Networks Joseph Renner Pascal Denis Rémi Gilleron Angèle Brunellière 16 3 0 14 Feb 2023
Few-Shot Table-to-Text Generation with Prompt Planning and Knowledge Memorization Zhixin Guo Minyxuan Yan Jiexing Qi Jianping Zhou Ziwei He Zhouhan Lin Guanjie Zheng Xinbing Wang LMTD VLM 24 3 0 09 Feb 2023
Cluster-Level Contrastive Learning for Emotion Recognition in Conversations Kailai Yang Tianlin Zhang Hassan Alhuzali Sophia Ananiadou 34 43 0 07 Feb 2023
Continual Pre-training of Language Models Zixuan Ke Yijia Shao Haowei Lin Tatsuya Konishi Gyuhak Kim Bin Liu CLL KELM 25 126 0 07 Feb 2023
An Empirical Study on the Transferability of Transformer Modules in Parameter-Efficient Fine-Tuning Mohammad AkbarTajari S. Rajaee Mohammad Taher Pilehvar 19 2 0 01 Feb 2023
One Model for All Domains: Collaborative Domain-Prefix Tuning for Cross-Domain NER Xiang Chen Lei Li Q. Fei Ningyu Zhang Chuanqi Tan Yong-jia Jiang Fei Huang Huajun Chen 26 23 0 25 Jan 2023
Editing Language Model-based Knowledge Graph Embeddings Shuyang Cheng Ningyu Zhang Bo Tian Zhiyu Li Wei Guo Huajun Chen KELM 51 23 0 25 Jan 2023
Unifying Structure Reasoning and Language Model Pre-training for Complex Reasoning Siyuan Wang Zhongyu Wei Jiarong Xu Taishan Li Zhihao Fan LRM 36 5 0 21 Jan 2023
Adaptive Pattern Extraction Multi-Task Learning for Multi-Step Conversion Estimations Xuewen Tao Mingming Ha Xiaobo Guo Qiongxu Ma Ho Kei Cheng Wenfang Lin 21 0 0 06 Jan 2023
A Survey on In-context Learning Qingxiu Dong Lei Li Damai Dai Ce Zheng Jingyuan Ma ... Zhiyong Wu Baobao Chang Xu Sun Lei Li Zhifang Sui ReLM AIMat 22 471 0 31 Dec 2022
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 32 3 0 27 Dec 2022
Injecting Domain Knowledge in Language Models for Task-Oriented Dialogue Systems Denis Emelin Daniele Bonadiman Sawsan Alqahtani Yi Zhang Saab Mansour 23 17 0 15 Dec 2022
Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning Shih-Cheng Huang Shi Wang Min-Han Shih Saurav Sahay Hung-yi Lee 42 0 0 02 Dec 2022
AIO-P: Expanding Neural Performance Predictors Beyond Image Classification Keith G. Mills Di Niu Mohammad Salameh Weichen Qiu Fred X. Han Puyuan Liu Jialin Zhang Wei Lu Shangling Jui 38 7 0 30 Nov 2022
Embracing Ambiguity: Improving Similarity-oriented Tasks with Contextual Synonym Knowledge Yong Li Jiaoyan Chen Hai-Tao Zheng Tianyu Yu Xi Chen Haitao Zheng 14 14 0 20 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 26 124 0 11 Nov 2022