K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters

5 February 2020

Xuanjing Huang

Papers citing "K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters"

50 / 316 papers shown

Title
InfuserKI: Enhancing Large Language Models with Knowledge Graphs via Infuser-Guided Knowledge Integration Fali Wang Runxue Bao Suhang Wang Wenchao Yu Yanchi Liu Wei Cheng Haifeng Chen KELM 21 8 0 18 Feb 2024
Generalizability of Mixture of Domain-Specific Adapters from the Lens of Signed Weight Directions and its Application to Effective Model Pruning Tuc Nguyen Thai Le MoMe 28 3 0 16 Feb 2024
An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration Yihao Li Ru Zhang Jianyi Liu LRM 63 16 0 07 Feb 2024
Foundation Model Sherpas: Guiding Foundation Models through Knowledge and Reasoning D. Bhattacharjya Junkyu Lee Don Joven Agravante Balaji Ganesan Radu Marinescu LLMAG 38 1 0 02 Feb 2024
What the Weight?! A Unified Framework for Zero-Shot Knowledge Composition Carolin Holtermann Markus Frohmann Navid Rekabsaz Anne Lauscher MoMe 24 5 0 23 Jan 2024
Graph Language Models Moritz Plenz Anette Frank KELM AI4CE 28 6 0 13 Jan 2024
SamLP: A Customized Segment Anything Model for License Plate Detection Haoxuan Ding Junyuan Gao Yuan. Yuan Qi. Wang MLLM VLM 34 7 0 12 Jan 2024
Training and Serving System of Foundation Models: A Comprehensive Survey Jiahang Zhou Yanyu Chen Zicong Hong Wuhui Chen Yue Yu Tao Zhang Hui Wang Chuan-fu Zhang Zibin Zheng ALM 45 6 0 05 Jan 2024
LLM Augmented LLMs: Expanding Capabilities through Composition Rachit Bansal Bidisha Samanta Siddharth Dalmia Nitish Gupta Shikhar Vashishth Sriram Ganapathy Abhishek Bapna Prateek Jain Partha P. Talukdar CLL 21 34 0 04 Jan 2024
Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs Juraj Vladika Alexander Fichtl Florian Matthes KELM 30 1 0 21 Dec 2023
Entity or Relation Embeddings? An Analysis of Encoding Strategies for Relation Extraction Frank Mtumbuka Steven Schockaert 22 0 0 18 Dec 2023
Gradient-based Parameter Selection for Efficient Fine-Tuning Zhi Zhang Qizhe Zhang Zijun Gao Renrui Zhang Ekaterina Shutova Shiji Zhou Shanghang Zhang 33 15 0 15 Dec 2023
LLaMAntino: LLaMA 2 Models for Effective Text Generation in Italian Language Pierpaolo Basile Elio Musacchio Marco Polignano Lucia Siciliani G. Fiameni Giovanni Semeraro 54 36 0 15 Dec 2023
Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs O. Ovadia Menachem Brief Moshik Mishaeli Oren Elisha RALM 40 134 0 10 Dec 2023
D $^2$ ST-Adapter: Disentangled-and-Deformable Spatio-Temporal Adapter for Few-shot Action Recognition Wenjie Pei Qizhong Tan Guangming Lu Jiandong Tian 41 3 0 03 Dec 2023
A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression Sumit Dalal Deepa Tilwani Kaushik Roy Manas Gaur Sarika Jain V. Shalin Amit P. Sheth 32 6 0 23 Nov 2023
Noise in Relation Classification Dataset TACRED: Characterization and Reduction Akshay Parekh Ashish Anand Amit Awekar 10 0 0 21 Nov 2023
Online Continual Knowledge Learning for Language Models Yuhao Wu Tongjun Shi Karthick Sharma Chun Seah Shuhao Zhang CLL KELM 33 4 0 16 Nov 2023
KTRL+F: Knowledge-Augmented In-Document Search Hanseok Oh Haebin Shin Miyoung Ko Hyunji Lee Minjoon Seo 36 3 0 14 Nov 2023
Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Models Yujin Kim Jaehong Yoon Seonghyeon Ye Sangmin Bae Namgyu Ho Sung Ju Hwang Se-Young Yun KELM 40 10 0 14 Nov 2023
On the Robustness of Question Rewriting Systems to Questions of Varying Hardness Hai Ye Hwee Tou Ng Wenjuan Han 34 3 0 12 Nov 2023
Unlearn What You Want to Forget: Efficient Unlearning for LLMs Jiaao Chen Diyi Yang MU 30 140 0 31 Oct 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models Paul Youssef Osman Alperen Koracs Meijie Li Jorg Schlotterer Christin Seifert KELM 24 16 0 25 Oct 2023
Knowledge Editing for Large Language Models: A Survey Song Wang Yaochen Zhu Haochen Liu Zaiyi Zheng Chen Chen Wenlin Yao KELM 81 137 0 24 Oct 2023
Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules Chaojun Xiao Yuqi Luo Wenbin Zhang Pengle Zhang Xu Han ... Zhengyan Zhang Ruobing Xie Zhiyuan Liu Maosong Sun Jie Zhou 30 0 0 24 Oct 2023
Cascaded Multi-task Adaptive Learning Based on Neural Architecture Search Yingying Gao Shilei Zhang Zihao Cui Chao Deng Junlan Feng 23 0 0 23 Oct 2023
Matrix Compression via Randomized Low Rank and Low Precision Factorization R. Saha Varun Srivastava Mert Pilanci 26 19 0 17 Oct 2023
Federated Class-Incremental Learning with Prompting Jiale Liu Yu-Wei Zhan Chong-Yu Zhang Xin Luo Zhen-Duo Chen Yinwei Wei CLL FedML 29 2 0 13 Oct 2023
Improving Factual Consistency for Knowledge-Grounded Dialogue Systems via Knowledge Enhancement and Alignment Boyang Xue Weichao Wang Hongru Wang Fei Mi Rui Wang Yasheng Wang Lifeng Shang Xin Jiang Qun Liu Kam-Fai Wong KELM HILM 224 15 0 12 Oct 2023
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances Zihan Zhang Meng Fang Lingxi Chen Mohammad-Reza Namazi-Rad Jun Wang KELM 24 21 0 11 Oct 2023
Prompting-based Temporal Domain Generalization Sepidehsadat Hosseini Mengyao Zhai Hossein Hajimirsadegh Frederick Tung AI4TS AI4CE OOD 25 0 0 03 Oct 2023
Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning Jie Wang Chengyu Wang Chuanqi Tan Jun Huang Ming Gao KELM 34 4 0 26 Sep 2023
"Merge Conflicts!" Exploring the Impacts of External Distractors to Parametric Knowledge Graphs Cheng Qian Xinran Zhao Sherry Tongshuang Wu KELM 30 8 0 15 Sep 2023
Detail Reinforcement Diffusion Model: Augmentation Fine-Grained Visual Categorization in Few-Shot Conditions Tianxu Wu Shuo Ye Shuhuang Chen Qinmu Peng Xinge You DiffM 35 3 0 15 Sep 2023
Introducing Language Guidance in Prompt-based Continual Learning Muhammad Gul Zain Ali Khan Muhammad Ferjad Naeem Luc Van Gool D. Stricker F. Tombari Muhammad Zeshan Afzal VLM CLL 22 47 0 30 Aug 2023
Generations of Knowledge Graphs: The Crazy Ideas and the Business Impact Xin Luna Dong 32 23 0 27 Aug 2023
Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs? Kai Sun Yongjun Xu Hanwen Zha Yue Liu Xinhsuai Dong AI4MH 39 131 0 20 Aug 2023
Evaluating the Ripple Effects of Knowledge Editing in Language Models Roi Cohen Eden Biran Ori Yoran Amir Globerson Mor Geva KELM 42 157 0 24 Jul 2023
Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph Jiashuo Sun Chengjin Xu Lumingyuan Tang Sai Wang Chen Lin Yeyun Gong Lionel M. Ni H. Shum Jian Guo LRM 38 63 0 15 Jul 2023
Efficient Domain Adaptation of Sentence Embeddings Using Adapters Tim Schopf Dennis Schneider Florian Matthes 28 5 0 06 Jul 2023
ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis Yu Mingjun Zhao Shiguang Qi Feiran Sun Baoxun Wang Weidong Guo Xiaoli Wang Lei Yang Di Niu 11 10 0 27 Jun 2023
IERL: Interpretable Ensemble Representation Learning -- Combining CrowdSourced Knowledge and Distributed Semantic Representations Yuxin Zi Kaushik Roy Vignesh Narayanan Manas Gaur Amit P. Sheth 32 8 0 24 Jun 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 40 87 0 20 Jun 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 40 723 0 14 Jun 2023
Efficient Adapters for Giant Speech Models Nanxin Chen Izhak Shafran Yu Zhang Chung-Cheng Chiu H. Soltau James Qin Yonghui Wu 27 10 0 13 Jun 2023
Parameter-efficient Dysarthric Speech Recognition Using Adapter Fusion and Householder Transformation Jinzi Qi Hugo Van hamme 43 3 0 12 Jun 2023
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories Shizhe Diao Tianyang Xu Ruijia Xu Jiawei Wang Tong Zhang MoE AI4CE 13 36 0 08 Jun 2023
Cross-Lingual Transfer with Target Language-Ready Task Adapters Marinela Parović Alan Ansell Ivan Vulić Anna Korhonen 40 9 0 05 Jun 2023
Joint Pre-training and Local Re-training: Transferable Representation Learning on Multi-source Knowledge Graphs Zequn Sun Jiacheng Huang Jing-Rong Lin Xiaozhou Xu Qijin Chen Wei Hu 34 2 0 05 Jun 2023
Commonsense Knowledge Transfer for Pre-trained Language Models Wangchunshu Zhou Ronan Le Bras Yejin Choi KELM LRM 15 4 0 04 Jun 2023