Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers

24 May 2020

Anne Lauscher

Olga Majewska

Leonardo F. R. Ribeiro

Nikolai Rozanov

Papers citing "Common Sense or World Knowledge? Investigating Adapter-Based Knowledge Injection into Pretrained Transformers"

27 / 27 papers shown

Title
Efficient Domain Adaptation of Sentence Embeddings Using Adapters Tim Schopf Dennis Schneider Florian Matthes 28 5 0 06 Jul 2023
Text-To-KG Alignment: Comparing Current Methods on Classification Tasks Sondre Wold Lilja Ovrelid Erik Velldal 24 3 0 05 Jun 2023
Modular Deep Learning Jonas Pfeiffer Sebastian Ruder Ivan Vulić E. Ponti MoMe OOD 32 73 0 22 Feb 2023
Injecting Domain Knowledge in Language Models for Task-Oriented Dialogue Systems Denis Emelin Daniele Bonadiman Sawsan Alqahtani Yi Zhang Saab Mansour 20 17 0 15 Dec 2022
InforMask: Unsupervised Informative Masking for Language Model Pretraining Nafis Sadeq Canwen Xu Julian McAuley 27 13 0 21 Oct 2022
The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection Sondre Wold KELM 37 4 0 03 Oct 2022
ConceptNet infused DialoGPT for Underlying Commonsense Understanding and Reasoning in Dialogue Response Generation Ye Liu Wolfgang Maier Wolfgang Minker Stefan Ultes 49 2 0 29 Sep 2022
Visual Comparison of Language Model Adaptation Rita Sevastjanova E. Cakmak Shauli Ravfogel Ryan Cotterell Mennatallah El-Assady VLM 44 16 0 17 Aug 2022
On the Limitations of Sociodemographic Adaptation with Transformers Chia-Chien Hung Anne Lauscher Dirk Hovy Simone Paolo Ponzetto Goran Glavavs 27 0 0 01 Aug 2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers Jonas Pfeiffer Naman Goyal Xi Lin Xian Li James Cross Sebastian Riedel Mikel Artetxe LRM 40 139 0 12 May 2022
Geographic Adaptation of Pretrained Language Models Valentin Hofmann Goran Glavavs Nikola Ljubevsić J. Pierrehumbert Hinrich Schütze VLM 21 16 0 16 Mar 2022
Efficient Hierarchical Domain Adaptation for Pretrained Language Models Alexandra Chronopoulou Matthew E. Peters Jesse Dodge 33 42 0 16 Dec 2021
SocialBERT -- Transformers for Online SocialNetwork Language Modelling I. Karpov Nick Kartashev 22 3 0 13 Nov 2021
Knowledge-Enhanced Evidence Retrieval for Counterargument Generation Yohan Jo Haneul Yoo Jinyeong Bak Alice H. Oh Chris Reed Eduard H. Hovy RALM 40 12 0 19 Sep 2021
xGQA: Cross-Lingual Visual Question Answering Jonas Pfeiffer Gregor Geigle Aishwarya Kamath Jan-Martin O. Steitz Stefan Roth Ivan Vulić Iryna Gurevych 37 56 0 13 Sep 2021
Sustainable Modular Debiasing of Language Models Anne Lauscher Tobias Lüken Goran Glavas 55 120 0 08 Sep 2021
Scientia Potentia Est -- On the Role of Knowledge in Computational Argumentation Anne Lauscher Henning Wachsmuth Iryna Gurevych Goran Glavavs 27 31 0 01 Jul 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 35 51 0 12 Apr 2021
Structural Adapters in Pretrained Language Models for AMR-to-text Generation Leonardo F. R. Ribeiro Yue Zhang Iryna Gurevych 41 69 0 16 Mar 2021
Combining pre-trained language models and structured knowledge Pedro Colon-Hernandez Catherine Havasi Jason B. Alonso Matthew Huggins C. Breazeal KELM 38 48 0 28 Jan 2021
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts Jonas Pfeiffer Ivan Vulić Iryna Gurevych Sebastian Ruder 24 126 0 31 Dec 2020
Reprogramming Language Models for Molecular Representation Learning R. Vinod Pin-Yu Chen Payel Das AAML OOD 37 14 0 07 Dec 2020
AdapterDrop: On the Efficiency of Adapters in Transformers Andreas Rucklé Gregor Geigle Max Glockner Tilman Beck Jonas Pfeiffer Nils Reimers Iryna Gurevych 57 254 0 22 Oct 2020
AdapterFusion: Non-Destructive Task Composition for Transfer Learning Jonas Pfeiffer Aishwarya Kamath Andreas Rucklé Kyunghyun Cho Iryna Gurevych CLL MoMe 21 817 0 01 May 2020
K-BERT: Enabling Language Representation with Knowledge Graph Weijie Liu Peng Zhou Zhe Zhao Zhiruo Wang Qi Ju Haotang Deng Ping Wang 231 778 0 17 Sep 2019
Knowledge Enhanced Contextual Word Representations Matthew E. Peters Mark Neumann IV RobertL.Logan Roy Schwartz Vidur Joshi Sameer Singh Noah A. Smith 234 656 0 09 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 299 6,984 0 20 Apr 2018