An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models

27 February 2019

Alexandra Chronopoulou

Christos Baziotis

Alexandros Potamianos

CLL

ArXiv PDF HTML

Papers citing "An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models"

26 / 26 papers shown

Title
Analysis of Climate Campaigns on Social Media using Bayesian Model Averaging Tunazzina Islam Ruqi Zhang Dan Goldwasser 48 4 0 06 May 2023
Zero-Shot Learning for Requirements Classification: An Exploratory Study Waad Alhoshan Alessio Ferrari Liping Zhao VLM 14 39 0 09 Feb 2023
Pivotal Role of Language Modeling in Recommender Systems: Enriching Task-specific and Task-agnostic Representation Learning Kyuyong Shin Hanock Kwak Wonjae Kim Jisu Jeong Seungjae Jung KyungHyun Kim Jung-Woo Ha Sang-Woo Lee 27 4 0 07 Dec 2022
AF Adapter: Continual Pretraining for Building Chinese Biomedical Language Model Yongyu Yan Kui Xue Xiaoming Shi Qi Ye Jingping Liu Tong Ruan CLL 47 1 0 21 Nov 2022
AdaPrompt: Adaptive Model Training for Prompt-based NLP Yulong Chen Yang Liu Li Dong Shuohang Wang Chenguang Zhu Michael Zeng Yue Zhang VLM 27 45 0 10 Feb 2022
Transferability in Deep Learning: A Survey Junguang Jiang Yang Shu Jianmin Wang Mingsheng Long OOD 34 101 0 15 Jan 2022
Improving Scheduled Sampling with Elastic Weight Consolidation for Neural Machine Translation Michalis Korakakis Andreas Vlachos CLL 31 2 0 13 Sep 2021
Efficient Contrastive Learning via Novel Data Augmentation and Curriculum Learning Seonghyeon Ye Jiseon Kim Alice Oh CLL VLM 26 21 0 10 Sep 2021
Cross-lingual Transferring of Pre-trained Contextualized Language Models Zuchao Li Kevin Parnow Hai Zhao Zhuosheng Zhang Rui Wang Masao Utiyama Eiichiro Sumita 13 8 0 27 Jul 2021
Adaptive Transfer Learning on Graph Neural Networks Xueting Han Zhenhuan Huang Bang An Jing Bai 30 59 0 19 Jul 2021
Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning Liangqiong Qu Yuyin Zhou Paul Pu Liang Yingda Xia Feifei Wang Ehsan Adeli L. Fei-Fei D. Rubin FedML AI4CE 19 176 0 10 Jun 2021
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios Michael A. Hedderich Lukas Lange Heike Adel Jannik Strötgen Dietrich Klakow 219 287 0 23 Oct 2020
Continual Learning for Natural Language Generation in Task-oriented Dialog Systems Fei Mi Liangwei Chen Mengjie Zhao Minlie Huang Boi Faltings CLL KELM 19 68 0 02 Oct 2020
Automated Source Code Generation and Auto-completion Using Deep Learning: Comparing and Discussing Current Language-Model-Related Approaches Juan Cruz-Benito Sanjay Vishwakarma Francisco Martín-Fernández Ismael Faro Ibm Quantum 22 30 0 16 Sep 2020
It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners Timo Schick Hinrich Schütze 51 956 0 15 Sep 2020
TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech Andy T. Liu Shang-Wen Li Hung-yi Lee SSL 62 356 0 12 Jul 2020
Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting Sanyuan Chen Yutai Hou Yiming Cui Wanxiang Che Ting Liu Xiangzhan Yu KELM CLL 21 213 0 27 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 243 1,452 0 18 Mar 2020
A Survey on Contextual Embeddings Qi Liu Matt J. Kusner Phil Blunsom 225 146 0 16 Mar 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference Timo Schick Hinrich Schütze 258 1,591 0 21 Jan 2020
MedCAT -- Medical Concept Annotation Tool Z. Kraljevic D. Bean Aurelie Mascio Lukasz Roguski A. Folarin A. Roberts R. Bendayan Richard J. B. Dobson MedIm 26 29 0 18 Dec 2019
Localization of Fake News Detection via Multitask Transfer Learning Jan Christian Blaise Cruz Julianne Agatha Tan C. Cheng 23 33 0 21 Oct 2019
Learning ASR-Robust Contextualized Embeddings for Spoken Language Understanding Chao-Wei Huang Yun-Nung (Vivian) Chen 16 43 0 24 Sep 2019
Bridging the domain gap in cross-lingual document classification Guokun Lai Barlas Oğuz Yiming Yang Veselin Stoyanov VLM 32 14 0 16 Sep 2019
Encoder-Agnostic Adaptation for Conditional Language Generation Zachary M. Ziegler Luke Melas-Kyriazi Sebastian Gehrmann Alexander M. Rush AI4CE 11 57 0 19 Aug 2019
MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension Alon Talmor Jonathan Berant 20 172 0 31 May 2019