Multi-task learning for natural language processing in the 2020s: where are we going?

22 July 2020

Papers citing "Multi-task learning for natural language processing in the 2020s: where are we going?"

30 / 30 papers shown

Title
Not Enough Data? Deep Learning to the Rescue! Ateret Anaby-Tavor Boaz Carmeli Esther Goldbraich Amir Kantor George Kour Segev Shlomov N. Tepper Naama Zwerdling 70 370 0 08 Nov 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 377 20,053 0 23 Oct 2019
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations Zhenzhong Lan Mingda Chen Sebastian Goodman Kevin Gimpel Piyush Sharma Radu Soricut SSL AIMat 332 6,441 0 26 Sep 2019
Ellipsis Resolution as Question Answering: An Evaluation Rahul Aralikatte Matthew Lamm D. Hardt Anders Søgaard 44 3 0 29 Aug 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 529 24,351 0 26 Jul 2019
SpanBERT: Improving Pre-training by Representing and Predicting Spans Mandar Joshi Danqi Chen Yinhan Liu Daniel S. Weld Luke Zettlemoyer Omer Levy 133 1,962 0 24 Jul 2019
BAM! Born-Again Multi-Task Networks for Natural Language Understanding Kevin Clark Minh-Thang Luong Urvashi Khandelwal Christopher D. Manning Quoc V. Le 53 229 0 10 Jul 2019
XLNet: Generalized Autoregressive Pretraining for Language Understanding Zhilin Yang Zihang Dai Yiming Yang J. Carbonell Ruslan Salakhutdinov Quoc V. Le AI4CE 220 8,415 0 19 Jun 2019
AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligence Jeff Clune 110 122 0 27 May 2019
Which Tasks Should Be Learned Together in Multi-task Learning? Trevor Scott Standley Amir Zamir Dawn Chen Leonidas Guibas Jitendra Malik Silvio Savarese 95 517 0 18 May 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Jinpeng Wang Yada Pruksachatkun Nikita Nangia Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 242 2,307 0 02 May 2019
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension Najoung Kim Roma Patel Adam Poliak Alex Jinpeng Wang Patrick Xia ... Alexis Ross Tal Linzen Benjamin Van Durme Samuel R. Bowman Ellie Pavlick 66 107 0 25 Apr 2019
Task2Vec: Task Embedding for Meta-Learning Alessandro Achille Michael Lam Rahul Tewari Avinash Ravichandran Subhransu Maji Charless C. Fowlkes Stefano Soatto Pietro Perona SSL 75 314 0 10 Feb 2019
Multi-Task Deep Neural Networks for Natural Language Understanding Xiaodong Liu Pengcheng He Weizhu Chen Jianfeng Gao AI4CE 121 1,270 0 31 Jan 2019
Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Tasks Jason Phang Thibault Févry Samuel R. Bowman 85 468 0 02 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.6K 94,511 0 11 Oct 2018
Seq2Seq and Multi-Task Learning for joint intent and content extraction for domain specific interpreters Marc Velay Fabrice Daniel VLM 24 2 0 01 Aug 2018
The Natural Language Decathlon: Multitask Learning as Question Answering Bryan McCann N. Keskar Caiming Xiong R. Socher AIMat MLLM BDL 125 644 0 20 Jun 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 964 7,141 0 20 Apr 2018
Continual Lifelong Learning with Neural Networks: A Review G. I. Parisi Ronald Kemker Jose L. Part Christopher Kanan S. Wermter KELM CLL 163 2,879 0 21 Feb 2018
Reverse Curriculum Generation for Reinforcement Learning Carlos Florensa David Held Markus Wulfmeier Michael Zhang Pieter Abbeel 65 443 0 17 Jul 2017
An Overview of Multi-Task Learning in Deep Neural Networks Sebastian Ruder CVBM 132 2,826 0 15 Jun 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 642 130,942 0 12 Jun 2017
Latent Multi-task Architecture Learning Sebastian Ruder Joachim Bingel Isabelle Augenstein Anders Søgaard CVBM 57 171 0 23 May 2017
Identifying beneficial task relations for multi-task learning in deep neural networks Joachim Bingel Anders Søgaard 43 252 0 27 Feb 2017
When is multitask learning effective? Semantic sequence prediction under varying data conditions Héctor Martínez Alonso Barbara Plank 65 163 0 07 Dec 2016
Transfer Learning for Low-Resource Neural Machine Translation Barret Zoph Deniz Yuret Jonathan May Kevin Knight 76 855 0 08 Apr 2016
How Transferable are Neural Networks in NLP Applications? Lili Mou Zhao Meng Rui Yan Ge Li Yan Xu Lu Zhang Zhi Jin 38 300 0 19 Mar 2016
Multi-task Sequence to Sequence Learning Minh-Thang Luong Quoc V. Le Ilya Sutskever Oriol Vinyals Lukasz Kaiser AIMat 101 807 0 19 Nov 2015
Distilling the Knowledge in a Neural Network Geoffrey E. Hinton Oriol Vinyals J. Dean FedML 318 19,609 0 09 Mar 2015