What to Pre-Train on? Efficient Intermediate Task Selection

v1v2 (latest)

What to Pre-Train on? Efficient Intermediate Task Selection

16 April 2021

Clifton A. Poth

Andreas Rucklé

ArXiv (abs)PDF HTML

Papers citing "What to Pre-Train on? Efficient Intermediate Task Selection"

12 / 62 papers shown

Title
Constructing Datasets for Multi-hop Reading Comprehension Across Documents Johannes Welbl Pontus Stenetorp Sebastian Riedel SyDa RALM 96 511 0 17 Oct 2017
Towards Universal Semantic Tagging Lasha Abzianidze Johan Bos 49 41 0 29 Sep 2017
SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluation Daniel Cer Mona T. Diab Eneko Agirre I. Lopez-Gazpio Lucia Specia 430 1,882 0 31 Jul 2017
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference Adina Williams Nikita Nangia Samuel R. Bowman 524 4,479 0 18 Apr 2017
RACE: Large-scale ReAding Comprehension Dataset From Examinations Guokun Lai Qizhe Xie Hanxiao Liu Yiming Yang Eduard H. Hovy ELM 186 1,348 0 15 Apr 2017
Identifying beneficial task relations for multi-task learning in deep neural networks Joachim Bingel Anders Søgaard 48 252 0 27 Feb 2017
NewsQA: A Machine Comprehension Dataset Adam Trischler Tong Wang Xingdi Yuan Justin Harris Alessandro Sordoni Philip Bachman Kaheer Suleman 103 893 0 29 Nov 2016
Compositional Sequence Labeling Models for Error Detection in Learner Writing Marek Rei H. Yannakoudakis 49 109 0 20 Jul 2016
SQuAD: 100,000+ Questions for Machine Comprehension of Text Pranav Rajpurkar Jian Zhang Konstantin Lopyrev Percy Liang RALM 283 8,134 0 16 Jun 2016
Towards a Neural Statistician Harrison Edwards Amos Storkey BDL 84 427 0 07 Jun 2016
Character-level Convolutional Networks for Text Classification Xiang Zhang Jiaqi Zhao Yann LeCun 268 6,113 0 04 Sep 2015
A large annotated corpus for learning natural language inference Samuel R. Bowman Gabor Angeli Christopher Potts Christopher D. Manning 315 4,287 0 21 Aug 2015