To Pretrain or Not to Pretrain: Examining the Benefits of Pretraining on
Resource Rich Tasks

To Pretrain or Not to Pretrain: Examining the Benefits of Pretraining on Resource Rich Tasks

15 June 2020

Sinong Wang

Madian Khabsa

Hao Ma

Papers citing "To Pretrain or Not to Pretrain: Examining the Benefits of Pretraining on Resource Rich Tasks"

6 / 6 papers shown

Title
On the Role of Pre-trained Embeddings in Binary Code Analysis Alwin Maier Felix Weissberg Konrad Rieck 105 0 0 12 Feb 2025
SpanBERT: Improving Pre-training by Representing and Predicting Spans Mandar Joshi Danqi Chen Yinhan Liu Daniel S. Weld Luke Zettlemoyer Omer Levy 128 1,962 0 24 Jul 2019
Rethinking ImageNet Pre-training Kaiming He Ross B. Girshick Piotr Dollár VLM SSeg 116 1,083 0 21 Nov 2018
Deep contextualized word representations Matthew E. Peters Mark Neumann Mohit Iyyer Matt Gardner Christopher Clark Kenton Lee Luke Zettlemoyer NAI 161 11,542 0 15 Feb 2018
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era Chen Sun Abhinav Shrivastava Saurabh Singh Abhinav Gupta VLM 147 2,393 0 10 Jul 2017
Neural Machine Translation of Rare Words with Subword Units Rico Sennrich Barry Haddow Alexandra Birch 186 7,729 0 31 Aug 2015

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.