Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2103.12718
Cited By
Self-Supervised Pretraining Improves Self-Supervised Pretraining
23 March 2021
Colorado Reed
Xiangyu Yue
Aniruddha Nrusimha
Sayna Ebrahimi
Vivek Vijaykumar
Richard Mao
Yue Liu
Shanghang Zhang
Devin Guillory
Sean L. Metzger
Kurt Keutzer
Trevor Darrell
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Self-Supervised Pretraining Improves Self-Supervised Pretraining"
50 / 55 papers shown
Title
A Model Zoo of Vision Transformers
Damian Falk
Léo Meynent
Florence Pfammatter
Konstantin Schurholt
Damian Borth
118
0
0
14 Apr 2025
Contrastive Learning from Exploratory Actions: Leveraging Natural Interactions for Preference Elicitation
N. Dennler
Stefanos Nikolaidis
Maja J. Matarić
366
0
0
03 Jan 2025
Big Self-Supervised Models Advance Medical Image Classification
Shekoofeh Azizi
Basil Mustafa
Fiona Ryan
Zach Beaver
Jan Freyberg
...
Alan Karthikesalingam
Simon Kornblith
Ting-Li Chen
Vivek Natarajan
Mohammad Norouzi
SSL
81
511
0
13 Jan 2021
Distant Domain Transfer Learning for Medical Imaging
Shuteng Niu
Meryl Liu
Yongxin Liu
Jian Wang
Haoze Song
OOD
60
70
0
10 Dec 2020
Geography-Aware Self-Supervised Learning
Kumar Ayush
Burak Uzkent
Chenlin Meng
Kumar Tanmay
Marshall Burke
David B. Lobell
Stefano Ermon
SSL
55
231
0
19 Nov 2020
Which Model to Transfer? Finding the Needle in the Growing Haystack
Cédric Renggli
André Susano Pinto
Luka Rimanic
J. Puigcerver
C. Riquelme
Ce Zhang
Mario Lucic
46
25
0
13 Oct 2020
Contrastive Representation Learning: A Framework and Review
Phúc H. Lê Khắc
Graham Healy
Alan F. Smeaton
SSL
AI4TS
234
697
0
10 Oct 2020
Remote Sensing Image Scene Classification with Self-Supervised Paradigm under Limited Labeled Samples
Chao Tao
Ji Qi
Weipeng Lu
Hao Wang
Haifeng Li
SSL
40
101
0
02 Oct 2020
Scalable Transfer Learning with Expert Models
J. Puigcerver
C. Riquelme
Basil Mustafa
Cédric Renggli
André Susano Pinto
Sylvain Gelly
Daniel Keysers
N. Houlsby
102
63
0
28 Sep 2020
SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning
Colorado Reed
Sean L. Metzger
A. Srinivas
Trevor Darrell
Kurt Keutzer
SSL
53
49
0
16 Sep 2020
What Should Not Be Contrastive in Contrastive Learning
Tete Xiao
Xiaolong Wang
Alexei A. Efros
Trevor Darrell
SSL
DRL
54
298
0
13 Aug 2020
Vehicle Trajectory Prediction by Transfer Learning of Semi-Supervised Models
Nick Lamm
Shashank Jaiprakash
Malavika Srikanth
Iddo Drori
87
6
0
14 Jul 2020
Transfer Learning or Self-supervised Learning? A Tale of Two Pretraining Paradigms
Xingyi Yang
Xuehai He
Yuxiao Liang
Yue Yang
Shanghang Zhang
P. Xie
SSL
22
43
0
19 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
Mathilde Caron
Ishan Misra
Julien Mairal
Priya Goyal
Piotr Bojanowski
Armand Joulin
OCL
SSL
124
4,032
0
17 Jun 2020
Self-supervised Learning: Generative or Contrastive
Xiao Liu
Fanjin Zhang
Zhenyu Hou
Zhaoyu Wang
Li Mian
Jing Zhang
Jie Tang
SSL
96
1,604
0
15 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning
Jean-Bastien Grill
Florian Strub
Florent Altché
Corentin Tallec
Pierre Harvey Richemond
...
M. G. Azar
Bilal Piot
Koray Kavukcuoglu
Rémi Munos
Michal Valko
SSL
256
6,718
0
13 Jun 2020
Don't Stop Pretraining: Adapt Language Models to Domains and Tasks
Suchin Gururangan
Ana Marasović
Swabha Swayamdipta
Kyle Lo
Iz Beltagy
Doug Downey
Noah A. Smith
VLM
AI4CE
CLL
101
2,380
0
23 Apr 2020
How Useful is Self-Supervised Pretraining for Visual Tasks?
Alejandro Newell
Jia Deng
SSL
39
136
0
31 Mar 2020
Improved Baselines with Momentum Contrastive Learning
Xinlei Chen
Haoqi Fan
Ross B. Girshick
Kaiming He
SSL
418
3,397
0
09 Mar 2020
A Simple Framework for Contrastive Learning of Visual Representations
Ting-Li Chen
Simon Kornblith
Mohammad Norouzi
Geoffrey E. Hinton
SSL
186
18,523
0
13 Feb 2020
Big Transfer (BiT): General Visual Representation Learning
Alexander Kolesnikov
Lucas Beyer
Xiaohua Zhai
J. Puigcerver
Jessica Yung
Sylvain Gelly
N. Houlsby
MQ
211
1,196
0
24 Dec 2019
The effect of task and training on intermediate representations in convolutional neural networks revealed with modified RV similarity analysis
J. Thompson
Yoshua Bengio
Marc Schoenwiesner
16
14
0
04 Dec 2019
In-domain representation learning for remote sensing
Maxim Neumann
André Susano Pinto
Xiaohua Zhai
N. Houlsby
SSL
33
62
0
15 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning
Kaiming He
Haoqi Fan
Yuxin Wu
Saining Xie
Ross B. Girshick
SSL
94
11,959
0
13 Nov 2019
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark
Xiaohua Zhai
J. Puigcerver
Alexander Kolesnikov
P. Ruyssen
C. Riquelme
...
Michael Tschannen
Marcin Michalski
Olivier Bousquet
Sylvain Gelly
N. Houlsby
SSL
58
432
0
01 Oct 2019
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks
Mingxing Tan
Quoc V. Le
3DV
MedIm
81
17,950
0
28 May 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding
Olivier J. Hénaff
A. Srinivas
J. Fauw
Ali Razavi
Carl Doersch
S. M. Ali Eslami
Aaron van den Oord
SSL
88
1,422
0
22 May 2019
Billion-scale semi-supervised learning for image classification
I. Z. Yalniz
Hervé Jégou
Kan Chen
Manohar Paluri
D. Mahajan
SSL
61
460
0
02 May 2019
Semi-supervised Domain Adaptation via Minimax Entropy
Kuniaki Saito
Donghyun Kim
Stan Sclaroff
Trevor Darrell
Kate Saenko
57
618
0
13 Apr 2019
Transfusion: Understanding Transfer Learning for Medical Imaging
M. Raghu
Chiyuan Zhang
Jon M. Kleinberg
Samy Bengio
MedIm
53
980
0
14 Feb 2019
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
Jeremy Irvin
Pranav Rajpurkar
M. Ko
Yifan Yu
Silviana Ciurea-Ilcus
...
D. Larson
C. Langlotz
Bhavik Patel
M. Lungren
A. Ng
75
2,568
0
21 Jan 2019
Moment Matching for Multi-Source Domain Adaptation
Xingchao Peng
Qinxun Bai
Xide Xia
Zijun Huang
Kate Saenko
Bo Wang
OOD
101
1,769
0
04 Dec 2018
Domain Adaptive Transfer Learning with Specialist Models
Jiquan Ngiam
Daiyi Peng
Vijay Vasudevan
Simon Kornblith
Quoc V. Le
Ruoming Pang
44
108
0
16 Nov 2018
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin
Ming-Wei Chang
Kenton Lee
Kristina Toutanova
VLM
SSL
SSeg
870
93,936
0
11 Oct 2018
A Survey on Deep Transfer Learning
Chuanqi Tan
F. Sun
Tao Kong
Wenchang Zhang
Chao Yang
Chunfang Liu
44
2,575
0
06 Aug 2018
Representation Learning with Contrastive Predictive Coding
Aaron van den Oord
Yazhe Li
Oriol Vinyals
DRL
SSL
215
10,152
0
10 Jul 2018
Do Better ImageNet Models Transfer Better?
Simon Kornblith
Jonathon Shlens
Quoc V. Le
OOD
MLT
128
1,319
0
23 May 2018
BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning
Feng Yu
Haofeng Chen
Xin Wang
Wenqi Xian
Yingying Chen
Fangchen Liu
Vashisht Madhavan
Trevor Darrell
VLM
111
2,112
0
12 May 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination
Zhirong Wu
Yuanjun Xiong
Stella X. Yu
Dahua Lin
SSL
143
3,437
0
05 May 2018
Exploring the Limits of Weakly Supervised Pretraining
D. Mahajan
Ross B. Girshick
Vignesh Ramanathan
Kaiming He
Manohar Paluri
Yixuan Li
Ashwin R. Bharambe
Laurens van der Maaten
VLM
160
1,362
0
02 May 2018
Unsupervised Representation Learning by Predicting Image Rotations
Spyros Gidaris
Praveer Singh
N. Komodakis
OOD
SSL
DRL
187
3,272
0
21 Mar 2018
xView: Objects in Context in Overhead Imagery
Darius Lam
Richard Kuzma
Kevin McGee
Samuel Dooley
Michael Laielli
Matthew K. Klaric
Yaroslav Bulatov
Brendan McCord
ObjD
31
322
0
22 Feb 2018
Playing for Benchmarks
Stephan R. Richter
Zeeshan Hayder
V. Koltun
63
466
0
21 Sep 2017
Multi-task Self-Supervised Visual Learning
Carl Doersch
Andrew Zisserman
SSL
43
631
0
25 Aug 2017
Mask R-CNN
Kaiming He
Georgia Gkioxari
Piotr Dollár
Ross B. Girshick
ObjD
275
27,018
0
20 Mar 2017
Remote Sensing Image Scene Classification: Benchmark and State of the Art
Gong Cheng
Junwei Han
Xiaoqiang Lu
74
2,237
0
01 Mar 2017
Colorful Image Colorization
Richard Y. Zhang
Phillip Isola
Alexei A. Efros
105
3,524
0
28 Mar 2016
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Christian Szegedy
Sergey Ioffe
Vincent Vanhoucke
Alexander A. Alemi
270
14,196
0
23 Feb 2016
Deep Residual Learning for Image Recognition
Kaiming He
Xinming Zhang
Shaoqing Ren
Jian Sun
MedIm
1.2K
192,638
0
10 Dec 2015
Unsupervised Visual Representation Learning by Context Prediction
Carl Doersch
Abhinav Gupta
Alexei A. Efros
DRL
SSL
145
2,777
0
19 May 2015
1
2
Next