Self-supervised Pre-training with Hard Examples Improves Visual Representations

25 December 2020

Lei Zhang

Mingyuan Zhou

Papers citing "Self-supervised Pre-training with Hard Examples Improves Visual Representations"

50 / 53 papers shown

Title
LeOCLR: Leveraging Original Images for Contrastive Learning of Visual Representations Mohammad Alkhalefi Georgios Leontidis Mingjun Zhong 87 3 0 11 Mar 2024
Do Adversarially Robust ImageNet Models Transfer Better? Hadi Salman Andrew Ilyas Logan Engstrom Ashish Kapoor Aleksander Madry 47 423 0 16 Jul 2020
Online Deep Clustering for Unsupervised Representation Learning Xiaohang Zhan Jiahao Xie Ziwei Liu Yew-Soon Ong Chen Change Loy OOD 57 186 0 18 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 75 4,032 0 17 Jun 2020
Bootstrap your own latent: A new approach to self-supervised Learning Jean-Bastien Grill Florian Strub Florent Altché Corentin Tallec Pierre Harvey Richemond ... M. G. Azar Bilal Piot Koray Kavukcuoglu Rémi Munos Michal Valko SSL 222 6,718 0 13 Jun 2020
Large-Scale Adversarial Training for Vision-and-Language Representation Learning Zhe Gan Yen-Chun Chen Linjie Li Chen Zhu Yu Cheng Jingjing Liu ObjD VLM 44 491 0 11 Jun 2020
What Makes for Good Views for Contrastive Learning? Yonglong Tian Chen Sun Ben Poole Dilip Krishnan Cordelia Schmid Phillip Isola SSL 53 1,313 0 20 May 2020
Prototypical Contrastive Learning of Unsupervised Representations Junnan Li Pan Zhou Caiming Xiong Guosheng Lin SSL DRL 100 965 0 11 May 2020
Adversarial Training for Large Neural Language Models Xiaodong Liu Hao Cheng Pengcheng He Weizhu Chen Yu Wang Hoifung Poon Jianfeng Gao AAML 62 184 0 20 Apr 2020
Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning Tianlong Chen Sijia Liu Shiyu Chang Yu Cheng Lisa Amini Zhangyang Wang AAML 24 247 0 28 Mar 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 402 3,397 0 09 Mar 2020
The Curious Case of Adversarially Robust Models: More Data Can Help, Double Descend, or Hurt Generalization Yifei Min Lin Chen Amin Karbasi AAML 59 69 0 25 Feb 2020
A Simple Framework for Contrastive Learning of Visual Representations Ting-Li Chen Simon Kornblith Mohammad Norouzi Geoffrey E. Hinton SSL 124 18,523 0 13 Feb 2020
Big Transfer (BiT): General Visual Representation Learning Alexander Kolesnikov Lucas Beyer Xiaohua Zhai J. Puigcerver Jessica Yung Sylvain Gelly N. Houlsby MQ 166 1,196 0 24 Dec 2019
Self-Supervised Learning of Pretext-Invariant Representations Ishan Misra Laurens van der Maaten SSL VLM 56 1,448 0 04 Dec 2019
Adversarial Examples Improve Image Recognition Cihang Xie Mingxing Tan Boqing Gong Jiang Wang Alan Yuille Quoc V. Le AAML 51 564 0 21 Nov 2019
Momentum Contrast for Unsupervised Visual Representation Learning Kaiming He Haoqi Fan Yuxin Wu Saining Xie Ross B. Girshick SSL 71 11,959 0 13 Nov 2019
Large Scale Adversarial Representation Learning Jeff Donahue Karen Simonyan SSL 78 542 0 04 Jul 2019
Adversarial Training Can Hurt Generalization Aditi Raghunathan Sang Michael Xie Fanny Yang John C. Duchi Percy Liang 42 241 0 14 Jun 2019
Contrastive Multiview Coding Yonglong Tian Dilip Krishnan Phillip Isola SSL 112 2,385 0 13 Jun 2019
Improving Neural Language Modeling via Adversarial Training Dilin Wang Chengyue Gong Qiang Liu AAML 57 116 0 10 Jun 2019
Selfie: Self-supervised Pretraining for Image Embedding Trieu H. Trinh Minh-Thang Luong Quoc V. Le SSL 34 112 0 07 Jun 2019
Robust Neural Machine Translation with Doubly Adversarial Inputs Yong Cheng Lu Jiang Wolfgang Macherey AAML 50 255 0 06 Jun 2019
Learning Representations by Maximizing Mutual Information Across Views Philip Bachman R. Devon Hjelm William Buchwalter SSL 134 1,463 0 03 Jun 2019
Data-Efficient Image Recognition with Contrastive Predictive Coding Olivier J. Hénaff A. Srinivas J. Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aaron van den Oord SSL 77 1,422 0 22 May 2019
CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features Sangdoo Yun Dongyoon Han Seong Joon Oh Sanghyuk Chun Junsuk Choe Y. Yoo OOD 545 4,735 0 13 May 2019
S4L: Self-Supervised Semi-Supervised Learning Xiaohua Zhai Avital Oliver Alexander Kolesnikov Lucas Beyer SSL VLM 64 790 0 09 May 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning Priya Goyal D. Mahajan Abhinav Gupta Ishan Misra SSL 36 397 0 03 May 2019
Unsupervised Data Augmentation for Consistency Training Qizhe Xie Zihang Dai Eduard H. Hovy Minh-Thang Luong Quoc V. Le 78 2,306 0 29 Apr 2019
Local Aggregation for Unsupervised Learning of Visual Embeddings Chengxu Zhuang Alex Zhai Daniel L. K. Yamins SSL 57 444 0 29 Mar 2019
Learning deep representations by mutual information estimation and maximization R. Devon Hjelm A. Fedorov Samuel Lavoie-Marchildon Karan Grewal Phil Bachman Adam Trischler Yoshua Bengio SSL DRL 190 2,649 0 20 Aug 2018
Invariant Information Clustering for Unsupervised Image Classification and Segmentation Xu Ji João F. Henriques Andrea Vedaldi SSL VLM 46 844 0 17 Jul 2018
Deep Clustering for Unsupervised Learning of Visual Features Mathilde Caron Piotr Bojanowski Armand Joulin Matthijs Douze SSL 61 1,878 0 15 Jul 2018
Representation Learning with Contrastive Predictive Coding Aaron van den Oord Yazhe Li Oriol Vinyals DRL SSL 177 10,152 0 10 Jul 2018
Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination Zhirong Wu Yuanjun Xiong Stella X. Yu Dahua Lin SSL 121 3,437 0 05 May 2018
Unsupervised Representation Learning by Predicting Image Rotations Spyros Gidaris Praveer Singh N. Komodakis OOD SSL DRL 147 3,272 0 21 Mar 2018
mixup: Beyond Empirical Risk Minimization Hongyi Zhang Moustapha Cissé Yann N. Dauphin David Lopez-Paz NoLa 212 9,687 0 25 Oct 2017
Improved Regularization of Convolutional Neural Networks with Cutout Terrance Devries Graham W. Taylor 63 3,739 0 15 Aug 2017
Towards Deep Learning Models Resistant to Adversarial Attacks Aleksander Madry Aleksandar Makelov Ludwig Schmidt Dimitris Tsipras Adrian Vladu SILM OOD 175 11,962 0 19 Jun 2017
Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning Takeru Miyato S. Maeda Masanori Koyama S. Ishii GAN 98 2,724 0 13 Apr 2017
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction Richard Y. Zhang Phillip Isola Alexei A. Efros SSL DRL 42 667 0 29 Nov 2016
Variational Autoencoder for Deep Learning of Images, Labels and Captions Yunchen Pu Zhe Gan Ricardo Henao Xin Yuan Chunyuan Li Andrew Stevens Lawrence Carin BDL CoGe 58 750 0 28 Sep 2016
Context Encoders: Feature Learning by Inpainting Deepak Pathak Philipp Krahenbuhl Jeff Donahue Trevor Darrell Alexei A. Efros SSL 23 5,277 0 25 Apr 2016
Joint Unsupervised Learning of Deep Representations and Image Clusters Jianwei Yang Devi Parikh Dhruv Batra SSL 26 814 0 13 Apr 2016
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles M. Noroozi Paolo Favaro SSL 114 2,965 0 30 Mar 2016
Colorful Image Colorization Richard Y. Zhang Phillip Isola Alexei A. Efros 93 3,524 0 28 Mar 2016
Learning Representations for Automatic Colorization Gustav Larsson Michael Maire Gregory Shakhnarovich VLM SSL 47 1,012 0 22 Mar 2016
Unsupervised Deep Embedding for Clustering Analysis Junyuan Xie Ross B. Girshick Ali Farhadi SSL 34 2,844 0 19 Nov 2015
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks Shaoqing Ren Kaiming He Ross B. Girshick Jian Sun AIMat ObjD 327 61,900 0 04 Jun 2015
Unsupervised Visual Representation Learning by Context Prediction Carl Doersch Abhinav Gupta Alexei A. Efros DRL SSL 126 2,777 0 19 May 2015