A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends

13 January 2023

Papers citing "A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends"

50 / 167 papers shown

Title
Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li Jianwei Yang Pengchuan Zhang Mei Gao Bin Xiao Xiyang Dai Lu Yuan Jianfeng Gao ViT 94 212 0 17 Jun 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 260 2,824 0 15 Jun 2021
MST: Masked Self-Supervised Transformer for Visual Representation Zhaowen Li Zhiyang Chen Fan Yang Wei Li Yousong Zhu ... Rui Deng Liwei Wu Rui Zhao Ming Tang Jinqiao Wang ViT 81 166 0 10 Jun 2021
Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive Loss Jeff Z. HaoChen Colin Wei Adrien Gaidon Tengyu Ma SSL 71 315 0 08 Jun 2021
Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive Lirong Wu Haitao Lin Zhangyang Gao Cheng Tan Stan.Z.Li SSL 61 254 0 16 May 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 151 933 0 11 May 2021
On Feature Decorrelation in Self-Supervised Learning Tianyu Hua Wenxiao Wang Zihui Xue Sucheng Ren Yue Wang Hang Zhao SSL OOD 174 193 0 02 May 2021
A Large-Scale Study on Unsupervised Spatiotemporal Representation Learning Christoph Feichtenhofer Haoqi Fan Bo Xiong Ross B. Girshick Kaiming He SSL AI4TS 95 262 0 29 Apr 2021
With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representations Debidatta Dwibedi Y. Aytar Jonathan Tompson P. Sermanet Andrew Zisserman SSL 233 467 0 29 Apr 2021
Contrastive Learning for Compact Single Image Dehazing Haiyan Wu Yanyun Qu Shaohui Lin Jingren Zhou Ruizhi Qiao Zhizhong Zhang Yuan Xie Lizhuang Ma 165 577 0 19 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 154 1,862 0 05 Apr 2021
Broaden Your Views for Self-Supervised Video Learning Adrià Recasens Pauline Luc Jean-Baptiste Alayrac Luyu Wang Ross Hemsley ... Florent Altché M. Valko Jean-Bastien Grill Aaron van den Oord Andrew Zisserman SSL AI4TS 79 128 0 30 Mar 2021
ICE: Inter-instance Contrastive Encoding for Unsupervised Person Re-identification Hao Chen Benoit Lagadec Francois Bremond SSL 101 189 0 30 Mar 2021
Contrasting Contrastive Self-Supervised Representation Learning Pipelines Klemen Kotar Gabriel Ilharco Ludwig Schmidt Kiana Ehsani Roozbeh Mottaghi SSL 82 46 0 25 Mar 2021
A Broad Study on the Transferability of Visual Representations with Contrastive Learning Ashraful Islam Chun-Fu Chen Yikang Shen Leonid Karlinsky Richard J. Radke Rogerio Feris SSL 118 113 0 24 Mar 2021
BossNAS: Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Changlin Li Tao Tang Guangrun Wang Jiefeng Peng Bing Wang Xiaodan Liang Xiaojun Chang ViT 102 107 0 23 Mar 2021
Efficient Visual Pretraining with Contrastive Detection Olivier J. Hénaff Skanda Koppula Jean-Baptiste Alayrac Aaron van den Oord Oriol Vinyals João Carreira VLM SSL 69 164 0 19 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 300 2,344 0 04 Mar 2021
Graph Self-Supervised Learning: A Survey Yixin Liu Ming Jin Shirui Pan Chuan Zhou Yu Zheng Xiwei Xu Philip S. Yu SSL 103 568 0 27 Feb 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 395 4,941 0 24 Feb 2021
Instance Localization for Self-supervised Detection Pretraining Ceyuan Yang Zhirong Wu Bolei Zhou Stephen Lin ViT SSL 128 149 0 16 Feb 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 207 284 0 12 Feb 2021
DetCo: Unsupervised Contrastive Learning for Object Detection Enze Xie Jian Ding Wenhai Wang Xiaohang Zhan Hang Xu Peize Sun Zhenguo Li Ping Luo 75 323 0 09 Feb 2021
CLEAR: Contrastive Learning for Sentence Representation Zhuofeng Wu Sinong Wang Jiatao Gu Madian Khabsa Fei Sun Hao Ma SSL 71 323 0 31 Dec 2020
Joint Generative and Contrastive Learning for Unsupervised Person Re-identification Hao Chen Yaohui Wang Benoit Lagadec A. Dantcheva Francois Bremond GAN SSL 56 141 0 16 Dec 2020
Pre-Training Transformers as Energy-Based Cloze Models Kevin Clark Minh-Thang Luong Quoc V. Le Christopher D. Manning 56 80 0 15 Dec 2020
Fine-grained Angular Contrastive Learning with Coarse Labels Guy Bukchin Eli Schwartz Kate Saenko Ori Shahar Rogerio Feris Raja Giryes Leonid Karlinsky 72 54 0 07 Dec 2020
Task Programming: Learning Data Efficient Behavior Representations Jennifer J. Sun Ann Kennedy Eric Zhan David J. Anderson Yisong Yue Pietro Perona 63 51 0 27 Nov 2020
How Well Do Self-Supervised Models Transfer? Linus Ericsson Henry Gouk Timothy M. Hospedales SSL 107 278 0 26 Nov 2020
Exploring Simple Siamese Representation Learning Xinlei Chen Kaiming He SSL 253 4,054 0 20 Nov 2020
Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning Zhenda Xie Yutong Lin Zheng Zhang Yue Cao Stephen Lin Han Hu SSL 104 413 0 19 Nov 2020
Dense Contrastive Learning for Self-Supervised Visual Pre-Training Xinlong Wang Rufeng Zhang Chunhua Shen Tao Kong Lei Li SSL 77 684 0 18 Nov 2020
AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries Q. Hu Tianlin Li Wei Hu Guo-Jun Qi SSL 40 153 0 17 Nov 2020
Intriguing Properties of Contrastive Losses Ting Chen Calvin Luo Lala Li 66 174 0 05 Nov 2020
A Survey on Contrastive Self-supervised Learning Ashish Jaiswal Ashwin Ramesh Babu Mohammad Zaki Zadeh Debapriya Banerjee F. Makedon SSL 127 1,393 0 31 Oct 2020
Representation Learning via Invariant Causal Mechanisms Jovana Mitrović Brian McWilliams Jacob Walker Lars Buesing Charles Blundell CML OOD SSL 60 249 0 15 Oct 2020
Hard Negative Mixing for Contrastive Learning Yannis Kalantidis Mert Bulent Sariyildiz Noé Pion Philippe Weinzaepfel Diane Larlus SSL 132 643 0 02 Oct 2020
Enhancing Unsupervised Video Representation Learning by Decoupling the Scene and the Motion Jinpeng Wang Yuting Gao Ke Li Jianguo Hu Xinyang Jiang Xiao-Wei Guo Rongrong Ji Xing Sun 65 65 0 12 Sep 2020
Contrastive learning, multi-view redundancy, and linear models Christopher Tosh A. Krishnamurthy Daniel J. Hsu SSL 74 166 0 24 Aug 2020
Self-supervised Video Representation Learning by Pace Prediction Jiangliu Wang Jianbo Jiao Yunhui Liu SSL AI4TS 71 235 0 13 Aug 2020
Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases Senthil Purushwalkam Abhinav Gupta SSL 79 219 0 28 Jul 2020
CycAs: Self-supervised Cycle Association for Learning Re-identifiable Descriptions Zhongdao Wang Jingwei Zhang Liang Zheng Yixuan Liu Yifan Sun Yali Li Shengjin Wang 43 94 0 15 Jul 2020
Self-Supervised Policy Adaptation during Deployment Nicklas Hansen Rishabh Jangir Yu Sun Guillem Alenyà Pieter Abbeel Alexei A. Efros Lerrel Pinto Xiaolong Wang 62 161 0 08 Jul 2020
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval Lee Xiong Chenyan Xiong Ye Li Kwok-Fung Tang Jialin Liu Paul N. Bennett Junaid Ahmed Arnold Overwijk 122 1,224 0 01 Jul 2020
Debiased Contrastive Learning Ching-Yao Chuang Joshua Robinson Yen-Chen Lin Antonio Torralba Stefanie Jegelka SSL 67 562 0 01 Jul 2020
Self-Supervised MultiModal Versatile Networks Jean-Baptiste Alayrac Adrià Recasens R. Schneider Relja Arandjelović Jason Ramapuram J. Fauw Lucas Smaira Sander Dieleman Andrew Zisserman SSL 121 373 0 29 Jun 2020
Space-Time Correspondence as a Contrastive Random Walk Allan Jabri Andrew Owens Alexei A. Efros SSL OT 77 302 0 25 Jun 2020
Contrastive learning of global and local features for medical image segmentation with limited annotations K. Chaitanya Ertunc Erdil Neerav Karani E. Konukoglu SSL 83 552 0 18 Jun 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 230 4,074 0 17 Jun 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 137 1,621 0 15 Jun 2020