Title
A Survey on Remote Sensing Foundation Models: From Vision to Multimodality Ziyue Huang Hongxi Yan Qiqi Zhan Shuai Yang Mingming Zhang Yiming Lei Chenkai Zhang Zeming Liu Qingjie Liu Yansen Wang 86 2 0 28 Mar 2025
Self-Supervised Learning for Pre-training Capsule Networks: Overcoming Medical Imaging Dataset Challenges Heba El-Shimy Hind Zantout M. Lones Neamat El Gayar SSL 63 1 0 07 Feb 2025
Exploring Self-Supervised Vision Transformers for Deepfake Detection: A Comparative Analysis H. Nguyen Junichi Yamagishi Isao Echizen 102 8 0 01 May 2024
A Survey on Self-Supervised Learning for Non-Sequential Tabular Data Wei-Yao Wang Wei-Wei Du Derek Xu Wei Wang Wenjie Peng LMTD 80 9 0 02 Feb 2024
Semi-supervised learning made simple with self-supervised clustering Enrico Fini Pietro Astolfi Alahari Karteek Xavier Alameda-Pineda Julien Mairal Moin Nabi Elisa Ricci SSL 63 28 0 13 Jun 2023
Learning to Mask and Permute Visual Tokens for Vision Transformer Pre-Training Lorenzo Baraldi Roberto Amoroso Marcella Cornia Lorenzo Baraldi Andrea Pilzer Rita Cucchiara 98 2 0 12 Jun 2023
FLSL: Feature-level Self-supervised Learning Qing Su Anton Netchaev Hai Helen Li Shihao Ji 53 5 0 09 Jun 2023
Semantic Segmentation using Vision Transformers: A survey Hans Thisanke Chamli Deshan K. Chamith Sachith Seneviratne Rajith Vidanaarachchi Damayanthi Herath ViT 61 153 0 05 May 2023
Domain Generalization for Mammographic Image Analysis with Contrastive Learning Zheren Li Zhiming Cui Lichi Zhang Sheng Wang Chenjin Lei ... Yajia Gu Zaiyi Liu Chunling Liu Dinggang Shen Jie‐Zhi Cheng 43 2 0 20 Apr 2023
Mixed Autoencoder for Self-supervised Visual Representation Learning Kai Chen Zhili Liu Lanqing Hong Hang Xu Zhenguo Li Dit-Yan Yeung SSL 94 45 0 30 Mar 2023
Semi-Supervised Constrained Clustering: An In-Depth Overview, Ranked Taxonomy and Future Research Directions Germán González-Almagro Daniel Peralta E. De Poorter J. Cano Salvador García 50 9 0 28 Feb 2023
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture Mahmoud Assran Quentin Duval Ishan Misra Piotr Bojanowski Pascal Vincent Michael G. Rabbat Yann LeCun Nicolas Ballas SSL AI4TS MDE 72 352 0 19 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 134 147 0 13 Jan 2023
Improving Visual Representation Learning through Perceptual Understanding Samyakh Tukra Frederick Hoffman Ken Chatfield 68 5 0 30 Dec 2022
Towards Sustainable Self-supervised Learning Shanghua Gao Pan Zhou Mingg-Ming Cheng Shuicheng Yan CLL 95 7 0 20 Oct 2022
Attention Distillation: self-supervised vision transformer students need more guidance Kai Wang Fei Yang Joost van de Weijer ViT 48 18 0 03 Oct 2022
Exploring Target Representations for Masked Autoencoders Xingbin Liu Jinghao Zhou Tao Kong Xianming Lin Rongrong Ji 137 51 0 08 Sep 2022
Self-Supervision Can Be a Good Few-Shot Learner Yuning Lu Liangjiang Wen Jianzhuang Liu Yajing Liu Xinmei Tian SSL 86 37 0 19 Jul 2022
Bootstrapped Masked Autoencoders for Vision BERT Pretraining Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu 68 77 0 14 Jul 2022
TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning Jiachen Zhu R. M. Moraes Serkan Karakulak Vlad Sobol A. Canziani Yann LeCun SSL 27 22 0 21 Jun 2022
Self-Supervised Learning for Videos: A Survey Madeline Chantry Schiappa Yogesh S Rawat M. Shah SSL 100 135 0 18 Jun 2022
Patch-level Representation Learning for Self-supervised Vision Transformers Sukmin Yun Hankook Lee Jaehyung Kim Jinwoo Shin ViT 87 67 0 16 Jun 2022
Masked Frequency Modeling for Self-Supervised Visual Pre-Training Jiahao Xie Wei Li Xiaohang Zhan Ziwei Liu Yew-Soon Ong Chen Change Loy 54 73 0 15 Jun 2022
Global Contrast Masked Autoencoders Are Powerful Pathological Representation Learners Hao Quan Xingyu Li Weixing Chen Qun Bai Mingchen Zou Ruijie Yang Tingting Zheng R. Qi Xin Gao Xiaoyu Cui MedIm 59 20 0 18 May 2022
A Comprehensive Survey of Image Augmentation Techniques for Deep Learning Mingle Xu Sook Yoon A. Fuentes D. Park VLM 89 422 0 03 May 2022
Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Florian Bordes Pascal Vincent Armand Joulin Michael G. Rabbat Nicolas Ballas SSL 94 322 0 14 Apr 2022
DeiT III: Revenge of the ViT Hugo Touvron Matthieu Cord Hervé Jégou ViT 120 413 0 14 Apr 2022
Self-supervised Vision Transformers for Joint SAR-optical Representation Learning Yi Wang C. Albrecht Xiaoxiang Zhu ViT 56 52 0 11 Apr 2022
Exploring Plain Vision Transformer Backbones for Object Detection Yanghao Li Hanzi Mao Ross B. Girshick Kaiming He ViT 90 808 0 30 Mar 2022
Generative Adversarial Networks Gilad Cohen Raja Giryes GAN 275 30,109 0 01 Mar 2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language Alexei Baevski Wei-Ning Hsu Qiantong Xu Arun Babu Jiatao Gu Michael Auli SSL VLM ViT 97 858 0 07 Feb 2022
Corrupted Image Modeling for Self-Supervised Visual Pre-Training Yuxin Fang Li Dong Hangbo Bao Xinggang Wang Furu Wei 64 88 0 07 Feb 2022
Deep Image Deblurring: A Survey Kaihao Zhang Wenqi Ren Wenhan Luo Wei-Sheng Lai B. Stenger Ming-Hsuan Yang Hongdong Li 153 244 0 26 Jan 2022
Self-Supervised Approach to Addressing Zero-Shot Learning Problem Ademola Okerinde Sam Hoggatt Divya Vani Lakkireddy Nolan Brubaker William H. Hsu L. Shamir Brian Spiesman SSL VLM 24 2 0 05 Jan 2022
SimMIM: A Simple Framework for Masked Image Modeling Zhenda Xie Zheng Zhang Yue Cao Yutong Lin Jianmin Bao Zhuliang Yao Qi Dai Han Hu 185 1,353 0 18 Nov 2021
iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou Chen Wei Huiyu Wang Wei Shen Cihang Xie Alan Yuille Tao Kong 81 735 0 15 Nov 2021
Masked Autoencoders Are Scalable Vision Learners Kaiming He Xinlei Chen Saining Xie Yanghao Li Piotr Dollár Ross B. Girshick ViT TPM 460 7,757 0 11 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 138 1,077 0 01 Nov 2021
Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li Jianwei Yang Pengchuan Zhang Mei Gao Bin Xiao Xiyang Dai Lu Yuan Jianfeng Gao ViT 97 213 0 17 Jun 2021
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao Li Dong Songhao Piao Furu Wei ViT 265 2,824 0 15 Jun 2021
MST: Masked Self-Supervised Transformer for Visual Representation Zhaowen Li Zhiyang Chen Fan Yang Wei Li Yousong Zhu ... Rui Deng Liwei Wu Rui Zhao Ming Tang Jinqiao Wang ViT 81 166 0 10 Jun 2021
Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive Lirong Wu Haitao Lin Zhangyang Gao Cheng Tan Stan.Z.Li SSL 63 254 0 16 May 2021
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes Jean Ponce Yann LeCun SSL DML 151 933 0 11 May 2021
Self-Supervised Learning with Swin Transformers Zhenda Xie Yutong Lin Zhuliang Yao Zheng Zhang Qi Dai Yue Cao Han Hu ViT 70 183 0 10 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 685 6,079 0 29 Apr 2021
An Empirical Study of Training Self-Supervised Vision Transformers Xinlei Chen Saining Xie Kaiming He ViT 154 1,864 0 05 Apr 2021
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Ze Liu Yutong Lin Yue Cao Han Hu Yixuan Wei Zheng Zhang Stephen Lin B. Guo ViT 447 21,418 0 25 Mar 2021
Barlow Twins: Self-Supervised Learning via Redundancy Reduction Jure Zbontar Li Jing Ishan Misra Yann LeCun Stéphane Deny SSL 304 2,347 0 04 Mar 2021
Transformer in Transformer Kai Han An Xiao Enhua Wu Jianyuan Guo Chunjing Xu Yunhe Wang ViT 389 1,565 0 27 Feb 2021
Learning Transferable Visual Models From Natural Language Supervision Alec Radford Jong Wook Kim Chris Hallacy Aditya A. Ramesh Gabriel Goh ... Amanda Askell Pamela Mishkin Jack Clark Gretchen Krueger Ilya Sutskever CLIP VLM 925 29,436 0 26 Feb 2021