How Useful is Self-Supervised Pretraining for Visual Tasks?

31 March 2020

Papers citing "How Useful is Self-Supervised Pretraining for Visual Tasks?"

32 / 32 papers shown

Title
Why does my medical AI look at pictures of birds? Exploring the efficacy of transfer learning across domain boundaries F. Jonske M. Kim Enrico Nasca J. Evers Johannes Haubold ... F. Nensa Michael Kamp C. Seibold Jan Egger Jens Kleesiek 79 1 0 17 Feb 2025
Self-supervised Learning via Cluster Distance Prediction for Operating Room Context Awareness Idris Hamoud Alexandros Karargyris Aidean Sharghi Omid Mohareri N. Padoy SSL 28 1 0 07 Jul 2024
On the Difficulty of Defending Contrastive Learning against Backdoor Attacks Changjiang Li Ren Pang Bochuan Cao Zhaohan Xi Jinghui Chen Shouling Ji Ting Wang AAML 36 6 0 14 Dec 2023
Individualized Deepfake Detection Exploiting Traces Due to Double Neural-Network Operations Mushfiqur Rahman Runze Liu Chau-Wai Wong Huaiyu Dai 36 0 0 13 Dec 2023
Representation Synthesis by Probabilistic Many-Valued Logic Operation in Self-Supervised Learning Hiroki Nakamura Masashi Okada T. Taniguchi SSL NAI 25 0 0 08 Sep 2023
Overwriting Pretrained Bias with Finetuning Data Angelina Wang Olga Russakovsky 21 29 0 10 Mar 2023
Learning Visual Representations via Language-Guided Sampling Mohamed El Banani Karan Desai Justin Johnson SSL VLM 16 28 0 23 Feb 2023
A Review of Predictive and Contrastive Self-supervised Learning for Medical Images Wei-Chien Wang E. Ahn Da-wei Feng Jinman Kim MedIm 24 27 0 10 Feb 2023
Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud Yachao Zhang Zhonghao Li Yuan Xie Yanyun Qu Cuihua Li Tao Mei 3DPC 24 94 0 09 Dec 2022
Rethinking Two Consensuses of the Transferability in Deep Learning Yixiong Chen Jingxia Li C. Ding Li Liu 31 2 0 01 Dec 2022
Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works Chao Tao Ji Qi Mingning Guo Qing Zhu Haifeng Li SSL 24 56 0 15 Nov 2022
Data-Limited Tissue Segmentation using Inpainting-Based Self-Supervised Learning J. Dominic Nandita Bhaskhar Arjun D Desai Andrew M Schmidt E. Rubin ... G. Gold B. Hargreaves L. Lenchik R. Boutin Akshay S. Chaudhari 15 0 0 14 Oct 2022
Composite Learning for Robust and Effective Dense Predictions Menelaos Kanakis Thomas E. Huang David Brüggemann F. I. F. Richard Yu Luc Van Gool SSL 39 3 0 13 Oct 2022
IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languages Tahir Javed Kaushal Bhogale A. Raman Anoop Kunchukuttan Pratyush Kumar Mitesh M. Khapra ELM 30 20 0 24 Aug 2022
Improving Fine-tuning of Self-supervised Models with Contrastive Initialization Haolin Pan Yong Guo Qinyi Deng Hao-Fan Yang Yiqun Chen Jian Chen SSL 18 19 0 30 Jul 2022
A Closer Look at Self-Supervised Lightweight Vision Transformers Shaoru Wang Jin Gao Zeming Li Jian-jun Sun Weiming Hu ViT 67 41 0 28 May 2022
Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey Kento Nozawa Issei Sato AI4TS 19 4 0 18 Apr 2022
Comparison Analysis of Traditional Machine Learning and Deep Learning Techniques for Data and Image Classification Efstathios Karypidis Stylianos G. Mouslech Kassiani Skoulariki Alexandros Gazis 20 14 0 11 Apr 2022
Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data Kyungjune Baek Hyunjung Shim 22 12 0 11 Apr 2022
Scaled ReLU Matters for Training Vision Transformers Pichao Wang Xue Wang Haowen Luo Jingkai Zhou Zhipeng Zhou Fan Wang Hao Li R. L. Jin 19 41 0 08 Sep 2021
A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective? Hiroaki Mikami Kenji Fukumizu Shogo Murai Shuji Suzuki Yuta Kikuchi Taiji Suzuki S. Maeda Kohei Hayashi 40 12 0 25 Aug 2021
How Transferable Are Self-supervised Features in Medical Image Classification Tasks? T. Truong Sadegh Mohammadi Matthias Lenga 42 45 0 23 Aug 2021
Geographical Knowledge-driven Representation Learning for Remote Sensing Images Wenyuan Li Keyan Chen Hao Chen Zhenwei Shi SSL 38 64 0 12 Jul 2021
Contrasting Contrastive Self-Supervised Representation Learning Pipelines Klemen Kotar Gabriel Ilharco Ludwig Schmidt Kiana Ehsani Roozbeh Mottaghi SSL 23 45 0 25 Mar 2021
Self-Supervised Pretraining Improves Self-Supervised Pretraining Colorado Reed Xiangyu Yue Aniruddha Nrusimha Sayna Ebrahimi Vivek Vijaykumar ... Shanghang Zhang Devin Guillory Sean L. Metzger Kurt Keutzer Trevor Darrell 25 105 0 23 Mar 2021
Self-supervised deep convolutional neural network for chest X-ray classification Matej Gazda J. Gazda J. Plávka P. Drotár SSL 30 55 0 04 Mar 2021
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning Kento Nozawa Issei Sato SSL 20 43 0 13 Feb 2021
Aggregative Self-Supervised Feature Learning from a Limited Sample Jiuwen Zhu Yuexiang Li S. Kevin Zhou SSL 22 0 0 14 Dec 2020
Learning Heatmap-Style Jigsaw Puzzles Provides Good Pretraining for 2D Human Pose Estimation Kun Zhang Rui Wu Ping Yao Kai Deng Ding Li Renbiao Liu Chuanguang Yang Ge Chen Min Du Tianyao Zheng 3DH 13 1 0 13 Dec 2020
Deep learning for time series classification Hassan Ismail Fawaz BDL AI4TS 43 35 0 01 Oct 2020
Self-Path: Self-supervision for Classification of Pathology Images with Limited Annotations Navid Alemi Koohbanani Balagopal Unnikrishnan S. Khurram Pavitra Krishnaswamy Nasir M. Rajpoot SSL 22 164 0 12 Aug 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 38 1,586 0 15 Jun 2020