Boosting Self-Supervised Learning via Knowledge Transfer

1 May 2018

Papers citing "Boosting Self-Supervised Learning via Knowledge Transfer"

50 / 165 papers shown

Title
KDC-MAE: Knowledge Distilled Contrastive Mask Auto-Encoder Maheswar Bora Saurabh Atreya Aritra Mukherjee Abhijit Das 92 0 0 19 Nov 2024
Fusion from Decomposition: A Self-Supervised Approach for Image Fusion and Beyond Pengwei Liang Junjun Jiang Qing Ma Xianming Liu Jiayi Ma 32 2 0 16 Oct 2024
Local-to-Global Self-Supervised Representation Learning for Diabetic Retinopathy Grading Mostafa Hajighasemloua Samad Sheikhaei Hamid Soltanian-Zadeha 21 0 0 01 Oct 2024
Scaling Backwards: Minimal Synthetic Pre-training? Ryo Nakamura Ryu Tadokoro Ryosuke Yamada Tim Puhlfürß Iro Laina Christian Rupprecht Walid Maalej Rio Yokota Hirokatsu Kataoka DD 22 2 0 01 Aug 2024
Unsqueeze [CLS] Bottleneck to Learn Rich Representations Qing Su Shihao Ji 26 0 0 24 Jul 2024
Progressive Proxy Anchor Propagation for Unsupervised Semantic Segmentation Hyun Seok Seong WonJun Moon Subeen Lee Jae-Pil Heo 40 0 0 17 Jul 2024
Relational Representation Distillation Nikolaos Giakoumoglou Tania Stathaki 40 0 0 16 Jul 2024
Self-Supervised Representation Learning with Spatial-Temporal Consistency for Sign Language Recognition Weichao Zhao Wengang Zhou Hezhen Hu Min Wang Houqiang Li SLR 35 2 0 15 Jun 2024
MASA: Motion-aware Masked Autoencoder with Semantic Alignment for Sign Language Recognition Weichao Zhao Hezhen Hu Wen-gang Zhou Yunyao Mao Min Wang Houqiang Li SLR 44 8 0 31 May 2024
SCE-MAE: Selective Correspondence Enhancement with Masked Autoencoder for Self-Supervised Landmark Estimation Kejia Yin Varshanth R. Rao R. Jiang Xudong Liu P. Aarabi David B. Lindell 51 0 0 28 May 2024
A Review on Discriminative Self-supervised Learning Methods in Computer Vision Nikolaos Giakoumoglou Tania Stathaki Athanasios Gkelias SSL 64 1 0 08 May 2024
Pose-Guided Self-Training with Two-Stage Clustering for Unsupervised Landmark Discovery Siddharth Tourani Ahmed Alwheibi Arif Mahmood Muhammad Haris Khan DiffM 46 1 0 24 Mar 2024
Private Knowledge Sharing in Distributed Learning: A Survey Yasas Supeksala Dinh C. Nguyen Ming Ding Thilina Ranbaduge Calson Chua Jun Zhang Jun Li H. Vincent Poor 40 0 0 08 Feb 2024
Let All be Whitened: Multi-teacher Distillation for Efficient Visual Retrieval Zhe Ma Jianfeng Dong Shouling Ji Zhenguang Liu Xuhong Zhang Zonghui Wang Sifeng He Feng Qian Xiaobo Zhang Lei Yang 35 6 0 15 Dec 2023
Progressive Feature Self-reinforcement for Weakly Supervised Semantic Segmentation Jingxuan He Lechao Cheng Chaowei Fang Zunlei Feng Tingting Mu Min-Gyoo Song 18 7 0 14 Dec 2023
One-bit Supervision for Image Classification: Problem, Solution, and Beyond Hengtong Hu Lingxi Xie Xinyue Huo Richang Hong Qi Tian SSL 31 2 0 26 Nov 2023
GhostEncoder: Stealthy Backdoor Attacks with Dynamic Triggers to Pre-trained Encoders in Self-supervised Learning Qiannan Wang Changchun Yin Jiafei Wu Liming Fang Run Wang Chenhao Lin AAML 30 4 0 01 Oct 2023
Self-Supervised Open-Ended Classification with Small Visual Language Models Mohammad Mahdi Derakhshani Ivona Najdenkoska Cees G. M. Snoek M. Worring Yuki M. Asano VLM 22 0 0 30 Sep 2023
Exploring Self-supervised Skeleton-based Action Recognition in Occluded Environments Yifei Chen Kunyu Peng Alina Roitberg David Schneider Jiaming Zhang Junwei Zheng R. Liu Yufan Chen Kailun Yang Rainer Stiefelhagen 34 0 0 21 Sep 2023
Unsupervised Landmark Discovery Using Consistency Guided Bottleneck Mamona Awan M. H. Khan Sanoojan Baliah Muhammad Ahmad Waseem Salman Khan Fahad Shahbaz Khan Arif Mahmood 21 1 0 19 Sep 2023
Variational Self-Supervised Contrastive Learning Using Beta Divergence Mehmet Can Yavuz Berrin Yanikoglu SSL 35 0 0 05 Sep 2023
CL-MAE: Curriculum-Learned Masked Autoencoders Neelu Madan Nicolae-Cătălin Ristea Kamal Nasrollahi T. Moeslund Radu Tudor Ionescu 19 10 0 31 Aug 2023
Extracting Cloud-based Model with Prior Knowledge Songtao Zhao Kangjie Chen Meng Hao Jian Zhang Guowen Xu Hongwei Li Tianwei Zhang AAML MIACV SILM MLAU SLR 36 5 0 07 Jun 2023
Label-Efficient Learning in Agriculture: A Comprehensive Review Jiajia Li Dong Chen Xinda Qi Zhao Li Yanbo Huang Daniel Morris Xiaobo Tan 39 34 0 24 May 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 47 273 0 24 Apr 2023
All4One: Symbiotic Neighbour Contrastive Learning via Self-Attention and Redundancy Reduction Imanol G. Estepa Ignacio Sarasúa Bhalaji Nagarajan P. Radeva SSL 48 8 0 16 Mar 2023
DualMix: Unleashing the Potential of Data Augmentation for Online Class-Incremental Learning Yunfeng Fan Wenchao Xu Yining Qi Jiaqi Zhu Junxiao Wang Song Guo CLL 16 0 0 14 Mar 2023
Self-Supervised Learning for Group Equivariant Neural Networks Yusuke Mukuta Tatsuya Harada SSL 35 0 0 08 Mar 2023
Multi-Task Self-Supervised Time-Series Representation Learning Heejeong Choi Pilsung Kang AI4TS SSL 52 11 0 02 Mar 2023
Learning From Biased Soft Labels Hua Yuan Ning Xu Yuge Shi Xin Geng Yong Rui FedML 34 6 0 16 Feb 2023
Alphazzle: Jigsaw Puzzle Solver with Deep Monte-Carlo Tree Search Marie-Morgane Paumard Hedi Tabia David Picard 19 2 0 01 Feb 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 31 124 0 13 Jan 2023
A New Perspective to Boost Vision Transformer for Medical Image Classification Yuexiang Li Yawen Huang Nanjun He Kai Ma Yefeng Zheng ViT MedIm 21 3 0 03 Jan 2023
A Knowledge-based Learning Framework for Self-supervised Pre-training Towards Enhanced Recognition of Biomedical Microscopy Images Wei Chen Chen Li Dan Chen Xin Luo MedIm SSL 38 12 0 27 Nov 2022
Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Works Chao Tao Ji Qi Mingning Guo Qing Zhu Haifeng Li SSL 24 56 0 15 Nov 2022
Structured Knowledge Distillation Towards Efficient and Compact Multi-View 3D Detection Linfeng Zhang Yukang Shi Hung-Shuo Tai Zhipeng Zhang Yuan He Ke Wang Kaisheng Ma 18 2 0 14 Nov 2022
Pixel-Wise Contrastive Distillation Junqiang Huang Zichao Guo 42 4 0 01 Nov 2022
SL3D: Self-supervised-Self-labeled 3D Recognition Fernando Julio Cendra Lan Ma Jiajun Shen Xiaojuan Qi 3DPC 37 3 0 30 Oct 2022
CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completion Philippe Weinzaepfel Vincent Leroy Thomas Lucas Romain Brégier Yohann Cabon Vaibhav Arora L. Antsfeld Boris Chidlovskii G. Csurka Jérôme Revaud SSL 42 64 0 19 Oct 2022
Attention Distillation: self-supervised vision transformer students need more guidance Kai Wang Fei Yang Joost van de Weijer ViT 30 16 0 03 Oct 2022
Improving Image Clustering through Sample Ranking and Its Application to remote--sensing images Qing Li Guoping Qiu 48 2 0 26 Sep 2022
Weakly Supervised Semantic Segmentation via Progressive Patch Learning Jinlong Li Zequn Jie Xu Wang Yu Zhou Xiaolin K. Wei Lin Ma VLM 55 20 0 16 Sep 2022
MimCo: Masked Image Modeling Pre-training with Contrastive Teacher Qiang-feng Zhou Chaohui Yu Haowen Luo Zhibin Wang Hao Li VLM 54 20 0 07 Sep 2022
Tailoring Self-Supervision for Supervised Learning WonJun Moon Ji-Hwan Kim Jae-Pil Heo SSL 14 10 0 20 Jul 2022
Unsupervised Visual Representation Learning by Synchronous Momentum Grouping Bo Pang Yifan Zhang Yaoyi Li Jia Cai Cewu Lu SSL 25 27 0 13 Jul 2022
Contrastive Deep Supervision Linfeng Zhang Xin Chen Junbo Zhang Runpei Dong Kaisheng Ma 72 28 0 12 Jul 2022
Self-supervised Learning in Remote Sensing: A Review Yi Wang C. Albrecht Nassim Ait Ali Braham Lichao Mou Xiao Xiang Zhu 27 218 0 27 Jun 2022
Replacing Labeled Real-image Datasets with Auto-generated Contours Hirokatsu Kataoka Ryo Hayamizu Ryosuke Yamada Kodai Nakashima Sora Takashima Xinyu Zhang Edgar Josafat Martinez-Noriega Nakamasa Inoue Rio Yokota 22 23 0 18 Jun 2022
Self-Supervised Learning for Videos: A Survey Madeline Chantry Schiappa Y. S. Rawat M. Shah SSL 36 131 0 18 Jun 2022
A Simple Data Mixing Prior for Improving Self-Supervised Learning Sucheng Ren Huiyu Wang Zhengqi Gao Shengfeng He Alan Yuille Yuyin Zhou Cihang Xie 18 35 0 15 Jun 2022