On Feature Decorrelation in Self-Supervised Learning

2 May 2021

Yue Wang

Hang Zhao

SSL

OOD

ArXiv PDF HTML

Papers citing "On Feature Decorrelation in Self-Supervised Learning"

26 / 126 papers shown

Title
Virtual embeddings and self-consistency for self-supervised learning T. Bdair Hossam Abdelhamid Nassir Navab Shadi Albarqouni SSL 16 0 0 13 Jun 2022
An Empirical Study on Disentanglement of Negative-free Contrastive Learning Jinkun Cao Ruiqian Nai Qing Yang Jialei Huang Yang Gao CoGe DRL 25 9 0 09 Jun 2022
Spatial Entropy as an Inductive Bias for Vision Transformers E. Peruzzo E. Sangineto Yahui Liu Marco De Nadai Wei Bi Bruno Lepri N. Sebe ViT MDE 31 1 0 09 Jun 2022
Beyond Just Vision: A Review on Self-Supervised Representation Learning on Multimodal and Temporal Data Shohreh Deldari Hao Xue Aaqib Saeed Jiayuan He Daniel V. Smith Flora D. Salim AI4TS 30 37 0 06 Jun 2022
Siamese Image Modeling for Self-Supervised Vision Representation Learning Chenxin Tao Xizhou Zhu Weijie Su Gao Huang Bin Li Jie Zhou Yu Qiao Xiaogang Wang Jifeng Dai SSL 40 94 0 02 Jun 2022
Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods Randall Balestriero Yann LeCun SSL 18 129 0 23 May 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 27 34 0 12 May 2022
Improving genetic risk prediction across diverse population by disentangling ancestry representations P. Gyawali Yann Le Guen Xiaoxia Liu Hua Tang J. Zou Zihuai He 12 7 0 10 May 2022
DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings Yung-Sung Chuang Rumen Dangovski Hongyin Luo Yang Zhang Shiyu Chang M. Soljavcić Shang-Wen Li Wen-tau Yih Yoon Kim James R. Glass 38 220 0 21 Apr 2022
Contrasting the landscape of contrastive and non-contrastive learning Ashwini Pokle Jinjin Tian Yuchen Li Andrej Risteski SSL 30 28 0 29 Mar 2022
Improving Contrastive Learning with Model Augmentation Zhiwei Liu Yong-Guang Chen Jia Li Man Luo Philip S. Yu Caiming Xiong 28 11 0 25 Mar 2022
On Understanding and Mitigating the Dimensional Collapse of Graph Contrastive Learning: a Non-Maximum Removal Approach Jiawei Sun Ruoxin Chen Jie Li Chentao Wu Yue Ding Junchi Yan 29 0 0 24 Mar 2022
Crafting Better Contrastive Views for Siamese Representation Learning Xiang Peng Kai Wang Zheng Hua Zhu Mang Wang Yang You SSL 28 102 0 07 Feb 2022
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework Chenxin Tao Honghui Wang Xizhou Zhu Jiahua Dong S. Song Gao Huang Jifeng Dai SSL 38 60 0 09 Dec 2021
Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning Yujun Shi Kuangqi Zhou Jian Liang Zihang Jiang Jiashi Feng Philip H. S. Torr Song Bai Vincent Y. F. Tan CLL 28 62 0 09 Dec 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 106 0 01 Nov 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 25 338 0 18 Oct 2021
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 21 26 0 11 Oct 2021
Computer Vision Self-supervised Learning Methods on Time Series Daesoo Lee Technology AI4TS 31 4 0 02 Sep 2021
From Canonical Correlation Analysis to Self-supervised Graph Neural Networks Hengrui Zhang Qitian Wu Junchi Yan David Wipf Philip S. Yu SSL 22 211 0 23 Jun 2021
Efficient Training of Visual Transformers with Small Datasets Yahui Liu E. Sangineto Wei Bi N. Sebe Bruno Lepri Marco De Nadai ViT 36 164 0 07 Jun 2021
Momentum Contrastive Voxel-wise Representation Learning for Semi-supervised Volumetric Medical Image Segmentation Chenyu You Ruihan Zhao Lawrence H. Staib James S. Duncan SSL 40 106 0 14 May 2021
Understanding self-supervised Learning Dynamics without Contrastive Pairs Yuandong Tian Xinlei Chen Surya Ganguli SSL 138 281 0 12 Feb 2021
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 250 114 0 20 Oct 2020
Out-of-distribution Generalization via Partial Feature Decorrelation Xin Guo Zhengxu Yu Chao Xiang Zhongming Jin Jianqiang Huang Deng Cai Xiaofei He Xiansheng Hua OODD OOD 10 0 0 30 Jul 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,371 0 09 Mar 2020