VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

11 May 2021

Papers citing "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning"

50 / 613 papers shown

Title
Dynamic Channel Selection in Self-Supervised Learning Tarun Krishna Ayush Rai Y. A. D. Djilali A. Smeaton Kevin McGuinness Noel E. O'Connor SSL 34 2 0 25 Jul 2022
Improving Test-Time Adaptation via Shift-agnostic Weight Regularization and Nearest Source Prototypes Sungha Choi Seunghan Yang Seokeon Choi Sungrack Yun TTA OOD 25 64 0 24 Jul 2022
Better Reasoning Behind Classification Predictions with BERT for Fake News Detection Daesoo Lee SSL 25 0 0 23 Jul 2022
Decoupled Adversarial Contrastive Learning for Self-supervised Adversarial Robustness Chaoning Zhang Kang Zhang Chenshuang Zhang Axi Niu Jiu Feng Chang-Dong Yoo In So Kweon SSL 35 24 0 22 Jul 2022
What Do We Maximize in Self-Supervised Learning? Ravid Shwartz-Ziv Randall Balestriero Yann LeCun SSL 29 17 0 20 Jul 2022
ExAgt: Expert-guided Augmentation for Representation Learning of Traffic Scenarios Lakshman Balasubramanian Jonas Wurst R. Egolf M. Botsch Wolfgang Utschick Ke Deng ViT 27 1 0 18 Jul 2022
HOME: High-Order Mixed-Moment-based Embedding for Representation Learning Chuang Niu Ge Wang SSL 10 4 0 15 Jul 2022
Label-Efficient Self-Supervised Speaker Verification With Information Maximization and Contrastive Learning Théo Lepage Réda Dehak SSL 18 11 0 12 Jul 2022
An Embedding-Dynamic Approach to Self-supervised Learning Suhong Moon Domas Buracas Seunghyun Park Jinkyu Kim John F. Canny OCL 25 4 0 07 Jul 2022
Transfer Learning with Deep Tabular Models Roman Levin Valeriia Cherepanova Avi Schwarzschild Arpit Bansal C. B. Bruss Tom Goldstein A. Wilson Micah Goldblum OOD FedML LMTD 75 58 0 30 Jun 2022
TINC: Temporally Informed Non-Contrastive Learning for Disease Progression Modeling in Retinal OCT Volumes T. Emre A. Chakravarty Antoine Rivail Sophie Riedl U. Schmidt-Erfurth Hrvoje Bogunović 26 14 0 30 Jun 2022
Primitive Graph Learning for Unified Vector Mapping Lei Wang Min Dai Jianan He Jingwei Huang Mingwei Sun 17 0 0 28 Jun 2022
Guillotine Regularization: Why removing layers is needed to improve generalization in Self-Supervised Learning Florian Bordes Randall Balestriero Q. Garrido Adrien Bardes Pascal Vincent 22 22 0 27 Jun 2022
Self-supervised Learning in Remote Sensing: A Review Yi Wang C. Albrecht Nassim Ait Ali Braham Lichao Mou Xiao Xiang Zhu 19 218 0 27 Jun 2022
Behavior Transformers: Cloning $k$ modes with one stone Nur Muhammad (Mahi) Shafiullah Zichen Jeff Cui Ariuntuya Altanzaya Lerrel Pinto OffRL 17 221 0 22 Jun 2022
TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning Jiachen Zhu R. M. Moraes Serkan Karakulak Vlad Sobol A. Canziani Yann LeCun SSL 17 22 0 21 Jun 2022
C-SENN: Contrastive Self-Explaining Neural Network Yoshihide Sawada Keigo Nakamura SSL 13 8 0 20 Jun 2022
Bag of Image Patch Embedding Behind the Success of Self-Supervised Learning Yubei Chen Adrien Bardes Zengyi Li Yann LeCun SSL AIFin 30 7 0 17 Jun 2022
OmniMAE: Single Model Masked Pretraining on Images and Videos Rohit Girdhar Alaaeldin El-Nouby Mannat Singh Kalyan Vasudev Alwala Armand Joulin Ishan Misra ViT 35 97 0 16 Jun 2022
Masked Siamese ConvNets L. Jing Jiachen Zhu Yann LeCun SSL 35 34 0 15 Jun 2022
Learning Task-Independent Game State Representations from Unlabeled Images C. Trivedi Konstantinos Makantasis Antonios Liapis Georgios N. Yannakakis SSL 14 6 0 13 Jun 2022
Self-Supervised Representation Learning With MUlti-Segmental Informational Coding (MUSIC) Chuang Niu Ge Wang SSL 20 6 0 13 Jun 2022
Look, Radiate, and Learn: Self-Supervised Localisation via Radio-Visual Correspondence Mohammed Alloulah Maximilian Arnold SSL 21 2 0 13 Jun 2022
SERE: Exploring Feature Self-relation for Self-supervised Transformer Zhong-Yu Li Shanghua Gao Ming-Ming Cheng ViT MDE 26 14 0 10 Jun 2022
Spatial Entropy as an Inductive Bias for Vision Transformers E. Peruzzo E. Sangineto Yahui Liu Marco De Nadai Wei Bi Bruno Lepri N. Sebe ViT MDE 31 1 0 09 Jun 2022
Local Spatiotemporal Representation Learning for Longitudinally-consistent Neuroimage Analysis Mengwei Ren Neel Dey Martin Styner K. Botteron Guido Gerig 19 18 0 09 Jun 2022
Extending Momentum Contrast with Cross Similarity Consistency Regularization M. Seyfi Amin Banitalebi-Dehkordi Yong Zhang SSL 36 11 0 07 Jun 2022
Consensus Learning for Cooperative Multi-Agent Reinforcement Learning Zhiwei Xu Bin Zhang Dapeng Li Zeren Zhang Guangchong Zhou Hao Chen Guoliang Fan 16 14 0 06 Jun 2022
Beyond Just Vision: A Review on Self-Supervised Representation Learning on Multimodal and Temporal Data Shohreh Deldari Hao Xue Aaqib Saeed Jiayuan He Daniel V. Smith Flora D. Salim AI4TS 25 37 0 06 Jun 2022
M2FNet: Multi-modal Fusion Network for Emotion Recognition in Conversation Vishal M. Chudasama P. Kar Ashish Gudmalwar Nirmesh J. Shah Pankaj Wasnik N. Onoe 11 109 0 05 Jun 2022
Toward a realistic model of speech processing in the brain with self-supervised learning Juliette Millet Charlotte Caucheteux Pierre Orhan Yves Boubenec Alexandre Gramfort Ewan Dunbar Christophe Pallier J. King 28 93 0 03 Jun 2022
On the duality between contrastive and non-contrastive self-supervised learning Q. Garrido Yubei Chen Adrien Bardes Laurent Najman Yann LeCun SSL 20 88 0 03 Jun 2022
Siamese Image Modeling for Self-Supervised Vision Representation Learning Chenxin Tao Xizhou Zhu Weijie Su Gao Huang Bin Li Jie Zhou Yu Qiao Xiaogang Wang Jifeng Dai SSL 37 94 0 02 Jun 2022
Contrasting quadratic assignments for set-based representation learning A. Moskalev Ivan Sosnovik Volker Fischer A. Smeulders SSL 32 9 0 31 May 2022
Registering Image Volumes using 3D SIFT and Discrete SP-Symmetry L. Chauvin W. Wells Matthew Toews 6 1 0 30 May 2022
GMML is All you Need Sara Atito Muhammad Awais J. Kittler ViT VLM 44 18 0 30 May 2022
CyCLIP: Cyclic Contrastive Language-Image Pretraining Shashank Goel Hritik Bansal S. Bhatia Ryan A. Rossi Vishwa Vinay Aditya Grover CLIP VLM 173 132 0 28 May 2022
Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods Randall Balestriero Yann LeCun SSL 18 129 0 23 May 2022
Combining Contrastive and Supervised Learning for Video Super-Resolution Detection Viacheslav Meshchaninov Ivan Molodetskikh D. Vatolin 12 0 0 20 May 2022
Toward a Geometrical Understanding of Self-supervised Contrastive Learning Romain Cosentino Anirvan M. Sengupta Salman Avestimehr Mahdi Soltanolkotabi Antonio Ortega Ted Willke Mariano Tepper SSL 37 17 0 13 May 2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning Zixin Wen Yuanzhi Li SSL 27 34 0 12 May 2022
An Empirical Study Of Self-supervised Learning Approaches For Object Detection With Transformers Gokul Karthik Kumar Sahal Shaji Mullappilly Abhishek Singh Gehlot ViT 23 1 0 11 May 2022
Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran Mathilde Caron Ishan Misra Piotr Bojanowski Florian Bordes Pascal Vincent Armand Joulin Michael G. Rabbat Nicolas Ballas SSL 28 311 0 14 Apr 2022
VNIbCReg: VICReg with Neighboring-Invariance and better-Covariance Evaluated on Non-stationary Seismic Signal Time Series Daesoo Lee Erlend Aune N. Langet J. Eidsvik 15 0 0 06 Apr 2022
Simplicial Embeddings in Self-Supervised Learning and Downstream Classification Samuel Lavoie Christos Tsirigotis Max Schwarzer Ankit Vani Michael Noukhovitch Kenji Kawaguchi Aaron C. Courville SSL 24 17 0 01 Apr 2022
On the Importance of Asymmetry for Siamese Representation Learning Xiao Wang Haoqi Fan Yuandong Tian Daisuke Kihara Xinlei Chen SSL 24 51 0 01 Apr 2022
Self-distillation Augmented Masked Autoencoders for Histopathological Image Classification Yang Luo Zhineng Chen Shengtian Zhou Xieping Gao 25 1 0 31 Mar 2022
Dual Temperature Helps Contrastive Learning Without Many Negative Samples: Towards Understanding and Simplifying MoCo Chaoning Zhang Kang Zhang T. Pham Axi Niu Zhinan Qiao Chang-Dong Yoo In So Kweon 22 54 0 30 Mar 2022
How Does SimSiam Avoid Collapse Without Negative Samples? A Unified Understanding with Self-supervised Contrastive Learning Chaoning Zhang Kang Zhang Chenshuang Zhang T. Pham Chang-Dong Yoo In So Kweon SSL 29 71 0 30 Mar 2022
mc-BEiT: Multi-choice Discretization for Image BERT Pre-training Xiaotong Li Yixiao Ge Kun Yi Zixuan Hu Ying Shan Ling-yu Duan 37 38 0 29 Mar 2022