VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

11 May 2021

Papers citing "VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning"

50 / 613 papers shown

Title
Towards Self-Supervised Gaze Estimation Arya Farkhondeh Cristina Palmero Simone Scardapane Sergio Escalera SSL 22 7 0 21 Mar 2022
Using the Order of Tomographic Slices as a Prior for Neural Networks Pre-Training Yaroslav Zharov A. Ershov T. Baumbach Vincent Heuveline 17 0 0 17 Mar 2022
Magnification Prior: A Self-Supervised Method for Learning Representations on Breast Cancer Histopathological Images Prakash Chandra Chhipa Richa Upadhyay G. Pihlgren Rajkumar Saini Seiichi Uchida Marcus Liwicki SSL MedIm 24 19 0 15 Mar 2022
SIGMA: Semantic-complete Graph Matching for Domain Adaptive Object Detection Wuyang Li Xinyu Liu Yixuan Yuan 31 138 0 12 Mar 2022
On Generalizing Beyond Domains in Cross-Domain Continual Learning Christian Simon M. Faraki Yi-Hsuan Tsai Xiang Yu S. Schulter Yumin Suh Mehrtash Harandi Manmohan Chandraker FedML OOD CLL 13 31 0 08 Mar 2022
HEAR: Holistic Evaluation of Audio Representations Joseph P. Turian Jordie Shier H. Khan Bhiksha Raj Björn W. Schuller ... P. Esling Pranay Manocha Shinji Watanabe Zeyu Jin Yonatan Bisk 31 99 0 06 Mar 2022
Measuring Self-Supervised Representation Quality for Downstream Classification using Discriminative Features N. Kalibhat Kanika Narang Hamed Firooz Maziar Sanjabi S. Feizi SSL 31 7 0 03 Mar 2022
Improved Dual Correlation Reduction Network Yue Liu Sihang Zhou Xinwang Liu Wenxuan Tu Xihong Yang 19 22 0 25 Feb 2022
Augment with Care: Contrastive Learning for Combinatorial Problems Haonan Duan Pashootan Vaezipoor Max B. Paulus Yangjun Ruan Chris J. Maddison SSL 11 19 0 17 Feb 2022
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision Priya Goyal Quentin Duval Isaac Seessel Mathilde Caron Ishan Misra Levent Sagun Armand Joulin Piotr Bojanowski VLM SSL 26 110 0 16 Feb 2022
Planckian Jitter: countering the color-crippling effects of color jitter on self-supervised training Simone Zini Alex Gomez-Villa M. Buzzelli Bartlomiej Twardowski Andrew D. Bagdanov Joost van de Weijer 16 13 0 16 Feb 2022
Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learning Kexue Fu Peng Gao Renrui Zhang Hongsheng Li Yu Qiao Manning Wang SSL 3DPC 20 23 0 09 Feb 2022
Simple Control Baselines for Evaluating Transfer Learning Andrei Atanov Shijian Xu Onur Beker Andrei Filatov Amir Zamir SSL 29 1 0 07 Feb 2022
Context Autoencoder for Self-Supervised Representation Learning Xiaokang Chen Mingyu Ding Xiaodi Wang Ying Xin Shentong Mo Yunhao Wang Shumin Han Ping Luo Gang Zeng Jingdong Wang SSL 45 386 0 07 Feb 2022
PARCEL: Physics-based Unsupervised Contrastive Representation Learning for Multi-coil MR Imaging Shanshan Wang Ruo-Nan Wu Cheng Li J. Zou Ziyao Zhang Qiegen Liu Yan Xi Hairong Zheng SSL 12 17 0 03 Feb 2022
Neural Manifold Clustering and Embedding Zengyi Li Yubei Chen Yann LeCun Friedrich T. Sommer DRL 22 41 0 24 Jan 2022
Video Transformers: A Survey Javier Selva A. S. Johansen Sergio Escalera Kamal Nasrollahi T. Moeslund Albert Clapés ViT 22 103 0 16 Jan 2022
Bringing Your Own View: Graph Contrastive Learning without Prefabricated Data Augmentations Yuning You Tianlong Chen Zhangyang Wang Yang Shen SSL 24 61 0 04 Jan 2022
Are Large-scale Datasets Necessary for Self-Supervised Pre-training? Alaaeldin El-Nouby Gautier Izacard Hugo Touvron Ivan Laptev Hervé Jégou Edouard Grave SSL 27 148 0 20 Dec 2021
Sparse Coding with Multi-Layer Decoders using Variance Regularization Katrina Evtimova Yann LeCun BDL OffRL 18 9 0 16 Dec 2021
High Fidelity Visualization of What Your Self-Supervised Representation Knows About Florian Bordes Randall Balestriero Pascal Vincent DiffM 25 61 0 16 Dec 2021
Revisiting Consistency Regularization for Semi-Supervised Learning Yue Fan Anna Kukleva Bernt Schiele 16 57 0 10 Dec 2021
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework Chenxin Tao Honghui Wang Xizhou Zhu Jiahua Dong S. Song Gao Huang Jifeng Dai SSL 33 60 0 09 Dec 2021
Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning Yujun Shi Kuangqi Zhou Jian Liang Zihang Jiang Jiashi Feng Philip H. S. Torr Song Bai Vincent Y. F. Tan CLL 26 62 0 09 Dec 2021
Self-Supervised Models are Continual Learners Enrico Fini Victor G. Turrisi da Costa Xavier Alameda-Pineda Elisa Ricci Alahari Karteek Julien Mairal BDL CLL SSL 33 157 0 08 Dec 2021
Joint Learning of Localized Representations from Medical Images and Reports Philipp Muller Georgios Kaissis Cong Zou Daniel Munich 132 81 0 06 Dec 2021
The Surprising Effectiveness of Representation Learning for Visual Imitation Jyothish Pari Nur Muhammad (Mahi) Shafiullah Sridhar Pandian Arunachalam Lerrel Pinto SSL 25 155 0 02 Dec 2021
MC-SSL0.0: Towards Multi-Concept Self-Supervised Learning Sara Atito Muhammad Awais Ammarah Farooq Zhenhua Feng J. Kittler 17 17 0 30 Nov 2021
Similarity Contrastive Estimation for Self-Supervised Soft Contrastive Learning J. Denize Jaonary Rabarisoa Astrid Orcesi Romain Hérault S. Canu SSL 19 30 0 29 Nov 2021
Long-range and hierarchical language predictions in brains and algorithms Charlotte Caucheteux Alexandre Gramfort J. King 20 22 0 28 Nov 2021
A Softmax-free Loss Function Based on Predefined Optimal-distribution of Latent Features for Deep Learning Classifier Qiuyu Zhu Xuewen Zu 22 5 0 25 Nov 2021
MIO : Mutual Information Optimization using Self-Supervised Binary Contrastive Learning Siladittya Manna Umapada Pal Saumik Bhattacharya SSL 35 1 0 24 Nov 2021
HoughCL: Finding Better Positive Pairs in Dense Self-supervised Learning Yunsung Lee Teakgyu Hong Han-Cheol Cho Junbum Cha Seungryong Kim SSL 12 0 0 21 Nov 2021
Self-Supervised Audio-Visual Representation Learning with Relaxed Cross-Modal Synchronicity Pritam Sarkar Ali Etemad SSL 23 11 0 09 Nov 2021
Augmentations in Graph Contrastive Learning: Current Methodological Flaws & Towards Better Practices Puja Trivedi Ekdeep Singh Lubana Yujun Yan Yaoqing Yang Danai Koutra 45 52 0 05 Nov 2021
Towards the Generalization of Contrastive Self-Supervised Learning Weiran Huang Mingyang Yi Xuyang Zhao Zihao Jiang SSL 21 105 0 01 Nov 2021
TLDR: Twin Learning for Dimensionality Reduction Yannis Kalantidis Carlos Lassance Jon Almazán Diane Larlus SSL 16 10 0 18 Oct 2021
Understanding Dimensional Collapse in Contrastive Self-supervised Learning Li Jing Pascal Vincent Yann LeCun Yuandong Tian SSL 25 336 0 18 Oct 2021
Self-Supervised Learning by Estimating Twin Class Distributions Feng Wang Tao Kong Rufeng Zhang Huaping Liu Hang Li SSL 55 16 0 14 Oct 2021
Decoupled Contrastive Learning Chun-Hsiao Yeh Cheng-Yao Hong Yen-Chi Hsu Tyng-Luh Liu Yubei Chen Yann LeCun 178 182 0 13 Oct 2021
Towards Demystifying Representation Learning with Non-contrastive Self-supervision Xiang Wang Xinlei Chen S. Du Yuandong Tian SSL 21 26 0 11 Oct 2021
Evaluating the fairness of fine-tuning strategies in self-supervised learning Jason Ramapuram Dan Busbridge Russ Webb 21 6 0 01 Oct 2021
Pointly-supervised 3D Scene Parsing with Viewpoint Bottleneck Liyi Luo Beiwen Tian Hao Zhao Guyue Zhou 3DPC 24 9 0 17 Sep 2021
Deep Bregman Divergence for Contrastive Learning of Visual Representations Mina Rezaei Farzin Soleymani B. Bischl Shekoofeh Azizi SSL 50 16 0 15 Sep 2021
An Empirical Study of Graph Contrastive Learning Yanqiao Zhu Yichen Xu Qiang Liu Shu Wu 11 167 0 02 Sep 2021
Computer Vision Self-supervised Learning Methods on Time Series Daesoo Lee Technology AI4TS 31 4 0 02 Sep 2021
Jointly Learnable Data Augmentations for Self-Supervised GNNs Zekarias T. Kefato Sarunas Girdzijauskas Hannes Stärk SSL 25 4 0 23 Aug 2021
AASAE: Augmentation-Augmented Stochastic Autoencoders William Falcon A. Jha Teddy Koker Kyunghyun Cho 13 0 0 26 Jul 2021
Trip-ROMA: Self-Supervised Learning with Triplets and Random Mappings Wenbin Li Xuesong Yang Meihao Kong Lei Wang Jing Huo Yang Gao Jiebo Luo 13 0 0 22 Jul 2021
SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networks Timoleon Moraitis Dmitry Toichkin Adrien Journé Yansong Chua Qinghai Guo AAML BDL 68 28 0 12 Jul 2021