Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases

28 July 2020

Papers citing "Demystifying Contrastive Self-Supervised Learning: Invariances, Augmentations and Dataset Biases"

50 / 146 papers shown

Title
Contrastive Learning to Fine-Tune Feature Extraction Models for the Visual Cortex Alex Mulrooney Austin J. Brockmeier 41 0 0 08 Oct 2024
Improving Object Detection via Local-global Contrastive Learning Danai Triantafyllidou Sarah Parisot A. Leonardis Steven G. McDonagh 34 0 0 07 Oct 2024
Self-supervised visual learning from interactions with objects A. Aubret Céline Teulière Jochen Triesch 55 5 0 09 Jul 2024
Self-supervised Pretraining and Finetuning for Monocular Depth and Visual Odometry Boris Chidlovskii L. Antsfeld MDE ViT 29 1 0 16 Jun 2024
Is Synthetic Data all We Need? Benchmarking the Robustness of Models Trained with Synthetic Images Krishnakant Singh Thanush Navaratnam Jannik Holmer Simone Schaub-Meyer Stefan Roth DiffM 44 18 0 30 May 2024
Self-Supervised Learning Based Handwriting Verification Mihir Chauhan Mohammad Abuzar Shaikh Abhishek Satbhai Mir Basheer Ali B. Ramamurthy Mingchen Gao Siwei Lyu Sargur Srihari 24 2 0 28 May 2024
Separable Power of Classical and Quantum Learning Protocols Through the Lens of No-Free-Lunch Theorem Xinbiao Wang Yuxuan Du Kecheng Liu Yong Luo Bo Du Dacheng Tao 27 1 0 12 May 2024
Modeling Caption Diversity in Contrastive Vision-Language Pretraining Samuel Lavoie Polina Kirichenko Mark Ibrahim Mahmoud Assran Andrew Gordon Wilson Aaron Courville Nicolas Ballas CLIP VLM 64 19 0 30 Apr 2024
HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Texts Wonjae Kim Sanghyuk Chun Taekyung Kim Dongyoon Han Sangdoo Yun 39 7 0 26 Apr 2024
Understanding Hyperbolic Metric Learning through Hard Negative Sampling Yun Yue Fangzhou Lin Guanyi Mou Ziming Zhang SSL 30 1 0 23 Apr 2024
Know Yourself Better: Diverse Discriminative Feature Learning Improves Open Set Recognition Jiawen Xu 23 0 0 16 Apr 2024
LeOCLR: Leveraging Original Images for Contrastive Learning of Visual Representations Mohammad Alkhalefi Georgios Leontidis Mingjun Zhong 63 2 0 11 Mar 2024
A Large-scale Evaluation of Pretraining Paradigms for the Detection of Defects in Electroluminescence Solar Cell Images David Torpey Lawrence Pratt Richard Klein 30 0 0 27 Feb 2024
Guarding Barlow Twins Against Overfitting with Mixed Samples W. G. C. Bandara C. D. Melo Vishal M. Patel SSL 32 10 0 04 Dec 2023
Disentangling the Effects of Data Augmentation and Format Transform in Self-Supervised Learning of Image Representations N. Kalibhat Warren Morningstar Alex Bijamov Luyang Liu Karan Singhal Philip Mansfield 25 2 0 02 Dec 2023
SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer Renan A. Rojas-Gomez Karan Singhal Ali Etemad Alex Bijamov Warren Morningstar Philip Mansfield 14 1 0 02 Dec 2023
BIM: Block-Wise Self-Supervised Learning with Masked Image Modeling Yixuan Luo Mengye Ren Sai Qian Zhang 20 0 0 28 Nov 2023
Continual Learning of Unsupervised Monocular Depth from Videos Hemang Chawla Arnav Varma Elahe Arani Bahram Zonooz 27 6 0 04 Nov 2023
SAMCLR: Contrastive pre-training on complex scenes using SAM for view sampling Benjamin Missaoui Chongbin Yuan VLM 23 1 0 23 Oct 2023
Self-supervised Representation Learning From Random Data Projectors Yi Sui Tongzi Wu Jesse C. Cresswell Ga Wu George Stein Xiao Shi Huang Xiaochen Zhang M. Volkovs 24 10 0 11 Oct 2023
Siamese Representation Learning for Unsupervised Relation Extraction Guangxin Zhang Shu Chen SSL 15 2 0 01 Oct 2023
SeMAnD: Self-Supervised Anomaly Detection in Multimodal Geospatial Datasets Daria Reshetova Swetava Ganguli C. V. K. Iyer Vipul Pandey 18 3 0 26 Sep 2023
Fine-Grained Spatiotemporal Motion Alignment for Contrastive Video Representation Learning Minghao Zhu Xiao Lin Ronghao Dang Chengju Liu Qi Chen VGen 22 8 0 01 Sep 2023
Towards a Rigorous Analysis of Mutual Information in Contrastive Learning Kyungeun Lee Jaeill Kim Suhyun Kang Wonjong Rhee SSL 28 2 0 30 Aug 2023
Composition-contrastive Learning for Sentence Embeddings Sachin Chanchani Ruihong Huang 25 7 0 14 Jul 2023
ScoreCL: Augmentation-Adaptive Contrastive Learning via Score-Matching Function Jinyoung Kim Soonwoo Kwon Hyojun Go Yunsung Lee Seungtaek Choi Hyun-Gyoon Kim 27 1 0 07 Jun 2023
Evaluating The Robustness of Self-Supervised Representations to Background/Foreground Removal Xavier F. Cadet Ranya Aloufi A. Miranville S. Ahmadi-Abhari Hamed Haddadi 16 0 0 02 Jun 2023
Tied-Augment: Controlling Representation Similarity Improves Data Augmentation Emirhan Kurtuluş Zichao Li Yann N. Dauphin E. D. Cubuk 30 3 0 22 May 2023
A Cookbook of Self-Supervised Learning Randall Balestriero Mark Ibrahim Vlad Sobal Ari S. Morcos Shashank Shekhar ... Pierre Fernandez Amir Bar Hamed Pirsiavash Yann LeCun Micah Goldblum SyDa FedML SSL 44 273 0 24 Apr 2023
Self-Supervised Learning from Non-Object Centric Images with a Geometric Transformation Sensitive Architecture Taeho Kim Jong-Min Lee 26 0 0 17 Apr 2023
Self-Supervised Learning of Object Segmentation from Unlabeled RGB-D Videos Shiyang Lu Yunfu Deng Abdeslam Boularias Kostas Bekris VOS 17 0 0 09 Apr 2023
Multi-Level Contrastive Learning for Dense Prediction Task Qiushan Guo Yizhou Yu Yi-Xin Jiang Jiannan Wu Zehuan Yuan Ping Luo SSL 24 2 0 04 Apr 2023
CrOC: Cross-View Online Clustering for Dense Visual Representation Learning Thomas Stegmüller Tim Lebailly Behzad Bozorgtabar Tinne Tuytelaars Jean-Philippe Thiran 29 15 0 23 Mar 2023
Instance-Conditioned GAN Data Augmentation for Representation Learning Pietro Astolfi Arantxa Casanova Jakob Verbeek Pascal Vincent Adriana Romero Soriano M. Drozdzal 19 6 0 16 Mar 2023
Rethinking Self-Supervised Visual Representation Learning in Pre-training for 3D Human Pose and Shape Estimation Hongsuk Choi Hyeongjin Nam T. Lee Gyeongsik Moon Kyoung Mu Lee 34 7 0 09 Mar 2023
Amortised Invariance Learning for Contrastive Self-Supervision Ruchika Chavhan H. Gouk Jan Stuehmer Calum Heggan Mehrdad Yaghoobi Timothy M. Hospedales SSL 35 11 0 24 Feb 2023
Deciphering the Projection Head: Representation Evaluation Self-supervised Learning Jiajun Ma Tianyang Hu Wenjia Wang 17 8 0 28 Jan 2023
A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends Jie Gui Tuo Chen Jing Zhang Qiong Cao Zhe Sun Haoran Luo Dacheng Tao 31 124 0 13 Jan 2023
CDA: Contrastive-adversarial Domain Adaptation Nishant Yadav M. Alam Ahmed K. Farahat Dipanjan Ghosh Chetan Gupta A. Ganguly 17 2 0 10 Jan 2023
Contrastive View Design Strategies to Enhance Robustness to Domain Shifts in Downstream Object Detection Kyle Buettner Adriana Kovashka 22 2 0 09 Dec 2022
Teaching Matters: Investigating the Role of Supervision in Vision Transformers Matthew Walmer Saksham Suri Kamal Gupta Abhinav Shrivastava 35 33 0 07 Dec 2022
CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flow Philippe Weinzaepfel Thomas Lucas Vincent Leroy Yohann Cabon Vaibhav Arora Romain Brégier G. Csurka L. Antsfeld Boris Chidlovskii Jérôme Revaud ViT 20 80 0 18 Nov 2022
Far Away in the Deep Space: Dense Nearest-Neighbor-Based Out-of-Distribution Detection Silvio Galesso Max Argus Thomas Brox UQCV 25 11 0 12 Nov 2022
Rethinking Prototypical Contrastive Learning through Alignment, Uniformity and Correlation Shentong Mo Zhun Sun Chao Li 15 11 0 18 Oct 2022
Correlation between Alignment-Uniformity and Performance of Dense Contrastive Representations Jong Hak Moon Wonjae Kim E. Choi 18 3 0 17 Oct 2022
Learning Self-Regularized Adversarial Views for Self-Supervised Vision Transformers Tao Tang Changlin Li Guangrun Wang Kaicheng Yu Xiaojun Chang Xiaodan Liang ViT 23 1 0 16 Oct 2022
Improving Molecular Pretraining with Complementary Featurizations Yanqiao Zhu Dingshuo Chen Yuanqi Du Yingze Wang Qiang Liu Shu Wu AI4CE 33 6 0 29 Sep 2022
Understanding Collapse in Non-Contrastive Siamese Representation Learning Alexander C. Li Alexei A. Efros Deepak Pathak SSL 45 33 0 29 Sep 2022
Measuring the Interpretability of Unsupervised Representations via Quantized Reverse Probing Iro Laina Yuki M. Asano Andrea Vedaldi SSL 21 8 0 07 Sep 2022
Multimodal contrastive learning for remote sensing tasks Umang Jain Alex Wilson Varun Gulshan SSL 36 24 0 06 Sep 2022